Aug 14 18:06:35 user nova-compute[73078]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 14 18:06:37 user nova-compute[73078]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=73078) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 14 18:06:37 user nova-compute[73078]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=73078) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 14 18:06:37 user nova-compute[73078]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=73078) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 14 18:06:37 user nova-compute[73078]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:06:38 user nova-compute[73078]: INFO nova.virt.driver [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 14 18:06:38 user nova-compute[73078]: INFO nova.compute.provider_config [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] Acquiring lock "singleton_lock" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] Acquired lock "singleton_lock" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] Releasing lock "singleton_lock" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] Full set of CONF: {{(pid=73078) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] ******************************************************************************** {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] Configuration options gathered from: {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] ================================================================================ {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] allow_resize_to_same_host      = True {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] arq_binding_timeout            = 300 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] backdoor_port                  = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] backdoor_socket                = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] block_device_allocate_retries  = 300 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] block_device_allocate_retries_interval = 5 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cert                           = self.pem {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] compute_monitors               = [] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] config_dir                     = [] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] config_drive_format            = iso9660 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] config_source                  = [] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] console_host                   = user {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] control_exchange               = nova {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cpu_allocation_ratio           = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] daemon                         = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] debug                          = True {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] default_access_ip_network_name = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] default_availability_zone      = nova {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] default_ephemeral_format       = ext4 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] default_schedule_zone          = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] disk_allocation_ratio          = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] enable_new_services            = True {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] enabled_apis                   = ['osapi_compute'] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] enabled_ssl_apis               = [] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] flat_injected                  = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] force_config_drive             = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] force_raw_images               = True {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] graceful_shutdown_timeout      = 5 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] heal_instance_info_cache_interval = 60 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] host                           = user {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] initial_disk_allocation_ratio  = 1.0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] initial_ram_allocation_ratio   = 1.0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] instance_build_timeout         = 0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] instance_delete_interval       = 300 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] instance_format                = [instance: %(uuid)s]  {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] instance_name_template         = instance-%08x {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] instance_usage_audit           = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] instance_usage_audit_period    = month {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] internal_service_availability_zone = internal {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] key                            = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] live_migration_retry_count     = 30 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] log_config_append              = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] log_dir                        = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] log_file                       = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] log_options                    = True {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] log_rotate_interval            = 1 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] log_rotate_interval_type       = days {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] log_rotation_type              = none {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] long_rpc_timeout               = 1800 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] max_concurrent_builds          = 10 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] max_concurrent_live_migrations = 1 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] max_concurrent_snapshots       = 5 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] max_local_block_devices        = 3 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] max_logfile_count              = 30 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] max_logfile_size_mb            = 200 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] maximum_instance_delete_attempts = 5 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] metadata_listen                = 0.0.0.0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] metadata_listen_port           = 8775 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] metadata_workers               = 3 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] migrate_max_retries            = -1 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] mkisofs_cmd                    = genisoimage {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] my_block_storage_ip            = 10.0.0.210 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] my_ip                          = 10.0.0.210 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] network_allocate_retries       = 0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] osapi_compute_listen           = 0.0.0.0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] osapi_compute_listen_port      = 8774 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] osapi_compute_unique_server_name_scope =  {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] osapi_compute_workers          = 3 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] password_length                = 12 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] periodic_enable                = True {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] periodic_fuzzy_delay           = 60 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] pointer_model                  = ps2mouse {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] preallocate_images             = none {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] publish_errors                 = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] pybasedir                      = /opt/stack/nova {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] ram_allocation_ratio           = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] rate_limit_burst               = 0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] rate_limit_except_level        = CRITICAL {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] rate_limit_interval            = 0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] reboot_timeout                 = 0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] reclaim_instance_interval      = 0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] record                         = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] reimage_timeout_per_gb         = 60 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] report_interval                = 120 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] rescue_timeout                 = 0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] reserved_host_cpus             = 0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] reserved_host_disk_mb          = 0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] reserved_host_memory_mb        = 512 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] reserved_huge_pages            = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] resize_confirm_window          = 0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] resize_fs_using_block_device   = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] resume_guests_state_on_host_boot = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] rpc_response_timeout           = 60 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] run_external_periodic_tasks    = True {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] running_deleted_instance_action = reap {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] running_deleted_instance_poll_interval = 1800 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] running_deleted_instance_timeout = 0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] scheduler_instance_sync_interval = 120 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] service_down_time              = 720 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] servicegroup_driver            = db {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] shelved_offload_time           = 0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] shelved_poll_interval          = 3600 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] shutdown_timeout               = 0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] source_is_ipv6                 = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] ssl_only                       = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] state_path                     = /opt/stack/data/nova {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] sync_power_state_interval      = 600 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] sync_power_state_pool_size     = 1000 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] syslog_log_facility            = LOG_USER {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] tempdir                        = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] timeout_nbd                    = 10 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] transport_url                  = **** {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] update_resources_interval      = 0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] use_cow_images                 = True {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] use_eventlog                   = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] use_journal                    = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] use_json                       = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] use_rootwrap_daemon            = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] use_stderr                     = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] use_syslog                     = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vcpu_pin_set                   = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vif_plugging_is_fatal          = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vif_plugging_timeout           = 0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] virt_mkfs                      = [] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] volume_usage_poll_interval     = 0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] watch_log_file                 = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] web                            = /usr/share/spice-html5 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_concurrency.disable_process_locking = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api.auth_strategy              = keystone {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api.compute_link_prefix        = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api.dhcp_domain                = novalocal {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api.enable_instance_password   = True {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api.glance_link_prefix         = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api.instance_list_cells_batch_strategy = distributed {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api.instance_list_per_project_cells = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api.list_records_by_skipping_down_cells = True {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api.local_metadata_per_cell    = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api.max_limit                  = 1000 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api.metadata_cache_expiration  = 15 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api.neutron_default_tenant_id  = default {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api.use_forwarded_for          = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api.use_neutron_default_nets   = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api.vendordata_dynamic_failure_fatal = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api.vendordata_dynamic_targets = [] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api.vendordata_jsonfile_path   = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cache.backend                  = dogpile.cache.memcached {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cache.backend_argument         = **** {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cache.config_prefix            = cache.oslo {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cache.dead_timeout             = 60.0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cache.debug_cache_backend      = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cache.enable_retry_client      = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cache.enable_socket_keepalive  = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cache.enabled                  = True {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cache.expiration_time          = 600 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cache.hashclient_retry_attempts = 2 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cache.hashclient_retry_delay   = 1.0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cache.memcache_dead_retry      = 300 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cache.memcache_password        =  {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cache.memcache_pool_maxsize    = 10 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cache.memcache_sasl_enabled    = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cache.memcache_socket_timeout  = 1.0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cache.memcache_username        =  {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cache.proxies                  = [] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cache.retry_attempts           = 2 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cache.retry_delay              = 0.0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cache.socket_keepalive_count   = 1 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cache.socket_keepalive_idle    = 1 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cache.socket_keepalive_interval = 1 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cache.tls_allowed_ciphers      = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cache.tls_cafile               = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cache.tls_certfile             = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cache.tls_enabled              = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cache.tls_keyfile              = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cinder.auth_section            = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cinder.auth_type               = password {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cinder.cafile                  = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cinder.catalog_info            = volumev3::publicURL {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cinder.certfile                = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cinder.collect_timing          = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cinder.cross_az_attach         = True {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cinder.debug                   = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cinder.endpoint_template       = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cinder.http_retries            = 3 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cinder.insecure                = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cinder.keyfile                 = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cinder.os_region_name          = RegionOne {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cinder.split_loggers           = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cinder.timeout                 = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] compute.cpu_dedicated_set      = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] compute.cpu_shared_set         = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] compute.image_type_exclude_list = [] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] compute.live_migration_wait_for_vif_plug = True {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] compute.max_concurrent_disk_ops = 0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] compute.max_disk_devices_to_attach = -1 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] compute.resource_provider_association_refresh = 300 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] compute.shutdown_retry_interval = 10 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] conductor.workers              = 3 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] console.allowed_origins        = [] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] console.ssl_ciphers            = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] console.ssl_minimum_version    = default {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] consoleauth.token_ttl          = 600 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cyborg.cafile                  = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cyborg.certfile                = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cyborg.collect_timing          = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cyborg.connect_retries         = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cyborg.connect_retry_delay     = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cyborg.endpoint_override       = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cyborg.insecure                = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cyborg.keyfile                 = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cyborg.max_version             = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cyborg.min_version             = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cyborg.region_name             = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cyborg.service_name            = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cyborg.service_type            = accelerator {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cyborg.split_loggers           = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cyborg.status_code_retries     = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cyborg.status_code_retry_delay = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cyborg.timeout                 = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] cyborg.version                 = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] database.backend               = sqlalchemy {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] database.connection            = **** {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] database.connection_debug      = 0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] database.connection_parameters =  {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] database.connection_recycle_time = 3600 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] database.connection_trace      = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] database.db_inc_retry_interval = True {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] database.db_max_retries        = 20 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] database.db_max_retry_interval = 10 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] database.db_retry_interval     = 1 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] database.max_overflow          = 50 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] database.max_pool_size         = 5 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] database.max_retries           = 10 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] database.mysql_enable_ndb      = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] database.mysql_wsrep_sync_wait = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] database.pool_timeout          = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] database.retry_interval        = 10 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] database.slave_connection      = **** {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] database.sqlite_synchronous    = True {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api_database.backend           = sqlalchemy {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api_database.connection        = **** {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api_database.connection_debug  = 0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api_database.connection_parameters =  {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api_database.connection_recycle_time = 3600 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api_database.connection_trace  = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api_database.db_inc_retry_interval = True {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api_database.db_max_retries    = 20 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api_database.db_max_retry_interval = 10 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api_database.db_retry_interval = 1 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api_database.max_overflow      = 50 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api_database.max_pool_size     = 5 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api_database.max_retries       = 10 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api_database.mysql_enable_ndb  = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api_database.mysql_wsrep_sync_wait = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api_database.pool_timeout      = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api_database.retry_interval    = 10 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api_database.slave_connection  = **** {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] api_database.sqlite_synchronous = True {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] devices.enabled_mdev_types     = [] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] ephemeral_storage_encryption.enabled = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] ephemeral_storage_encryption.key_size = 512 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] glance.api_servers             = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] glance.cafile                  = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] glance.certfile                = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] glance.collect_timing          = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] glance.connect_retries         = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] glance.connect_retry_delay     = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] glance.debug                   = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] glance.default_trusted_certificate_ids = [] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] glance.enable_certificate_validation = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] glance.enable_rbd_download     = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] glance.endpoint_override       = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] glance.insecure                = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] glance.keyfile                 = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] glance.max_version             = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] glance.min_version             = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] glance.num_retries             = 3 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] glance.rbd_ceph_conf           =  {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] glance.rbd_connect_timeout     = 5 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] glance.rbd_pool                =  {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] glance.rbd_user                =  {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] glance.region_name             = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] glance.service_name            = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] glance.service_type            = image {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] glance.split_loggers           = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] glance.status_code_retries     = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] glance.status_code_retry_delay = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] glance.timeout                 = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] glance.verify_glance_signatures = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] glance.version                 = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] guestfs.debug                  = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] hyperv.config_drive_cdrom      = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] hyperv.config_drive_inject_password = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] hyperv.enable_instance_metrics_collection = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] hyperv.enable_remotefx         = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] hyperv.instances_path_share    =  {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] hyperv.iscsi_initiator_list    = [] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] hyperv.limit_cpu_features      = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] hyperv.power_state_check_timeframe = 60 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] hyperv.power_state_event_polling_interval = 2 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] hyperv.use_multipath_io        = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] hyperv.volume_attach_retry_count = 10 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] hyperv.volume_attach_retry_interval = 5 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] hyperv.vswitch_name            = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] mks.enabled                    = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] image_cache.manager_interval   = 2400 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] image_cache.precache_concurrency = 1 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] image_cache.remove_unused_base_images = True {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] image_cache.subdirectory_name  = _base {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] ironic.api_max_retries         = 60 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] ironic.api_retry_interval      = 2 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] ironic.auth_section            = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] ironic.auth_type               = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] ironic.cafile                  = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] ironic.certfile                = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] ironic.collect_timing          = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] ironic.connect_retries         = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] ironic.connect_retry_delay     = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] ironic.endpoint_override       = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] ironic.insecure                = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] ironic.keyfile                 = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] ironic.max_version             = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] ironic.min_version             = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] ironic.partition_key           = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] ironic.peer_list               = [] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] ironic.region_name             = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] ironic.serial_console_state_timeout = 10 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] ironic.service_name            = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] ironic.service_type            = baremetal {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] ironic.split_loggers           = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] ironic.status_code_retries     = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] ironic.status_code_retry_delay = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] ironic.timeout                 = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] ironic.version                 = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] key_manager.fixed_key          = **** {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] barbican.barbican_api_version  = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] barbican.barbican_endpoint     = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] barbican.barbican_endpoint_type = public {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] barbican.barbican_region_name  = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] barbican.cafile                = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] barbican.certfile              = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] barbican.collect_timing        = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] barbican.insecure              = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] barbican.keyfile               = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] barbican.number_of_retries     = 60 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] barbican.retry_delay           = 1 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] barbican.send_service_user_token = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] barbican.split_loggers         = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] barbican.timeout               = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] barbican.verify_ssl            = True {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] barbican.verify_ssl_path       = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] barbican_service_user.auth_section = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] barbican_service_user.auth_type = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] barbican_service_user.cafile   = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] barbican_service_user.certfile = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] barbican_service_user.collect_timing = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] barbican_service_user.insecure = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] barbican_service_user.keyfile  = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] barbican_service_user.split_loggers = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] barbican_service_user.timeout  = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vault.approle_role_id          = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vault.approle_secret_id        = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vault.cafile                   = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vault.certfile                 = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vault.collect_timing           = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vault.insecure                 = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vault.keyfile                  = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vault.kv_mountpoint            = secret {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vault.kv_version               = 2 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vault.namespace                = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vault.root_token_id            = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vault.split_loggers            = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vault.ssl_ca_crt_file          = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vault.timeout                  = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vault.use_ssl                  = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] keystone.cafile                = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] keystone.certfile              = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] keystone.collect_timing        = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] keystone.connect_retries       = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] keystone.connect_retry_delay   = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] keystone.endpoint_override     = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] keystone.insecure              = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] keystone.keyfile               = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] keystone.max_version           = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] keystone.min_version           = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] keystone.region_name           = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] keystone.service_name          = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] keystone.service_type          = identity {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] keystone.split_loggers         = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] keystone.status_code_retries   = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] keystone.status_code_retry_delay = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] keystone.timeout               = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] keystone.version               = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.connection_uri         =  {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.cpu_mode               = custom {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.cpu_model_extra_flags  = [] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: WARNING oslo_config.cfg [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.cpu_power_governor_high = performance {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.cpu_power_governor_low = powersave {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.cpu_power_management   = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.device_detach_attempts = 8 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.device_detach_timeout  = 20 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.disk_cachemodes        = [] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.disk_prefix            = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.enabled_perf_events    = [] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.file_backed_memory     = 0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.gid_maps               = [] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.hw_disk_discard        = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.hw_machine_type        = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.images_rbd_ceph_conf   =  {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.images_rbd_glance_store_name =  {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.images_rbd_pool        = rbd {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.images_type            = default {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.images_volume_group    = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.inject_key             = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.inject_partition       = -2 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.inject_password        = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.iscsi_iface            = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.iser_use_multipath     = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.live_migration_bandwidth = 0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.live_migration_completion_timeout = 800 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.live_migration_downtime = 500 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.live_migration_downtime_delay = 75 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.live_migration_downtime_steps = 10 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.live_migration_inbound_addr = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.live_migration_permit_auto_converge = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.live_migration_permit_post_copy = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.live_migration_scheme  = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.live_migration_timeout_action = abort {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.live_migration_tunnelled = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: WARNING oslo_config.cfg [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 14 18:06:38 user nova-compute[73078]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 14 18:06:38 user nova-compute[73078]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 14 18:06:38 user nova-compute[73078]: and ``live_migration_inbound_addr`` respectively.
Aug 14 18:06:38 user nova-compute[73078]: ).  Its value may be silently ignored in the future.
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.live_migration_with_native_tls = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.max_queues             = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.mem_stats_period_seconds = 10 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.nfs_mount_options      = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.num_aoe_discover_tries = 3 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.num_iser_scan_tries    = 5 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.num_memory_encrypted_guests = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.num_nvme_discover_tries = 5 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.num_pcie_ports         = 0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.num_volume_scan_tries  = 5 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.pmem_namespaces        = [] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.quobyte_client_cfg     = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.rbd_connect_timeout    = 5 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.rbd_secret_uuid        = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.rbd_user               = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.realtime_scheduler_priority = 1 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.remote_filesystem_transport = ssh {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.rescue_image_id        = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.rescue_kernel_id       = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.rescue_ramdisk_id      = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.rx_queue_size          = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.smbfs_mount_options    =  {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.snapshot_compression   = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.snapshot_image_format  = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.sparse_logical_volumes = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.swtpm_enabled          = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.swtpm_group            = tss {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.swtpm_user             = tss {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.sysinfo_serial         = unique {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.tb_cache_size          = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.tx_queue_size          = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.uid_maps               = [] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.use_virtio_for_bridges = True {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.virt_type              = kvm {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.volume_clear           = zero {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.volume_clear_size      = 0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.volume_use_multipath   = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.vzstorage_cache_path   = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.vzstorage_mount_group  = qemu {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.vzstorage_mount_opts   = [] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.vzstorage_mount_user   = stack {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] neutron.auth_section           = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] neutron.auth_type              = password {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] neutron.cafile                 = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] neutron.certfile               = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] neutron.collect_timing         = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] neutron.connect_retries        = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] neutron.connect_retry_delay    = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] neutron.default_floating_pool  = public {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] neutron.endpoint_override      = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] neutron.extension_sync_interval = 600 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] neutron.http_retries           = 3 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] neutron.insecure               = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] neutron.keyfile                = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] neutron.max_version            = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] neutron.metadata_proxy_shared_secret = **** {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] neutron.min_version            = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] neutron.ovs_bridge             = br-int {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] neutron.physnets               = [] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] neutron.region_name            = RegionOne {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] neutron.service_metadata_proxy = True {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] neutron.service_name           = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] neutron.service_type           = network {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] neutron.split_loggers          = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] neutron.status_code_retries    = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] neutron.status_code_retry_delay = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] neutron.timeout                = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] neutron.version                = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] notifications.bdms_in_notifications = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] notifications.default_level    = INFO {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] notifications.notification_format = unversioned {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] notifications.notify_on_state_change = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] pci.alias                      = [] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] pci.device_spec                = [] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] pci.report_in_placement        = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] placement.auth_section         = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] placement.auth_type            = password {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] placement.cafile               = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] placement.certfile             = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] placement.collect_timing       = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] placement.connect_retries      = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] placement.connect_retry_delay  = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] placement.default_domain_id    = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] placement.default_domain_name  = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] placement.domain_id            = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] placement.domain_name          = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] placement.endpoint_override    = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] placement.insecure             = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] placement.keyfile              = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] placement.max_version          = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] placement.min_version          = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] placement.password             = **** {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] placement.project_domain_id    = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] placement.project_domain_name  = Default {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] placement.project_id           = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] placement.project_name         = service {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] placement.region_name          = RegionOne {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] placement.service_name         = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] placement.service_type         = placement {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] placement.split_loggers        = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] placement.status_code_retries  = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] placement.status_code_retry_delay = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] placement.system_scope         = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] placement.timeout              = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] placement.trust_id             = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] placement.user_domain_id       = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] placement.user_domain_name     = Default {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] placement.user_id              = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] placement.username             = placement {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] placement.version              = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] quota.cores                    = 20 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] quota.count_usage_from_placement = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] quota.injected_file_content_bytes = 10240 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] quota.injected_file_path_length = 255 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] quota.injected_files           = 5 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] quota.instances                = 10 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] quota.key_pairs                = 100 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] quota.metadata_items           = 128 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] quota.ram                      = 51200 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] quota.recheck_quota            = True {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] quota.server_group_members     = 10 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] quota.server_groups            = 10 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] rdp.enabled                    = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] scheduler.image_metadata_prefilter = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] scheduler.max_attempts         = 3 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] scheduler.max_placement_results = 1000 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] scheduler.query_placement_for_availability_zone = True {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] scheduler.query_placement_for_image_type_support = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] scheduler.workers              = 3 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] filter_scheduler.host_subset_size = 1 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] filter_scheduler.image_properties_default_architecture = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] filter_scheduler.isolated_hosts = [] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] filter_scheduler.isolated_images = [] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] filter_scheduler.max_instances_per_host = 50 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] filter_scheduler.pci_in_placement = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] filter_scheduler.track_instance_changes = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] metrics.required               = True {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] metrics.weight_multiplier      = 1.0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] metrics.weight_setting         = [] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] serial_console.enabled         = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] serial_console.port_range      = 10000:20000 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] serial_console.serialproxy_port = 6083 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] service_user.auth_section      = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] service_user.auth_type         = password {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] service_user.cafile            = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] service_user.certfile          = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] service_user.collect_timing    = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] service_user.insecure          = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] service_user.keyfile           = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] service_user.send_service_user_token = True {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] service_user.split_loggers     = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] service_user.timeout           = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] spice.agent_enabled            = True {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] spice.enabled                  = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] spice.html5proxy_port          = 6082 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] spice.image_compression        = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] spice.jpeg_compression         = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] spice.playback_compression     = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] spice.server_listen            = 127.0.0.1 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] spice.streaming_mode           = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] spice.zlib_compression         = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] upgrade_levels.baseapi         = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] upgrade_levels.cert            = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] upgrade_levels.compute         = auto {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] upgrade_levels.conductor       = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] upgrade_levels.scheduler       = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vendordata_dynamic_auth.auth_section = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vendordata_dynamic_auth.auth_type = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vendordata_dynamic_auth.cafile = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vendordata_dynamic_auth.certfile = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vendordata_dynamic_auth.collect_timing = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vendordata_dynamic_auth.insecure = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vendordata_dynamic_auth.keyfile = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vendordata_dynamic_auth.split_loggers = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vendordata_dynamic_auth.timeout = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vmware.api_retry_count         = 10 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vmware.ca_file                 = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vmware.cache_prefix            = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vmware.cluster_name            = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vmware.connection_pool_size    = 10 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vmware.console_delay_seconds   = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vmware.datastore_regex         = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vmware.host_ip                 = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vmware.host_password           = **** {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vmware.host_port               = 443 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vmware.host_username           = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vmware.insecure                = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vmware.integration_bridge      = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vmware.maximum_objects         = 100 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vmware.pbm_default_policy      = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vmware.pbm_enabled             = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vmware.pbm_wsdl_location       = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vmware.serial_port_proxy_uri   = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vmware.serial_port_service_uri = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vmware.task_poll_interval      = 0.5 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vmware.use_linked_clone        = True {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vmware.vnc_keymap              = en-us {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vmware.vnc_port                = 5900 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vmware.vnc_port_total          = 10000 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vnc.auth_schemes               = ['none'] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vnc.enabled                    = True {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vnc.novncproxy_port            = 6080 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vnc.server_listen              = 0.0.0.0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vnc.vencrypt_ca_certs          = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vnc.vencrypt_client_cert       = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vnc.vencrypt_client_key        = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] workarounds.disable_fallback_pcpu_query = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] workarounds.disable_group_policy_check_upcall = True {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] workarounds.disable_rootwrap   = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] workarounds.enable_numa_live_migration = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] workarounds.handle_virt_lifecycle_events = True {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] workarounds.libvirt_disable_apic = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] workarounds.never_download_image_if_on_rbd = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] wsgi.client_socket_timeout     = 900 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] wsgi.default_pool_size         = 1000 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] wsgi.keep_alive                = True {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] wsgi.max_header_line           = 16384 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] wsgi.secure_proxy_ssl_header   = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] wsgi.ssl_ca_file               = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] wsgi.ssl_cert_file             = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] wsgi.ssl_key_file              = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] wsgi.tcp_keepidle              = 600 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] zvm.ca_file                    = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] zvm.cloud_connector_url        = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] zvm.reachable_timeout          = 300 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_policy.enforce_new_defaults = True {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_policy.enforce_scope      = True {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_policy.policy_default_rule = default {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_policy.policy_file        = policy.yaml {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] profiler.connection_string     = messaging:// {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] profiler.enabled               = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] profiler.es_doc_type           = notification {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] profiler.es_scroll_size        = 10000 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] profiler.es_scroll_time        = 2m {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] profiler.filter_error_trace    = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] profiler.hmac_keys             = **** {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] profiler.sentinel_service_name = mymaster {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] profiler.socket_timeout        = 0.1 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] profiler.trace_requests        = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] profiler.trace_sqlalchemy      = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] profiler_jaeger.process_tags   = {} {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] profiler_jaeger.service_name_prefix = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] profiler_otlp.service_name_prefix = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] remote_debug.host              = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] remote_debug.port              = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_rabbit.ssl      = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_notifications.retry = -1 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_messaging_notifications.transport_url = **** {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_limit.auth_section        = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_limit.auth_type           = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_limit.cafile              = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_limit.certfile            = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_limit.collect_timing      = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_limit.connect_retries     = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_limit.connect_retry_delay = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_limit.endpoint_id         = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_limit.endpoint_override   = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_limit.insecure            = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_limit.keyfile             = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_limit.max_version         = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_limit.min_version         = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_limit.region_name         = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_limit.service_name        = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_limit.service_type        = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_limit.split_loggers       = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_limit.status_code_retries = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_limit.status_code_retry_delay = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_limit.timeout             = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_limit.valid_interfaces    = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_limit.version             = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_reports.file_event_handler = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] oslo_reports.log_dir           = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vif_plug_linux_bridge_privileged.group = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vif_plug_linux_bridge_privileged.user = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vif_plug_ovs_privileged.group  = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vif_plug_ovs_privileged.helper_command = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] vif_plug_ovs_privileged.user   = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] os_vif_linux_bridge.flat_interface = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] os_vif_linux_bridge.vlan_interface = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] os_vif_ovs.isolate_vif         = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] os_vif_ovs.ovsdb_interface     = native {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] os_vif_ovs.per_port_bridge     = False {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] os_brick.lock_path             = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] privsep_osbrick.capabilities   = [21] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] privsep_osbrick.group          = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] privsep_osbrick.helper_command = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] privsep_osbrick.user           = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] nova_sys_admin.group           = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] nova_sys_admin.helper_command  = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] nova_sys_admin.thread_pool_size = 12 {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] nova_sys_admin.user            = None {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG oslo_service.service [None req-6524ae98-daf9-4ca3-9529-87daeff4f18a None None] ******************************************************************************** {{(pid=73078) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 14 18:06:38 user nova-compute[73078]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 14 18:06:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Starting native event thread {{(pid=73078) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Starting green dispatch thread {{(pid=73078) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Starting connection event dispatch thread {{(pid=73078) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Connecting to libvirt: qemu:///system {{(pid=73078) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fe9906c8d60> {{(pid=73078) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 14 18:06:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fe9906c8d60> {{(pid=73078) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 14 18:06:38 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Connection event '1' reason 'None'
Aug 14 18:06:38 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 14 18:06:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.mount [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Initialising _HostMountState generation 0 {{(pid=73078) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 14 18:06:46 user nova-compute[73078]: INFO nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Libvirt host capabilities <capabilities>
Aug 14 18:06:46 user nova-compute[73078]:   <host>
Aug 14 18:06:46 user nova-compute[73078]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 14 18:06:46 user nova-compute[73078]:     <cpu>
Aug 14 18:06:46 user nova-compute[73078]:       <arch>x86_64</arch>
Aug 14 18:06:46 user nova-compute[73078]:       <model>IvyBridge-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <vendor>Intel</vendor>
Aug 14 18:06:46 user nova-compute[73078]:       <microcode version='1070'/>
Aug 14 18:06:46 user nova-compute[73078]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 14 18:06:46 user nova-compute[73078]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature name='ss'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature name='vmx'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature name='pcid'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature name='osxsave'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature name='hypervisor'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature name='arat'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature name='tsc_adjust'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature name='md-clear'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature name='stibp'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature name='arch-capabilities'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature name='ssbd'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature name='invtsc'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature name='rsba'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature name='skip-l1dfl-vmentry'/>
Aug 14 18:06:46 user nova-compute[73078]:       <pages unit='KiB' size='4'/>
Aug 14 18:06:46 user nova-compute[73078]:       <pages unit='KiB' size='2048'/>
Aug 14 18:06:46 user nova-compute[73078]:     </cpu>
Aug 14 18:06:46 user nova-compute[73078]:     <power_management>
Aug 14 18:06:46 user nova-compute[73078]:       <suspend_mem/>
Aug 14 18:06:46 user nova-compute[73078]:       <suspend_disk/>
Aug 14 18:06:46 user nova-compute[73078]:       <suspend_hybrid/>
Aug 14 18:06:46 user nova-compute[73078]:     </power_management>
Aug 14 18:06:46 user nova-compute[73078]:     <iommu support='no'/>
Aug 14 18:06:46 user nova-compute[73078]:     <migration_features>
Aug 14 18:06:46 user nova-compute[73078]:       <live/>
Aug 14 18:06:46 user nova-compute[73078]:       <uri_transports>
Aug 14 18:06:46 user nova-compute[73078]:         <uri_transport>tcp</uri_transport>
Aug 14 18:06:46 user nova-compute[73078]:         <uri_transport>rdma</uri_transport>
Aug 14 18:06:46 user nova-compute[73078]:       </uri_transports>
Aug 14 18:06:46 user nova-compute[73078]:     </migration_features>
Aug 14 18:06:46 user nova-compute[73078]:     <topology>
Aug 14 18:06:46 user nova-compute[73078]:       <cells num='2'>
Aug 14 18:06:46 user nova-compute[73078]:         <cell id='0'>
Aug 14 18:06:46 user nova-compute[73078]:           <memory unit='KiB'>8189224</memory>
Aug 14 18:06:46 user nova-compute[73078]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 14 18:06:46 user nova-compute[73078]:           <pages unit='KiB' size='2048'>0</pages>
Aug 14 18:06:46 user nova-compute[73078]:           <distances>
Aug 14 18:06:46 user nova-compute[73078]:             <sibling id='0' value='10'/>
Aug 14 18:06:46 user nova-compute[73078]:             <sibling id='1' value='20'/>
Aug 14 18:06:46 user nova-compute[73078]:           </distances>
Aug 14 18:06:46 user nova-compute[73078]:           <cpus num='6'>
Aug 14 18:06:46 user nova-compute[73078]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 14 18:06:46 user nova-compute[73078]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 14 18:06:46 user nova-compute[73078]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 14 18:06:46 user nova-compute[73078]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 14 18:06:46 user nova-compute[73078]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 14 18:06:46 user nova-compute[73078]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 14 18:06:46 user nova-compute[73078]:           </cpus>
Aug 14 18:06:46 user nova-compute[73078]:         </cell>
Aug 14 18:06:46 user nova-compute[73078]:         <cell id='1'>
Aug 14 18:06:46 user nova-compute[73078]:           <memory unit='KiB'>8206460</memory>
Aug 14 18:06:46 user nova-compute[73078]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 14 18:06:46 user nova-compute[73078]:           <pages unit='KiB' size='2048'>0</pages>
Aug 14 18:06:46 user nova-compute[73078]:           <distances>
Aug 14 18:06:46 user nova-compute[73078]:             <sibling id='0' value='20'/>
Aug 14 18:06:46 user nova-compute[73078]:             <sibling id='1' value='10'/>
Aug 14 18:06:46 user nova-compute[73078]:           </distances>
Aug 14 18:06:46 user nova-compute[73078]:           <cpus num='6'>
Aug 14 18:06:46 user nova-compute[73078]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 14 18:06:46 user nova-compute[73078]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 14 18:06:46 user nova-compute[73078]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 14 18:06:46 user nova-compute[73078]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 14 18:06:46 user nova-compute[73078]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 14 18:06:46 user nova-compute[73078]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 14 18:06:46 user nova-compute[73078]:           </cpus>
Aug 14 18:06:46 user nova-compute[73078]:         </cell>
Aug 14 18:06:46 user nova-compute[73078]:       </cells>
Aug 14 18:06:46 user nova-compute[73078]:     </topology>
Aug 14 18:06:46 user nova-compute[73078]:     <cache>
Aug 14 18:06:46 user nova-compute[73078]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 14 18:06:46 user nova-compute[73078]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 14 18:06:46 user nova-compute[73078]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 14 18:06:46 user nova-compute[73078]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 14 18:06:46 user nova-compute[73078]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 14 18:06:46 user nova-compute[73078]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 14 18:06:46 user nova-compute[73078]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 14 18:06:46 user nova-compute[73078]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 14 18:06:46 user nova-compute[73078]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 14 18:06:46 user nova-compute[73078]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 14 18:06:46 user nova-compute[73078]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 14 18:06:46 user nova-compute[73078]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 14 18:06:46 user nova-compute[73078]:     </cache>
Aug 14 18:06:46 user nova-compute[73078]:     <secmodel>
Aug 14 18:06:46 user nova-compute[73078]:       <model>apparmor</model>
Aug 14 18:06:46 user nova-compute[73078]:       <doi>0</doi>
Aug 14 18:06:46 user nova-compute[73078]:     </secmodel>
Aug 14 18:06:46 user nova-compute[73078]:     <secmodel>
Aug 14 18:06:46 user nova-compute[73078]:       <model>dac</model>
Aug 14 18:06:46 user nova-compute[73078]:       <doi>0</doi>
Aug 14 18:06:46 user nova-compute[73078]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 14 18:06:46 user nova-compute[73078]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 14 18:06:46 user nova-compute[73078]:     </secmodel>
Aug 14 18:06:46 user nova-compute[73078]:   </host>
Aug 14 18:06:46 user nova-compute[73078]:   <guest>
Aug 14 18:06:46 user nova-compute[73078]:     <os_type>hvm</os_type>
Aug 14 18:06:46 user nova-compute[73078]:     <arch name='alpha'>
Aug 14 18:06:46 user nova-compute[73078]:       <wordsize>64</wordsize>
Aug 14 18:06:46 user nova-compute[73078]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='4'>clipper</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <domain type='qemu'/>
Aug 14 18:06:46 user nova-compute[73078]:     </arch>
Aug 14 18:06:46 user nova-compute[73078]:     <features>
Aug 14 18:06:46 user nova-compute[73078]:       <cpuselection/>
Aug 14 18:06:46 user nova-compute[73078]:       <deviceboot/>
Aug 14 18:06:46 user nova-compute[73078]:       <disksnapshot default='on' toggle='no'/>
Aug 14 18:06:46 user nova-compute[73078]:     </features>
Aug 14 18:06:46 user nova-compute[73078]:   </guest>
Aug 14 18:06:46 user nova-compute[73078]:   <guest>
Aug 14 18:06:46 user nova-compute[73078]:     <os_type>hvm</os_type>
Aug 14 18:06:46 user nova-compute[73078]:     <arch name='armv6l'>
Aug 14 18:06:46 user nova-compute[73078]:       <wordsize>32</wordsize>
Aug 14 18:06:46 user nova-compute[73078]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>integratorcp</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>borzoi</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>spitz</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>nuri</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>musca-b1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>versatileab</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>kzm</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>musca-a</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>smdkc210</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>sx1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>z2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>tosa</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='4'>sabrelite</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>realview-eb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>n810</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>n800</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>versatilepb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>terrier</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>mainstone</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='4'>midway</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>musicpal</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>microbit</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>cubieboard</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>verdex</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>netduino2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='4'>raspi2b</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>cheetah</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='4'>highbank</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>akita</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>connex</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>collie</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>raspi0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <domain type='qemu'/>
Aug 14 18:06:46 user nova-compute[73078]:     </arch>
Aug 14 18:06:46 user nova-compute[73078]:     <features>
Aug 14 18:06:46 user nova-compute[73078]:       <cpuselection/>
Aug 14 18:06:46 user nova-compute[73078]:       <deviceboot/>
Aug 14 18:06:46 user nova-compute[73078]:       <disksnapshot default='on' toggle='no'/>
Aug 14 18:06:46 user nova-compute[73078]:     </features>
Aug 14 18:06:46 user nova-compute[73078]:   </guest>
Aug 14 18:06:46 user nova-compute[73078]:   <guest>
Aug 14 18:06:46 user nova-compute[73078]:     <os_type>hvm</os_type>
Aug 14 18:06:46 user nova-compute[73078]:     <arch name='armv7l'>
Aug 14 18:06:46 user nova-compute[73078]:       <wordsize>32</wordsize>
Aug 14 18:06:46 user nova-compute[73078]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>integratorcp</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>borzoi</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>spitz</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>nuri</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>musca-b1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>versatileab</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>kzm</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>musca-a</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>smdkc210</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>sx1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>z2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>tosa</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='4'>sabrelite</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>realview-eb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>n810</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>n800</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>versatilepb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>terrier</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>mainstone</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='4'>midway</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>musicpal</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>microbit</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>cubieboard</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>verdex</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>netduino2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='4'>raspi2b</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>cheetah</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='4'>highbank</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>akita</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>connex</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>collie</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>raspi0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <domain type='qemu'/>
Aug 14 18:06:46 user nova-compute[73078]:     </arch>
Aug 14 18:06:46 user nova-compute[73078]:     <features>
Aug 14 18:06:46 user nova-compute[73078]:       <cpuselection/>
Aug 14 18:06:46 user nova-compute[73078]:       <deviceboot/>
Aug 14 18:06:46 user nova-compute[73078]:       <disksnapshot default='on' toggle='no'/>
Aug 14 18:06:46 user nova-compute[73078]:     </features>
Aug 14 18:06:46 user nova-compute[73078]:   </guest>
Aug 14 18:06:46 user nova-compute[73078]:   <guest>
Aug 14 18:06:46 user nova-compute[73078]:     <os_type>hvm</os_type>
Aug 14 18:06:46 user nova-compute[73078]:     <arch name='aarch64'>
Aug 14 18:06:46 user nova-compute[73078]:       <wordsize>64</wordsize>
Aug 14 18:06:46 user nova-compute[73078]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>integratorcp</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>borzoi</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>spitz</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>nuri</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>musca-b1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>versatileab</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>kzm</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>musca-a</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>smdkc210</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>sx1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>z2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>tosa</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='4'>sabrelite</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>realview-eb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>n810</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>n800</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>versatilepb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>terrier</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>mainstone</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='4'>midway</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>musicpal</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>microbit</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>cubieboard</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>verdex</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>netduino2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='4'>raspi3b</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='4'>raspi2b</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>cheetah</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='4'>highbank</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>akita</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>connex</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>collie</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>raspi0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <domain type='qemu'/>
Aug 14 18:06:46 user nova-compute[73078]:     </arch>
Aug 14 18:06:46 user nova-compute[73078]:     <features>
Aug 14 18:06:46 user nova-compute[73078]:       <acpi default='on' toggle='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:       <cpuselection/>
Aug 14 18:06:46 user nova-compute[73078]:       <deviceboot/>
Aug 14 18:06:46 user nova-compute[73078]:       <disksnapshot default='on' toggle='no'/>
Aug 14 18:06:46 user nova-compute[73078]:     </features>
Aug 14 18:06:46 user nova-compute[73078]:   </guest>
Aug 14 18:06:46 user nova-compute[73078]:   <guest>
Aug 14 18:06:46 user nova-compute[73078]:     <os_type>hvm</os_type>
Aug 14 18:06:46 user nova-compute[73078]:     <arch name='cris'>
Aug 14 18:06:46 user nova-compute[73078]:       <wordsize>32</wordsize>
Aug 14 18:06:46 user nova-compute[73078]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <domain type='qemu'/>
Aug 14 18:06:46 user nova-compute[73078]:     </arch>
Aug 14 18:06:46 user nova-compute[73078]:     <features>
Aug 14 18:06:46 user nova-compute[73078]:       <cpuselection/>
Aug 14 18:06:46 user nova-compute[73078]:       <deviceboot/>
Aug 14 18:06:46 user nova-compute[73078]:       <disksnapshot default='on' toggle='no'/>
Aug 14 18:06:46 user nova-compute[73078]:     </features>
Aug 14 18:06:46 user nova-compute[73078]:   </guest>
Aug 14 18:06:46 user nova-compute[73078]:   <guest>
Aug 14 18:06:46 user nova-compute[73078]:     <os_type>hvm</os_type>
Aug 14 18:06:46 user nova-compute[73078]:     <arch name='i686'>
Aug 14 18:06:46 user nova-compute[73078]:       <wordsize>32</wordsize>
Aug 14 18:06:46 user nova-compute[73078]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>x-remote</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>isapc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>microvm</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <domain type='qemu'/>
Aug 14 18:06:46 user nova-compute[73078]:       <domain type='kvm'/>
Aug 14 18:06:46 user nova-compute[73078]:     </arch>
Aug 14 18:06:46 user nova-compute[73078]:     <features>
Aug 14 18:06:46 user nova-compute[73078]:       <pae/>
Aug 14 18:06:46 user nova-compute[73078]:       <nonpae/>
Aug 14 18:06:46 user nova-compute[73078]:       <acpi default='on' toggle='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:       <apic default='on' toggle='no'/>
Aug 14 18:06:46 user nova-compute[73078]:       <cpuselection/>
Aug 14 18:06:46 user nova-compute[73078]:       <deviceboot/>
Aug 14 18:06:46 user nova-compute[73078]:       <disksnapshot default='on' toggle='no'/>
Aug 14 18:06:46 user nova-compute[73078]:     </features>
Aug 14 18:06:46 user nova-compute[73078]:   </guest>
Aug 14 18:06:46 user nova-compute[73078]:   <guest>
Aug 14 18:06:46 user nova-compute[73078]:     <os_type>hvm</os_type>
Aug 14 18:06:46 user nova-compute[73078]:     <arch name='m68k'>
Aug 14 18:06:46 user nova-compute[73078]:       <wordsize>32</wordsize>
Aug 14 18:06:46 user nova-compute[73078]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>an5206</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>q800</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>next-cube</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <domain type='qemu'/>
Aug 14 18:06:46 user nova-compute[73078]:     </arch>
Aug 14 18:06:46 user nova-compute[73078]:     <features>
Aug 14 18:06:46 user nova-compute[73078]:       <cpuselection/>
Aug 14 18:06:46 user nova-compute[73078]:       <deviceboot/>
Aug 14 18:06:46 user nova-compute[73078]:       <disksnapshot default='on' toggle='no'/>
Aug 14 18:06:46 user nova-compute[73078]:     </features>
Aug 14 18:06:46 user nova-compute[73078]:   </guest>
Aug 14 18:06:46 user nova-compute[73078]:   <guest>
Aug 14 18:06:46 user nova-compute[73078]:     <os_type>hvm</os_type>
Aug 14 18:06:46 user nova-compute[73078]:     <arch name='microblaze'>
Aug 14 18:06:46 user nova-compute[73078]:       <wordsize>32</wordsize>
Aug 14 18:06:46 user nova-compute[73078]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <domain type='qemu'/>
Aug 14 18:06:46 user nova-compute[73078]:     </arch>
Aug 14 18:06:46 user nova-compute[73078]:     <features>
Aug 14 18:06:46 user nova-compute[73078]:       <cpuselection/>
Aug 14 18:06:46 user nova-compute[73078]:       <deviceboot/>
Aug 14 18:06:46 user nova-compute[73078]:       <disksnapshot default='on' toggle='no'/>
Aug 14 18:06:46 user nova-compute[73078]:     </features>
Aug 14 18:06:46 user nova-compute[73078]:   </guest>
Aug 14 18:06:46 user nova-compute[73078]:   <guest>
Aug 14 18:06:46 user nova-compute[73078]:     <os_type>hvm</os_type>
Aug 14 18:06:46 user nova-compute[73078]:     <arch name='microblazeel'>
Aug 14 18:06:46 user nova-compute[73078]:       <wordsize>32</wordsize>
Aug 14 18:06:46 user nova-compute[73078]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <domain type='qemu'/>
Aug 14 18:06:46 user nova-compute[73078]:     </arch>
Aug 14 18:06:46 user nova-compute[73078]:     <features>
Aug 14 18:06:46 user nova-compute[73078]:       <cpuselection/>
Aug 14 18:06:46 user nova-compute[73078]:       <deviceboot/>
Aug 14 18:06:46 user nova-compute[73078]:       <disksnapshot default='on' toggle='no'/>
Aug 14 18:06:46 user nova-compute[73078]:     </features>
Aug 14 18:06:46 user nova-compute[73078]:   </guest>
Aug 14 18:06:46 user nova-compute[73078]:   <guest>
Aug 14 18:06:46 user nova-compute[73078]:     <os_type>hvm</os_type>
Aug 14 18:06:46 user nova-compute[73078]:     <arch name='mips'>
Aug 14 18:06:46 user nova-compute[73078]:       <wordsize>32</wordsize>
Aug 14 18:06:46 user nova-compute[73078]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='16'>malta</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>mipssim</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <domain type='qemu'/>
Aug 14 18:06:46 user nova-compute[73078]:     </arch>
Aug 14 18:06:46 user nova-compute[73078]:     <features>
Aug 14 18:06:46 user nova-compute[73078]:       <cpuselection/>
Aug 14 18:06:46 user nova-compute[73078]:       <deviceboot/>
Aug 14 18:06:46 user nova-compute[73078]:       <disksnapshot default='on' toggle='no'/>
Aug 14 18:06:46 user nova-compute[73078]:     </features>
Aug 14 18:06:46 user nova-compute[73078]:   </guest>
Aug 14 18:06:46 user nova-compute[73078]:   <guest>
Aug 14 18:06:46 user nova-compute[73078]:     <os_type>hvm</os_type>
Aug 14 18:06:46 user nova-compute[73078]:     <arch name='mipsel'>
Aug 14 18:06:46 user nova-compute[73078]:       <wordsize>32</wordsize>
Aug 14 18:06:46 user nova-compute[73078]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='16'>malta</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>mipssim</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <domain type='qemu'/>
Aug 14 18:06:46 user nova-compute[73078]:     </arch>
Aug 14 18:06:46 user nova-compute[73078]:     <features>
Aug 14 18:06:46 user nova-compute[73078]:       <cpuselection/>
Aug 14 18:06:46 user nova-compute[73078]:       <deviceboot/>
Aug 14 18:06:46 user nova-compute[73078]:       <disksnapshot default='on' toggle='no'/>
Aug 14 18:06:46 user nova-compute[73078]:     </features>
Aug 14 18:06:46 user nova-compute[73078]:   </guest>
Aug 14 18:06:46 user nova-compute[73078]:   <guest>
Aug 14 18:06:46 user nova-compute[73078]:     <os_type>hvm</os_type>
Aug 14 18:06:46 user nova-compute[73078]:     <arch name='mips64'>
Aug 14 18:06:46 user nova-compute[73078]:       <wordsize>64</wordsize>
Aug 14 18:06:46 user nova-compute[73078]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='16'>malta</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>mipssim</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>pica61</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>magnum</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <domain type='qemu'/>
Aug 14 18:06:46 user nova-compute[73078]:     </arch>
Aug 14 18:06:46 user nova-compute[73078]:     <features>
Aug 14 18:06:46 user nova-compute[73078]:       <cpuselection/>
Aug 14 18:06:46 user nova-compute[73078]:       <deviceboot/>
Aug 14 18:06:46 user nova-compute[73078]:       <disksnapshot default='on' toggle='no'/>
Aug 14 18:06:46 user nova-compute[73078]:     </features>
Aug 14 18:06:46 user nova-compute[73078]:   </guest>
Aug 14 18:06:46 user nova-compute[73078]:   <guest>
Aug 14 18:06:46 user nova-compute[73078]:     <os_type>hvm</os_type>
Aug 14 18:06:46 user nova-compute[73078]:     <arch name='mips64el'>
Aug 14 18:06:46 user nova-compute[73078]:       <wordsize>64</wordsize>
Aug 14 18:06:46 user nova-compute[73078]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='16'>malta</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>mipssim</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>pica61</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>magnum</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='16'>boston</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <domain type='qemu'/>
Aug 14 18:06:46 user nova-compute[73078]:     </arch>
Aug 14 18:06:46 user nova-compute[73078]:     <features>
Aug 14 18:06:46 user nova-compute[73078]:       <cpuselection/>
Aug 14 18:06:46 user nova-compute[73078]:       <deviceboot/>
Aug 14 18:06:46 user nova-compute[73078]:       <disksnapshot default='on' toggle='no'/>
Aug 14 18:06:46 user nova-compute[73078]:     </features>
Aug 14 18:06:46 user nova-compute[73078]:   </guest>
Aug 14 18:06:46 user nova-compute[73078]:   <guest>
Aug 14 18:06:46 user nova-compute[73078]:     <os_type>hvm</os_type>
Aug 14 18:06:46 user nova-compute[73078]:     <arch name='ppc'>
Aug 14 18:06:46 user nova-compute[73078]:       <wordsize>32</wordsize>
Aug 14 18:06:46 user nova-compute[73078]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>g3beige</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>mac99</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='32'>ppce500</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>pegasos2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>sam460ex</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>bamboo</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>40p</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>ref405ep</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>taihu</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <domain type='qemu'/>
Aug 14 18:06:46 user nova-compute[73078]:     </arch>
Aug 14 18:06:46 user nova-compute[73078]:     <features>
Aug 14 18:06:46 user nova-compute[73078]:       <cpuselection/>
Aug 14 18:06:46 user nova-compute[73078]:       <deviceboot/>
Aug 14 18:06:46 user nova-compute[73078]:       <disksnapshot default='on' toggle='no'/>
Aug 14 18:06:46 user nova-compute[73078]:     </features>
Aug 14 18:06:46 user nova-compute[73078]:   </guest>
Aug 14 18:06:46 user nova-compute[73078]:   <guest>
Aug 14 18:06:46 user nova-compute[73078]:     <os_type>hvm</os_type>
Aug 14 18:06:46 user nova-compute[73078]:     <arch name='ppc64'>
Aug 14 18:06:46 user nova-compute[73078]:       <wordsize>64</wordsize>
Aug 14 18:06:46 user nova-compute[73078]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2048'>powernv9</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>taihu</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2048'>powernv10</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='32'>ppce500</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>40p</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>pegasos2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>bamboo</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>g3beige</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>mac99</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>sam460ex</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>ref405ep</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2048'>powernv8</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <domain type='qemu'/>
Aug 14 18:06:46 user nova-compute[73078]:     </arch>
Aug 14 18:06:46 user nova-compute[73078]:     <features>
Aug 14 18:06:46 user nova-compute[73078]:       <cpuselection/>
Aug 14 18:06:46 user nova-compute[73078]:       <deviceboot/>
Aug 14 18:06:46 user nova-compute[73078]:       <disksnapshot default='on' toggle='no'/>
Aug 14 18:06:46 user nova-compute[73078]:     </features>
Aug 14 18:06:46 user nova-compute[73078]:   </guest>
Aug 14 18:06:46 user nova-compute[73078]:   <guest>
Aug 14 18:06:46 user nova-compute[73078]:     <os_type>hvm</os_type>
Aug 14 18:06:46 user nova-compute[73078]:     <arch name='ppc64le'>
Aug 14 18:06:46 user nova-compute[73078]:       <wordsize>64</wordsize>
Aug 14 18:06:46 user nova-compute[73078]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2048'>powernv9</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>taihu</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2048'>powernv10</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='32'>ppce500</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>40p</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>pegasos2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>bamboo</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>g3beige</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>mac99</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>sam460ex</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>ref405ep</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2048'>powernv8</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <domain type='qemu'/>
Aug 14 18:06:46 user nova-compute[73078]:     </arch>
Aug 14 18:06:46 user nova-compute[73078]:     <features>
Aug 14 18:06:46 user nova-compute[73078]:       <cpuselection/>
Aug 14 18:06:46 user nova-compute[73078]:       <deviceboot/>
Aug 14 18:06:46 user nova-compute[73078]:       <disksnapshot default='on' toggle='no'/>
Aug 14 18:06:46 user nova-compute[73078]:     </features>
Aug 14 18:06:46 user nova-compute[73078]:   </guest>
Aug 14 18:06:46 user nova-compute[73078]:   <guest>
Aug 14 18:06:46 user nova-compute[73078]:     <os_type>hvm</os_type>
Aug 14 18:06:46 user nova-compute[73078]:     <arch name='riscv32'>
Aug 14 18:06:46 user nova-compute[73078]:       <wordsize>32</wordsize>
Aug 14 18:06:46 user nova-compute[73078]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='8'>spike</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>opentitan</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='5'>sifive_u</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>sifive_e</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='8'>virt</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <domain type='qemu'/>
Aug 14 18:06:46 user nova-compute[73078]:     </arch>
Aug 14 18:06:46 user nova-compute[73078]:     <features>
Aug 14 18:06:46 user nova-compute[73078]:       <cpuselection/>
Aug 14 18:06:46 user nova-compute[73078]:       <deviceboot/>
Aug 14 18:06:46 user nova-compute[73078]:       <disksnapshot default='on' toggle='no'/>
Aug 14 18:06:46 user nova-compute[73078]:     </features>
Aug 14 18:06:46 user nova-compute[73078]:   </guest>
Aug 14 18:06:46 user nova-compute[73078]:   <guest>
Aug 14 18:06:46 user nova-compute[73078]:     <os_type>hvm</os_type>
Aug 14 18:06:46 user nova-compute[73078]:     <arch name='riscv64'>
Aug 14 18:06:46 user nova-compute[73078]:       <wordsize>64</wordsize>
Aug 14 18:06:46 user nova-compute[73078]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='8'>spike</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='5'>sifive_u</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>shakti_c</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>sifive_e</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='8'>virt</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <domain type='qemu'/>
Aug 14 18:06:46 user nova-compute[73078]:     </arch>
Aug 14 18:06:46 user nova-compute[73078]:     <features>
Aug 14 18:06:46 user nova-compute[73078]:       <cpuselection/>
Aug 14 18:06:46 user nova-compute[73078]:       <deviceboot/>
Aug 14 18:06:46 user nova-compute[73078]:       <disksnapshot default='on' toggle='no'/>
Aug 14 18:06:46 user nova-compute[73078]:     </features>
Aug 14 18:06:46 user nova-compute[73078]:   </guest>
Aug 14 18:06:46 user nova-compute[73078]:   <guest>
Aug 14 18:06:46 user nova-compute[73078]:     <os_type>hvm</os_type>
Aug 14 18:06:46 user nova-compute[73078]:     <arch name='s390x'>
Aug 14 18:06:46 user nova-compute[73078]:       <wordsize>64</wordsize>
Aug 14 18:06:46 user nova-compute[73078]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <domain type='qemu'/>
Aug 14 18:06:46 user nova-compute[73078]:     </arch>
Aug 14 18:06:46 user nova-compute[73078]:     <features>
Aug 14 18:06:46 user nova-compute[73078]:       <cpuselection/>
Aug 14 18:06:46 user nova-compute[73078]:       <deviceboot/>
Aug 14 18:06:46 user nova-compute[73078]:       <disksnapshot default='on' toggle='no'/>
Aug 14 18:06:46 user nova-compute[73078]:     </features>
Aug 14 18:06:46 user nova-compute[73078]:   </guest>
Aug 14 18:06:46 user nova-compute[73078]:   <guest>
Aug 14 18:06:46 user nova-compute[73078]:     <os_type>hvm</os_type>
Aug 14 18:06:46 user nova-compute[73078]:     <arch name='sh4'>
Aug 14 18:06:46 user nova-compute[73078]:       <wordsize>32</wordsize>
Aug 14 18:06:46 user nova-compute[73078]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>shix</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>r2d</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <domain type='qemu'/>
Aug 14 18:06:46 user nova-compute[73078]:     </arch>
Aug 14 18:06:46 user nova-compute[73078]:     <features>
Aug 14 18:06:46 user nova-compute[73078]:       <cpuselection/>
Aug 14 18:06:46 user nova-compute[73078]:       <deviceboot/>
Aug 14 18:06:46 user nova-compute[73078]:       <disksnapshot default='on' toggle='no'/>
Aug 14 18:06:46 user nova-compute[73078]:     </features>
Aug 14 18:06:46 user nova-compute[73078]:   </guest>
Aug 14 18:06:46 user nova-compute[73078]:   <guest>
Aug 14 18:06:46 user nova-compute[73078]:     <os_type>hvm</os_type>
Aug 14 18:06:46 user nova-compute[73078]:     <arch name='sh4eb'>
Aug 14 18:06:46 user nova-compute[73078]:       <wordsize>64</wordsize>
Aug 14 18:06:46 user nova-compute[73078]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>shix</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>r2d</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <domain type='qemu'/>
Aug 14 18:06:46 user nova-compute[73078]:     </arch>
Aug 14 18:06:46 user nova-compute[73078]:     <features>
Aug 14 18:06:46 user nova-compute[73078]:       <cpuselection/>
Aug 14 18:06:46 user nova-compute[73078]:       <deviceboot/>
Aug 14 18:06:46 user nova-compute[73078]:       <disksnapshot default='on' toggle='no'/>
Aug 14 18:06:46 user nova-compute[73078]:     </features>
Aug 14 18:06:46 user nova-compute[73078]:   </guest>
Aug 14 18:06:46 user nova-compute[73078]:   <guest>
Aug 14 18:06:46 user nova-compute[73078]:     <os_type>hvm</os_type>
Aug 14 18:06:46 user nova-compute[73078]:     <arch name='sparc'>
Aug 14 18:06:46 user nova-compute[73078]:       <wordsize>32</wordsize>
Aug 14 18:06:46 user nova-compute[73078]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>SS-5</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='4'>SS-20</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>LX</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>SS-4</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='4'>SS-10</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>Voyager</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <domain type='qemu'/>
Aug 14 18:06:46 user nova-compute[73078]:     </arch>
Aug 14 18:06:46 user nova-compute[73078]:     <features>
Aug 14 18:06:46 user nova-compute[73078]:       <cpuselection/>
Aug 14 18:06:46 user nova-compute[73078]:       <deviceboot/>
Aug 14 18:06:46 user nova-compute[73078]:       <disksnapshot default='on' toggle='no'/>
Aug 14 18:06:46 user nova-compute[73078]:     </features>
Aug 14 18:06:46 user nova-compute[73078]:   </guest>
Aug 14 18:06:46 user nova-compute[73078]:   <guest>
Aug 14 18:06:46 user nova-compute[73078]:     <os_type>hvm</os_type>
Aug 14 18:06:46 user nova-compute[73078]:     <arch name='sparc64'>
Aug 14 18:06:46 user nova-compute[73078]:       <wordsize>64</wordsize>
Aug 14 18:06:46 user nova-compute[73078]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>sun4u</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>niagara</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>sun4v</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <domain type='qemu'/>
Aug 14 18:06:46 user nova-compute[73078]:     </arch>
Aug 14 18:06:46 user nova-compute[73078]:     <features>
Aug 14 18:06:46 user nova-compute[73078]:       <cpuselection/>
Aug 14 18:06:46 user nova-compute[73078]:       <deviceboot/>
Aug 14 18:06:46 user nova-compute[73078]:       <disksnapshot default='on' toggle='no'/>
Aug 14 18:06:46 user nova-compute[73078]:     </features>
Aug 14 18:06:46 user nova-compute[73078]:   </guest>
Aug 14 18:06:46 user nova-compute[73078]:   <guest>
Aug 14 18:06:46 user nova-compute[73078]:     <os_type>hvm</os_type>
Aug 14 18:06:46 user nova-compute[73078]:     <arch name='x86_64'>
Aug 14 18:06:46 user nova-compute[73078]:       <wordsize>64</wordsize>
Aug 14 18:06:46 user nova-compute[73078]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>x-remote</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='1'>isapc</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>microvm</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <domain type='qemu'/>
Aug 14 18:06:46 user nova-compute[73078]:       <domain type='kvm'/>
Aug 14 18:06:46 user nova-compute[73078]:     </arch>
Aug 14 18:06:46 user nova-compute[73078]:     <features>
Aug 14 18:06:46 user nova-compute[73078]:       <acpi default='on' toggle='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:       <apic default='on' toggle='no'/>
Aug 14 18:06:46 user nova-compute[73078]:       <cpuselection/>
Aug 14 18:06:46 user nova-compute[73078]:       <deviceboot/>
Aug 14 18:06:46 user nova-compute[73078]:       <disksnapshot default='on' toggle='no'/>
Aug 14 18:06:46 user nova-compute[73078]:     </features>
Aug 14 18:06:46 user nova-compute[73078]:   </guest>
Aug 14 18:06:46 user nova-compute[73078]:   <guest>
Aug 14 18:06:46 user nova-compute[73078]:     <os_type>hvm</os_type>
Aug 14 18:06:46 user nova-compute[73078]:     <arch name='xtensa'>
Aug 14 18:06:46 user nova-compute[73078]:       <wordsize>32</wordsize>
Aug 14 18:06:46 user nova-compute[73078]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='4'>sim</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='32'>kc705</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='32'>ml605</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='32'>virt</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='32'>lx200</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='32'>lx60</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <domain type='qemu'/>
Aug 14 18:06:46 user nova-compute[73078]:     </arch>
Aug 14 18:06:46 user nova-compute[73078]:     <features>
Aug 14 18:06:46 user nova-compute[73078]:       <cpuselection/>
Aug 14 18:06:46 user nova-compute[73078]:       <deviceboot/>
Aug 14 18:06:46 user nova-compute[73078]:       <disksnapshot default='on' toggle='no'/>
Aug 14 18:06:46 user nova-compute[73078]:     </features>
Aug 14 18:06:46 user nova-compute[73078]:   </guest>
Aug 14 18:06:46 user nova-compute[73078]:   <guest>
Aug 14 18:06:46 user nova-compute[73078]:     <os_type>hvm</os_type>
Aug 14 18:06:46 user nova-compute[73078]:     <arch name='xtensaeb'>
Aug 14 18:06:46 user nova-compute[73078]:       <wordsize>32</wordsize>
Aug 14 18:06:46 user nova-compute[73078]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='4'>sim</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='32'>kc705</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='32'>ml605</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='32'>virt</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='32'>lx200</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='32'>lx60</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 14 18:06:46 user nova-compute[73078]:       <domain type='qemu'/>
Aug 14 18:06:46 user nova-compute[73078]:     </arch>
Aug 14 18:06:46 user nova-compute[73078]:     <features>
Aug 14 18:06:46 user nova-compute[73078]:       <cpuselection/>
Aug 14 18:06:46 user nova-compute[73078]:       <deviceboot/>
Aug 14 18:06:46 user nova-compute[73078]:       <disksnapshot default='on' toggle='no'/>
Aug 14 18:06:46 user nova-compute[73078]:     </features>
Aug 14 18:06:46 user nova-compute[73078]:   </guest>
Aug 14 18:06:46 user nova-compute[73078]: </capabilities>
Aug 14 18:06:46 user nova-compute[73078]: 
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=73078) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=73078) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=73078) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73078) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73078) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=73078) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73078) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=73078) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=73078) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=73078) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=73078) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu', 'pc', 'ubuntu-q35'} {{(pid=73078) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 14 18:06:46 user nova-compute[73078]: <domainCapabilities>
Aug 14 18:06:46 user nova-compute[73078]:   <path>/usr/bin/qemu-system-i386</path>
Aug 14 18:06:46 user nova-compute[73078]:   <domain>kvm</domain>
Aug 14 18:06:46 user nova-compute[73078]:   <machine>pc-q35-6.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:   <arch>i686</arch>
Aug 14 18:06:46 user nova-compute[73078]:   <vcpu max='288'/>
Aug 14 18:06:46 user nova-compute[73078]:   <iothreads supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:   <os supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:     <enum name='firmware'/>
Aug 14 18:06:46 user nova-compute[73078]:     <loader supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 14 18:06:46 user nova-compute[73078]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 14 18:06:46 user nova-compute[73078]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 14 18:06:46 user nova-compute[73078]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 14 18:06:46 user nova-compute[73078]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='type'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>rom</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>pflash</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='readonly'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>yes</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>no</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='secure'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>no</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </loader>
Aug 14 18:06:46 user nova-compute[73078]:   </os>
Aug 14 18:06:46 user nova-compute[73078]:   <cpu>
Aug 14 18:06:46 user nova-compute[73078]:     <mode name='host-passthrough' supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='hostPassthroughMigratable'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>off</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </mode>
Aug 14 18:06:46 user nova-compute[73078]:     <mode name='maximum' supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='maximumMigratable'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>on</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>off</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </mode>
Aug 14 18:06:46 user nova-compute[73078]:     <mode name='host-model' supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <vendor>Intel</vendor>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='ss'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='vmx'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='pcid'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='hypervisor'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='arat'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='umip'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='md-clear'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='stibp'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='ssbd'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='ibpb'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='ibrs'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='amd-stibp'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='disable' name='erms'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='disable' name='lm'/>
Aug 14 18:06:46 user nova-compute[73078]:     </mode>
Aug 14 18:06:46 user nova-compute[73078]:     <mode name='custom' supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>qemu64</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>qemu32</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>phenom</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>pentium3</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>pentium2</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>pentium</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>n270</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>kvm64</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>kvm32</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>coreduo</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>core2duo</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>athlon</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Westmere-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Westmere</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Snowridge</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Server</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Client</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>SandyBridge</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Penryn</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Opteron_G5</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Opteron_G4</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Opteron_G3</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Opteron_G2</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Opteron_G1</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Nehalem-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Nehalem</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>IvyBridge</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Icelake-Server</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Haswell</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>EPYC-Rome</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>EPYC-Milan</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>EPYC</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Dhyana</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Cooperlake</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Conroe</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Broadwell</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>486</model>
Aug 14 18:06:46 user nova-compute[73078]:     </mode>
Aug 14 18:06:46 user nova-compute[73078]:   </cpu>
Aug 14 18:06:46 user nova-compute[73078]:   <memoryBacking supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:     <enum name='sourceType'>
Aug 14 18:06:46 user nova-compute[73078]:       <value>file</value>
Aug 14 18:06:46 user nova-compute[73078]:       <value>anonymous</value>
Aug 14 18:06:46 user nova-compute[73078]:       <value>memfd</value>
Aug 14 18:06:46 user nova-compute[73078]:     </enum>
Aug 14 18:06:46 user nova-compute[73078]:   </memoryBacking>
Aug 14 18:06:46 user nova-compute[73078]:   <devices>
Aug 14 18:06:46 user nova-compute[73078]:     <disk supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='diskDevice'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>disk</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>cdrom</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>floppy</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>lun</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='bus'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>fdc</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>scsi</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>usb</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>sata</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='model'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio-transitional</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio-non-transitional</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </disk>
Aug 14 18:06:46 user nova-compute[73078]:     <graphics supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='type'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>sdl</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>vnc</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>spice</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>egl-headless</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </graphics>
Aug 14 18:06:46 user nova-compute[73078]:     <video supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='modelType'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>vga</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>cirrus</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>vmvga</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>qxl</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>none</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>bochs</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>ramfb</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </video>
Aug 14 18:06:46 user nova-compute[73078]:     <hostdev supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='mode'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>subsystem</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='startupPolicy'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>default</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>mandatory</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>requisite</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>optional</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='subsysType'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>usb</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>pci</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>scsi</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='capsType'/>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='pciBackend'/>
Aug 14 18:06:46 user nova-compute[73078]:     </hostdev>
Aug 14 18:06:46 user nova-compute[73078]:     <rng supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='model'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio-transitional</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio-non-transitional</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='backendModel'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>random</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>egd</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>builtin</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </rng>
Aug 14 18:06:46 user nova-compute[73078]:     <filesystem supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='driverType'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>path</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>handle</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtiofs</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </filesystem>
Aug 14 18:06:46 user nova-compute[73078]:     <tpm supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='model'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>tpm-tis</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>tpm-crb</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='backendModel'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>passthrough</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>emulator</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </tpm>
Aug 14 18:06:46 user nova-compute[73078]:   </devices>
Aug 14 18:06:46 user nova-compute[73078]:   <features>
Aug 14 18:06:46 user nova-compute[73078]:     <gic supported='no'/>
Aug 14 18:06:46 user nova-compute[73078]:     <vmcoreinfo supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:     <genid supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:     <backingStoreInput supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:     <backup supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:     <sev supported='no'/>
Aug 14 18:06:46 user nova-compute[73078]:   </features>
Aug 14 18:06:46 user nova-compute[73078]: </domainCapabilities>
Aug 14 18:06:46 user nova-compute[73078]:  {{(pid=73078) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 14 18:06:46 user nova-compute[73078]: <domainCapabilities>
Aug 14 18:06:46 user nova-compute[73078]:   <path>/usr/bin/qemu-system-i386</path>
Aug 14 18:06:46 user nova-compute[73078]:   <domain>kvm</domain>
Aug 14 18:06:46 user nova-compute[73078]:   <machine>pc-i440fx-jammy</machine>
Aug 14 18:06:46 user nova-compute[73078]:   <arch>i686</arch>
Aug 14 18:06:46 user nova-compute[73078]:   <vcpu max='255'/>
Aug 14 18:06:46 user nova-compute[73078]:   <iothreads supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:   <os supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:     <enum name='firmware'/>
Aug 14 18:06:46 user nova-compute[73078]:     <loader supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 14 18:06:46 user nova-compute[73078]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 14 18:06:46 user nova-compute[73078]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 14 18:06:46 user nova-compute[73078]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 14 18:06:46 user nova-compute[73078]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='type'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>rom</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>pflash</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='readonly'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>yes</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>no</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='secure'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>no</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </loader>
Aug 14 18:06:46 user nova-compute[73078]:   </os>
Aug 14 18:06:46 user nova-compute[73078]:   <cpu>
Aug 14 18:06:46 user nova-compute[73078]:     <mode name='host-passthrough' supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='hostPassthroughMigratable'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>off</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </mode>
Aug 14 18:06:46 user nova-compute[73078]:     <mode name='maximum' supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='maximumMigratable'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>on</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>off</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </mode>
Aug 14 18:06:46 user nova-compute[73078]:     <mode name='host-model' supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <vendor>Intel</vendor>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='ss'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='vmx'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='pcid'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='hypervisor'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='arat'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='umip'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='md-clear'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='stibp'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='ssbd'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='ibpb'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='ibrs'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='amd-stibp'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='disable' name='erms'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='disable' name='lm'/>
Aug 14 18:06:46 user nova-compute[73078]:     </mode>
Aug 14 18:06:46 user nova-compute[73078]:     <mode name='custom' supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>qemu64</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>qemu32</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>phenom</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>pentium3</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>pentium2</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>pentium</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>n270</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>kvm64</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>kvm32</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>coreduo</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>core2duo</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>athlon</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Westmere-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Westmere</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Snowridge</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Server</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Client</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>SandyBridge</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Penryn</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Opteron_G5</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Opteron_G4</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Opteron_G3</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Opteron_G2</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Opteron_G1</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Nehalem-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Nehalem</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>IvyBridge</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Icelake-Server</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Haswell</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>EPYC-Rome</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>EPYC-Milan</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>EPYC</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Dhyana</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Cooperlake</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Conroe</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Broadwell</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>486</model>
Aug 14 18:06:46 user nova-compute[73078]:     </mode>
Aug 14 18:06:46 user nova-compute[73078]:   </cpu>
Aug 14 18:06:46 user nova-compute[73078]:   <memoryBacking supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:     <enum name='sourceType'>
Aug 14 18:06:46 user nova-compute[73078]:       <value>file</value>
Aug 14 18:06:46 user nova-compute[73078]:       <value>anonymous</value>
Aug 14 18:06:46 user nova-compute[73078]:       <value>memfd</value>
Aug 14 18:06:46 user nova-compute[73078]:     </enum>
Aug 14 18:06:46 user nova-compute[73078]:   </memoryBacking>
Aug 14 18:06:46 user nova-compute[73078]:   <devices>
Aug 14 18:06:46 user nova-compute[73078]:     <disk supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='diskDevice'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>disk</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>cdrom</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>floppy</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>lun</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='bus'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>ide</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>fdc</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>scsi</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>usb</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>sata</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='model'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio-transitional</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio-non-transitional</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </disk>
Aug 14 18:06:46 user nova-compute[73078]:     <graphics supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='type'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>sdl</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>vnc</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>spice</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>egl-headless</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </graphics>
Aug 14 18:06:46 user nova-compute[73078]:     <video supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='modelType'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>vga</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>cirrus</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>vmvga</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>qxl</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>none</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>bochs</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>ramfb</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </video>
Aug 14 18:06:46 user nova-compute[73078]:     <hostdev supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='mode'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>subsystem</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='startupPolicy'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>default</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>mandatory</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>requisite</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>optional</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='subsysType'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>usb</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>pci</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>scsi</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='capsType'/>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='pciBackend'/>
Aug 14 18:06:46 user nova-compute[73078]:     </hostdev>
Aug 14 18:06:46 user nova-compute[73078]:     <rng supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='model'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio-transitional</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio-non-transitional</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='backendModel'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>random</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>egd</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>builtin</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </rng>
Aug 14 18:06:46 user nova-compute[73078]:     <filesystem supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='driverType'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>path</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>handle</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtiofs</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </filesystem>
Aug 14 18:06:46 user nova-compute[73078]:     <tpm supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='model'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>tpm-tis</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>tpm-crb</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='backendModel'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>passthrough</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>emulator</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </tpm>
Aug 14 18:06:46 user nova-compute[73078]:   </devices>
Aug 14 18:06:46 user nova-compute[73078]:   <features>
Aug 14 18:06:46 user nova-compute[73078]:     <gic supported='no'/>
Aug 14 18:06:46 user nova-compute[73078]:     <vmcoreinfo supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:     <genid supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:     <backingStoreInput supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:     <backup supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:     <sev supported='no'/>
Aug 14 18:06:46 user nova-compute[73078]:   </features>
Aug 14 18:06:46 user nova-compute[73078]: </domainCapabilities>
Aug 14 18:06:46 user nova-compute[73078]:  {{(pid=73078) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 14 18:06:46 user nova-compute[73078]: <domainCapabilities>
Aug 14 18:06:46 user nova-compute[73078]:   <path>/usr/bin/qemu-system-i386</path>
Aug 14 18:06:46 user nova-compute[73078]:   <domain>kvm</domain>
Aug 14 18:06:46 user nova-compute[73078]:   <machine>pc-i440fx-6.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:   <arch>i686</arch>
Aug 14 18:06:46 user nova-compute[73078]:   <vcpu max='255'/>
Aug 14 18:06:46 user nova-compute[73078]:   <iothreads supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:   <os supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:     <enum name='firmware'/>
Aug 14 18:06:46 user nova-compute[73078]:     <loader supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 14 18:06:46 user nova-compute[73078]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 14 18:06:46 user nova-compute[73078]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 14 18:06:46 user nova-compute[73078]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 14 18:06:46 user nova-compute[73078]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='type'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>rom</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>pflash</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='readonly'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>yes</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>no</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='secure'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>no</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </loader>
Aug 14 18:06:46 user nova-compute[73078]:   </os>
Aug 14 18:06:46 user nova-compute[73078]:   <cpu>
Aug 14 18:06:46 user nova-compute[73078]:     <mode name='host-passthrough' supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='hostPassthroughMigratable'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>off</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </mode>
Aug 14 18:06:46 user nova-compute[73078]:     <mode name='maximum' supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='maximumMigratable'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>on</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>off</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </mode>
Aug 14 18:06:46 user nova-compute[73078]:     <mode name='host-model' supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <vendor>Intel</vendor>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='ss'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='vmx'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='pcid'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='hypervisor'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='arat'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='umip'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='md-clear'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='stibp'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='ssbd'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='ibpb'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='ibrs'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='amd-stibp'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='disable' name='erms'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='disable' name='lm'/>
Aug 14 18:06:46 user nova-compute[73078]:     </mode>
Aug 14 18:06:46 user nova-compute[73078]:     <mode name='custom' supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>qemu64</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>qemu32</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>phenom</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>pentium3</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>pentium2</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>pentium</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>n270</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>kvm64</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>kvm32</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>coreduo</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>core2duo</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>athlon</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Westmere-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Westmere</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Snowridge</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Server</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Client</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>SandyBridge</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Penryn</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Opteron_G5</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Opteron_G4</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Opteron_G3</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Opteron_G2</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Opteron_G1</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Nehalem-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Nehalem</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>IvyBridge</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Icelake-Server</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Haswell</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>EPYC-Rome</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>EPYC-Milan</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>EPYC</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Dhyana</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Cooperlake</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Conroe</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Broadwell</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>486</model>
Aug 14 18:06:46 user nova-compute[73078]:     </mode>
Aug 14 18:06:46 user nova-compute[73078]:   </cpu>
Aug 14 18:06:46 user nova-compute[73078]:   <memoryBacking supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:     <enum name='sourceType'>
Aug 14 18:06:46 user nova-compute[73078]:       <value>file</value>
Aug 14 18:06:46 user nova-compute[73078]:       <value>anonymous</value>
Aug 14 18:06:46 user nova-compute[73078]:       <value>memfd</value>
Aug 14 18:06:46 user nova-compute[73078]:     </enum>
Aug 14 18:06:46 user nova-compute[73078]:   </memoryBacking>
Aug 14 18:06:46 user nova-compute[73078]:   <devices>
Aug 14 18:06:46 user nova-compute[73078]:     <disk supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='diskDevice'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>disk</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>cdrom</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>floppy</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>lun</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='bus'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>ide</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>fdc</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>scsi</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>usb</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>sata</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='model'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio-transitional</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio-non-transitional</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </disk>
Aug 14 18:06:46 user nova-compute[73078]:     <graphics supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='type'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>sdl</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>vnc</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>spice</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>egl-headless</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </graphics>
Aug 14 18:06:46 user nova-compute[73078]:     <video supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='modelType'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>vga</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>cirrus</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>vmvga</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>qxl</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>none</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>bochs</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>ramfb</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </video>
Aug 14 18:06:46 user nova-compute[73078]:     <hostdev supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='mode'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>subsystem</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='startupPolicy'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>default</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>mandatory</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>requisite</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>optional</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='subsysType'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>usb</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>pci</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>scsi</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='capsType'/>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='pciBackend'/>
Aug 14 18:06:46 user nova-compute[73078]:     </hostdev>
Aug 14 18:06:46 user nova-compute[73078]:     <rng supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='model'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio-transitional</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio-non-transitional</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='backendModel'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>random</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>egd</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>builtin</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </rng>
Aug 14 18:06:46 user nova-compute[73078]:     <filesystem supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='driverType'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>path</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>handle</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtiofs</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </filesystem>
Aug 14 18:06:46 user nova-compute[73078]:     <tpm supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='model'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>tpm-tis</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>tpm-crb</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='backendModel'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>passthrough</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>emulator</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </tpm>
Aug 14 18:06:46 user nova-compute[73078]:   </devices>
Aug 14 18:06:46 user nova-compute[73078]:   <features>
Aug 14 18:06:46 user nova-compute[73078]:     <gic supported='no'/>
Aug 14 18:06:46 user nova-compute[73078]:     <vmcoreinfo supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:     <genid supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:     <backingStoreInput supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:     <backup supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:     <sev supported='no'/>
Aug 14 18:06:46 user nova-compute[73078]:   </features>
Aug 14 18:06:46 user nova-compute[73078]: </domainCapabilities>
Aug 14 18:06:46 user nova-compute[73078]:  {{(pid=73078) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 14 18:06:46 user nova-compute[73078]: <domainCapabilities>
Aug 14 18:06:46 user nova-compute[73078]:   <path>/usr/bin/qemu-system-i386</path>
Aug 14 18:06:46 user nova-compute[73078]:   <domain>kvm</domain>
Aug 14 18:06:46 user nova-compute[73078]:   <machine>pc-q35-jammy</machine>
Aug 14 18:06:46 user nova-compute[73078]:   <arch>i686</arch>
Aug 14 18:06:46 user nova-compute[73078]:   <vcpu max='288'/>
Aug 14 18:06:46 user nova-compute[73078]:   <iothreads supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:   <os supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:     <enum name='firmware'/>
Aug 14 18:06:46 user nova-compute[73078]:     <loader supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 14 18:06:46 user nova-compute[73078]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 14 18:06:46 user nova-compute[73078]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 14 18:06:46 user nova-compute[73078]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 14 18:06:46 user nova-compute[73078]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='type'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>rom</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>pflash</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='readonly'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>yes</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>no</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='secure'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>no</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </loader>
Aug 14 18:06:46 user nova-compute[73078]:   </os>
Aug 14 18:06:46 user nova-compute[73078]:   <cpu>
Aug 14 18:06:46 user nova-compute[73078]:     <mode name='host-passthrough' supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='hostPassthroughMigratable'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>off</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </mode>
Aug 14 18:06:46 user nova-compute[73078]:     <mode name='maximum' supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='maximumMigratable'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>on</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>off</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </mode>
Aug 14 18:06:46 user nova-compute[73078]:     <mode name='host-model' supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <vendor>Intel</vendor>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='ss'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='vmx'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='pcid'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='hypervisor'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='arat'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='umip'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='md-clear'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='stibp'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='ssbd'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='ibpb'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='ibrs'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='amd-stibp'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='disable' name='erms'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='disable' name='lm'/>
Aug 14 18:06:46 user nova-compute[73078]:     </mode>
Aug 14 18:06:46 user nova-compute[73078]:     <mode name='custom' supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>qemu64</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>qemu32</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>phenom</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>pentium3</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>pentium2</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>pentium</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>n270</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>kvm64</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>kvm32</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>coreduo</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>core2duo</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>athlon</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Westmere-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Westmere</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Snowridge</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Server</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Client</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>SandyBridge</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Penryn</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Opteron_G5</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Opteron_G4</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Opteron_G3</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Opteron_G2</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Opteron_G1</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Nehalem-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Nehalem</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>IvyBridge</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Icelake-Server</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Haswell</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>EPYC-Rome</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>EPYC-Milan</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>EPYC</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Dhyana</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Cooperlake</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Conroe</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Broadwell</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>486</model>
Aug 14 18:06:46 user nova-compute[73078]:     </mode>
Aug 14 18:06:46 user nova-compute[73078]:   </cpu>
Aug 14 18:06:46 user nova-compute[73078]:   <memoryBacking supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:     <enum name='sourceType'>
Aug 14 18:06:46 user nova-compute[73078]:       <value>file</value>
Aug 14 18:06:46 user nova-compute[73078]:       <value>anonymous</value>
Aug 14 18:06:46 user nova-compute[73078]:       <value>memfd</value>
Aug 14 18:06:46 user nova-compute[73078]:     </enum>
Aug 14 18:06:46 user nova-compute[73078]:   </memoryBacking>
Aug 14 18:06:46 user nova-compute[73078]:   <devices>
Aug 14 18:06:46 user nova-compute[73078]:     <disk supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='diskDevice'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>disk</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>cdrom</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>floppy</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>lun</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='bus'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>fdc</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>scsi</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>usb</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>sata</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='model'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio-transitional</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio-non-transitional</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </disk>
Aug 14 18:06:46 user nova-compute[73078]:     <graphics supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='type'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>sdl</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>vnc</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>spice</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>egl-headless</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </graphics>
Aug 14 18:06:46 user nova-compute[73078]:     <video supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='modelType'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>vga</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>cirrus</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>vmvga</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>qxl</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>none</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>bochs</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>ramfb</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </video>
Aug 14 18:06:46 user nova-compute[73078]:     <hostdev supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='mode'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>subsystem</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='startupPolicy'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>default</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>mandatory</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>requisite</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>optional</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='subsysType'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>usb</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>pci</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>scsi</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='capsType'/>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='pciBackend'/>
Aug 14 18:06:46 user nova-compute[73078]:     </hostdev>
Aug 14 18:06:46 user nova-compute[73078]:     <rng supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='model'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio-transitional</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio-non-transitional</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='backendModel'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>random</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>egd</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>builtin</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </rng>
Aug 14 18:06:46 user nova-compute[73078]:     <filesystem supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='driverType'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>path</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>handle</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtiofs</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </filesystem>
Aug 14 18:06:46 user nova-compute[73078]:     <tpm supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='model'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>tpm-tis</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>tpm-crb</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='backendModel'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>passthrough</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>emulator</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </tpm>
Aug 14 18:06:46 user nova-compute[73078]:   </devices>
Aug 14 18:06:46 user nova-compute[73078]:   <features>
Aug 14 18:06:46 user nova-compute[73078]:     <gic supported='no'/>
Aug 14 18:06:46 user nova-compute[73078]:     <vmcoreinfo supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:     <genid supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:     <backingStoreInput supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:     <backup supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:     <sev supported='no'/>
Aug 14 18:06:46 user nova-compute[73078]:   </features>
Aug 14 18:06:46 user nova-compute[73078]: </domainCapabilities>
Aug 14 18:06:46 user nova-compute[73078]:  {{(pid=73078) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=73078) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73078) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73078) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=73078) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=73078) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=73078) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=73078) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=73078) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=73078) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=73078) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=73078) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=73078) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=73078) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=73078) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=73078) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=73078) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=73078) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=73078) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73078) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73078) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73078) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=73078) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73078) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73078) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=73078) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=73078) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=73078) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=73078) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=73078) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=73078) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=73078) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=73078) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=73078) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=73078) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=73078) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=73078) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=73078) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=73078) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu', 'pc', 'ubuntu-q35'} {{(pid=73078) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 14 18:06:46 user nova-compute[73078]: <domainCapabilities>
Aug 14 18:06:46 user nova-compute[73078]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 14 18:06:46 user nova-compute[73078]:   <domain>kvm</domain>
Aug 14 18:06:46 user nova-compute[73078]:   <machine>pc-q35-6.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:   <arch>x86_64</arch>
Aug 14 18:06:46 user nova-compute[73078]:   <vcpu max='288'/>
Aug 14 18:06:46 user nova-compute[73078]:   <iothreads supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:   <os supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:     <enum name='firmware'>
Aug 14 18:06:46 user nova-compute[73078]:       <value>efi</value>
Aug 14 18:06:46 user nova-compute[73078]:     </enum>
Aug 14 18:06:46 user nova-compute[73078]:     <loader supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 14 18:06:46 user nova-compute[73078]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 14 18:06:46 user nova-compute[73078]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='type'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>rom</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>pflash</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='readonly'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>yes</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>no</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='secure'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>yes</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>no</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </loader>
Aug 14 18:06:46 user nova-compute[73078]:   </os>
Aug 14 18:06:46 user nova-compute[73078]:   <cpu>
Aug 14 18:06:46 user nova-compute[73078]:     <mode name='host-passthrough' supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='hostPassthroughMigratable'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>on</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>off</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </mode>
Aug 14 18:06:46 user nova-compute[73078]:     <mode name='maximum' supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='maximumMigratable'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>on</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>off</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </mode>
Aug 14 18:06:46 user nova-compute[73078]:     <mode name='host-model' supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <vendor>Intel</vendor>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='ss'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='vmx'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='pcid'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='hypervisor'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='arat'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='umip'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='md-clear'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='stibp'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='ssbd'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='invtsc'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='ibpb'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='ibrs'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='amd-stibp'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='rsba'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='pschange-mc-no'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='disable' name='erms'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 18:06:46 user nova-compute[73078]:     </mode>
Aug 14 18:06:46 user nova-compute[73078]:     <mode name='custom' supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>qemu64</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>qemu32</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>phenom</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>pentium3</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>pentium2</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>pentium</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>n270</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>kvm64</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>kvm32</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>coreduo</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>core2duo</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>athlon</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>Westmere-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>Westmere</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Snowridge</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Server</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Client</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>SandyBridge</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>Penryn</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Opteron_G5</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Opteron_G4</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Opteron_G3</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Opteron_G2</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>Opteron_G1</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>Nehalem</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>IvyBridge</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Icelake-Server</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Haswell</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>EPYC-Rome</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>EPYC-Milan</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>EPYC</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Dhyana</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Cooperlake</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>Conroe</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Broadwell</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>486</model>
Aug 14 18:06:46 user nova-compute[73078]:     </mode>
Aug 14 18:06:46 user nova-compute[73078]:   </cpu>
Aug 14 18:06:46 user nova-compute[73078]:   <memoryBacking supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:     <enum name='sourceType'>
Aug 14 18:06:46 user nova-compute[73078]:       <value>file</value>
Aug 14 18:06:46 user nova-compute[73078]:       <value>anonymous</value>
Aug 14 18:06:46 user nova-compute[73078]:       <value>memfd</value>
Aug 14 18:06:46 user nova-compute[73078]:     </enum>
Aug 14 18:06:46 user nova-compute[73078]:   </memoryBacking>
Aug 14 18:06:46 user nova-compute[73078]:   <devices>
Aug 14 18:06:46 user nova-compute[73078]:     <disk supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='diskDevice'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>disk</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>cdrom</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>floppy</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>lun</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='bus'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>fdc</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>scsi</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>usb</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>sata</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='model'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio-transitional</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio-non-transitional</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </disk>
Aug 14 18:06:46 user nova-compute[73078]:     <graphics supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='type'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>sdl</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>vnc</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>spice</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>egl-headless</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </graphics>
Aug 14 18:06:46 user nova-compute[73078]:     <video supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='modelType'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>vga</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>cirrus</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>vmvga</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>qxl</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>none</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>bochs</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>ramfb</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </video>
Aug 14 18:06:46 user nova-compute[73078]:     <hostdev supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='mode'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>subsystem</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='startupPolicy'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>default</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>mandatory</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>requisite</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>optional</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='subsysType'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>usb</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>pci</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>scsi</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='capsType'/>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='pciBackend'/>
Aug 14 18:06:46 user nova-compute[73078]:     </hostdev>
Aug 14 18:06:46 user nova-compute[73078]:     <rng supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='model'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio-transitional</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio-non-transitional</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='backendModel'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>random</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>egd</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>builtin</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </rng>
Aug 14 18:06:46 user nova-compute[73078]:     <filesystem supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='driverType'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>path</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>handle</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtiofs</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </filesystem>
Aug 14 18:06:46 user nova-compute[73078]:     <tpm supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='model'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>tpm-tis</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>tpm-crb</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='backendModel'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>passthrough</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>emulator</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </tpm>
Aug 14 18:06:46 user nova-compute[73078]:   </devices>
Aug 14 18:06:46 user nova-compute[73078]:   <features>
Aug 14 18:06:46 user nova-compute[73078]:     <gic supported='no'/>
Aug 14 18:06:46 user nova-compute[73078]:     <vmcoreinfo supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:     <genid supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:     <backingStoreInput supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:     <backup supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:     <sev supported='no'/>
Aug 14 18:06:46 user nova-compute[73078]:   </features>
Aug 14 18:06:46 user nova-compute[73078]: </domainCapabilities>
Aug 14 18:06:46 user nova-compute[73078]:  {{(pid=73078) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 14 18:06:46 user nova-compute[73078]: <domainCapabilities>
Aug 14 18:06:46 user nova-compute[73078]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 14 18:06:46 user nova-compute[73078]:   <domain>kvm</domain>
Aug 14 18:06:46 user nova-compute[73078]:   <machine>pc-i440fx-jammy</machine>
Aug 14 18:06:46 user nova-compute[73078]:   <arch>x86_64</arch>
Aug 14 18:06:46 user nova-compute[73078]:   <vcpu max='255'/>
Aug 14 18:06:46 user nova-compute[73078]:   <iothreads supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:   <os supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:     <enum name='firmware'>
Aug 14 18:06:46 user nova-compute[73078]:       <value>efi</value>
Aug 14 18:06:46 user nova-compute[73078]:     </enum>
Aug 14 18:06:46 user nova-compute[73078]:     <loader supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='type'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>rom</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>pflash</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='readonly'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>yes</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>no</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='secure'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>no</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </loader>
Aug 14 18:06:46 user nova-compute[73078]:   </os>
Aug 14 18:06:46 user nova-compute[73078]:   <cpu>
Aug 14 18:06:46 user nova-compute[73078]:     <mode name='host-passthrough' supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='hostPassthroughMigratable'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>on</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>off</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </mode>
Aug 14 18:06:46 user nova-compute[73078]:     <mode name='maximum' supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='maximumMigratable'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>on</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>off</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </mode>
Aug 14 18:06:46 user nova-compute[73078]:     <mode name='host-model' supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <vendor>Intel</vendor>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='ss'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='vmx'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='pcid'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='hypervisor'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='arat'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='umip'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='md-clear'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='stibp'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='ssbd'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='invtsc'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='ibpb'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='ibrs'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='amd-stibp'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='rsba'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='pschange-mc-no'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='disable' name='erms'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 18:06:46 user nova-compute[73078]:     </mode>
Aug 14 18:06:46 user nova-compute[73078]:     <mode name='custom' supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>qemu64</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>qemu32</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>phenom</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>pentium3</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>pentium2</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>pentium</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>n270</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>kvm64</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>kvm32</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>coreduo</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>core2duo</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>athlon</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>Westmere-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>Westmere</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Snowridge</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Server</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Client</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>SandyBridge</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>Penryn</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Opteron_G5</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Opteron_G4</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Opteron_G3</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Opteron_G2</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>Opteron_G1</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>Nehalem</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>IvyBridge</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Icelake-Server</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Haswell</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>EPYC-Rome</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>EPYC-Milan</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>EPYC</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Dhyana</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Cooperlake</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>Conroe</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Broadwell</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>486</model>
Aug 14 18:06:46 user nova-compute[73078]:     </mode>
Aug 14 18:06:46 user nova-compute[73078]:   </cpu>
Aug 14 18:06:46 user nova-compute[73078]:   <memoryBacking supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:     <enum name='sourceType'>
Aug 14 18:06:46 user nova-compute[73078]:       <value>file</value>
Aug 14 18:06:46 user nova-compute[73078]:       <value>anonymous</value>
Aug 14 18:06:46 user nova-compute[73078]:       <value>memfd</value>
Aug 14 18:06:46 user nova-compute[73078]:     </enum>
Aug 14 18:06:46 user nova-compute[73078]:   </memoryBacking>
Aug 14 18:06:46 user nova-compute[73078]:   <devices>
Aug 14 18:06:46 user nova-compute[73078]:     <disk supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='diskDevice'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>disk</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>cdrom</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>floppy</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>lun</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='bus'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>ide</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>fdc</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>scsi</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>usb</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>sata</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='model'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio-transitional</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio-non-transitional</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </disk>
Aug 14 18:06:46 user nova-compute[73078]:     <graphics supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='type'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>sdl</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>vnc</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>spice</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>egl-headless</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </graphics>
Aug 14 18:06:46 user nova-compute[73078]:     <video supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='modelType'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>vga</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>cirrus</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>vmvga</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>qxl</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>none</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>bochs</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>ramfb</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </video>
Aug 14 18:06:46 user nova-compute[73078]:     <hostdev supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='mode'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>subsystem</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='startupPolicy'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>default</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>mandatory</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>requisite</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>optional</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='subsysType'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>usb</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>pci</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>scsi</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='capsType'/>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='pciBackend'/>
Aug 14 18:06:46 user nova-compute[73078]:     </hostdev>
Aug 14 18:06:46 user nova-compute[73078]:     <rng supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='model'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio-transitional</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio-non-transitional</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='backendModel'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>random</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>egd</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>builtin</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </rng>
Aug 14 18:06:46 user nova-compute[73078]:     <filesystem supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='driverType'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>path</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>handle</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtiofs</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </filesystem>
Aug 14 18:06:46 user nova-compute[73078]:     <tpm supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='model'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>tpm-tis</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>tpm-crb</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='backendModel'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>passthrough</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>emulator</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </tpm>
Aug 14 18:06:46 user nova-compute[73078]:   </devices>
Aug 14 18:06:46 user nova-compute[73078]:   <features>
Aug 14 18:06:46 user nova-compute[73078]:     <gic supported='no'/>
Aug 14 18:06:46 user nova-compute[73078]:     <vmcoreinfo supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:     <genid supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:     <backingStoreInput supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:     <backup supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:     <sev supported='no'/>
Aug 14 18:06:46 user nova-compute[73078]:   </features>
Aug 14 18:06:46 user nova-compute[73078]: </domainCapabilities>
Aug 14 18:06:46 user nova-compute[73078]:  {{(pid=73078) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 14 18:06:46 user nova-compute[73078]: <domainCapabilities>
Aug 14 18:06:46 user nova-compute[73078]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 14 18:06:46 user nova-compute[73078]:   <domain>kvm</domain>
Aug 14 18:06:46 user nova-compute[73078]:   <machine>pc-i440fx-6.2</machine>
Aug 14 18:06:46 user nova-compute[73078]:   <arch>x86_64</arch>
Aug 14 18:06:46 user nova-compute[73078]:   <vcpu max='255'/>
Aug 14 18:06:46 user nova-compute[73078]:   <iothreads supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:   <os supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:     <enum name='firmware'>
Aug 14 18:06:46 user nova-compute[73078]:       <value>efi</value>
Aug 14 18:06:46 user nova-compute[73078]:     </enum>
Aug 14 18:06:46 user nova-compute[73078]:     <loader supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='type'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>rom</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>pflash</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='readonly'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>yes</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>no</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='secure'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>no</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </loader>
Aug 14 18:06:46 user nova-compute[73078]:   </os>
Aug 14 18:06:46 user nova-compute[73078]:   <cpu>
Aug 14 18:06:46 user nova-compute[73078]:     <mode name='host-passthrough' supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='hostPassthroughMigratable'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>on</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>off</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </mode>
Aug 14 18:06:46 user nova-compute[73078]:     <mode name='maximum' supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='maximumMigratable'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>on</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>off</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </mode>
Aug 14 18:06:46 user nova-compute[73078]:     <mode name='host-model' supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <vendor>Intel</vendor>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='ss'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='vmx'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='pcid'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='hypervisor'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='arat'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='umip'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='md-clear'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='stibp'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='ssbd'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='invtsc'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='ibpb'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='ibrs'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='amd-stibp'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='rsba'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='pschange-mc-no'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='disable' name='erms'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 18:06:46 user nova-compute[73078]:     </mode>
Aug 14 18:06:46 user nova-compute[73078]:     <mode name='custom' supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>qemu64</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>qemu32</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>phenom</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>pentium3</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>pentium2</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>pentium</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>n270</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>kvm64</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>kvm32</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>coreduo</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>core2duo</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>athlon</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>Westmere-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>Westmere</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Snowridge</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Server</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Client</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>SandyBridge</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>Penryn</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Opteron_G5</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Opteron_G4</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Opteron_G3</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Opteron_G2</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>Opteron_G1</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>Nehalem</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>IvyBridge</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Icelake-Server</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Haswell</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>EPYC-Rome</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>EPYC-Milan</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>EPYC</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Dhyana</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Cooperlake</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>Conroe</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Broadwell</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>486</model>
Aug 14 18:06:46 user nova-compute[73078]:     </mode>
Aug 14 18:06:46 user nova-compute[73078]:   </cpu>
Aug 14 18:06:46 user nova-compute[73078]:   <memoryBacking supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:     <enum name='sourceType'>
Aug 14 18:06:46 user nova-compute[73078]:       <value>file</value>
Aug 14 18:06:46 user nova-compute[73078]:       <value>anonymous</value>
Aug 14 18:06:46 user nova-compute[73078]:       <value>memfd</value>
Aug 14 18:06:46 user nova-compute[73078]:     </enum>
Aug 14 18:06:46 user nova-compute[73078]:   </memoryBacking>
Aug 14 18:06:46 user nova-compute[73078]:   <devices>
Aug 14 18:06:46 user nova-compute[73078]:     <disk supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='diskDevice'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>disk</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>cdrom</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>floppy</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>lun</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='bus'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>ide</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>fdc</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>scsi</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>usb</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>sata</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='model'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio-transitional</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio-non-transitional</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </disk>
Aug 14 18:06:46 user nova-compute[73078]:     <graphics supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='type'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>sdl</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>vnc</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>spice</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>egl-headless</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </graphics>
Aug 14 18:06:46 user nova-compute[73078]:     <video supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='modelType'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>vga</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>cirrus</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>vmvga</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>qxl</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>none</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>bochs</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>ramfb</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </video>
Aug 14 18:06:46 user nova-compute[73078]:     <hostdev supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='mode'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>subsystem</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='startupPolicy'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>default</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>mandatory</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>requisite</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>optional</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='subsysType'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>usb</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>pci</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>scsi</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='capsType'/>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='pciBackend'/>
Aug 14 18:06:46 user nova-compute[73078]:     </hostdev>
Aug 14 18:06:46 user nova-compute[73078]:     <rng supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='model'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio-transitional</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio-non-transitional</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='backendModel'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>random</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>egd</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>builtin</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </rng>
Aug 14 18:06:46 user nova-compute[73078]:     <filesystem supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='driverType'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>path</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>handle</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtiofs</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </filesystem>
Aug 14 18:06:46 user nova-compute[73078]:     <tpm supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='model'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>tpm-tis</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>tpm-crb</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='backendModel'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>passthrough</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>emulator</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </tpm>
Aug 14 18:06:46 user nova-compute[73078]:   </devices>
Aug 14 18:06:46 user nova-compute[73078]:   <features>
Aug 14 18:06:46 user nova-compute[73078]:     <gic supported='no'/>
Aug 14 18:06:46 user nova-compute[73078]:     <vmcoreinfo supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:     <genid supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:     <backingStoreInput supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:     <backup supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:     <sev supported='no'/>
Aug 14 18:06:46 user nova-compute[73078]:   </features>
Aug 14 18:06:46 user nova-compute[73078]: </domainCapabilities>
Aug 14 18:06:46 user nova-compute[73078]:  {{(pid=73078) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 14 18:06:46 user nova-compute[73078]: <domainCapabilities>
Aug 14 18:06:46 user nova-compute[73078]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 14 18:06:46 user nova-compute[73078]:   <domain>kvm</domain>
Aug 14 18:06:46 user nova-compute[73078]:   <machine>pc-q35-jammy</machine>
Aug 14 18:06:46 user nova-compute[73078]:   <arch>x86_64</arch>
Aug 14 18:06:46 user nova-compute[73078]:   <vcpu max='288'/>
Aug 14 18:06:46 user nova-compute[73078]:   <iothreads supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:   <os supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:     <enum name='firmware'>
Aug 14 18:06:46 user nova-compute[73078]:       <value>efi</value>
Aug 14 18:06:46 user nova-compute[73078]:     </enum>
Aug 14 18:06:46 user nova-compute[73078]:     <loader supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 14 18:06:46 user nova-compute[73078]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 14 18:06:46 user nova-compute[73078]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='type'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>rom</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>pflash</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='readonly'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>yes</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>no</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='secure'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>yes</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>no</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </loader>
Aug 14 18:06:46 user nova-compute[73078]:   </os>
Aug 14 18:06:46 user nova-compute[73078]:   <cpu>
Aug 14 18:06:46 user nova-compute[73078]:     <mode name='host-passthrough' supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='hostPassthroughMigratable'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>on</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>off</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </mode>
Aug 14 18:06:46 user nova-compute[73078]:     <mode name='maximum' supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='maximumMigratable'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>on</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>off</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </mode>
Aug 14 18:06:46 user nova-compute[73078]:     <mode name='host-model' supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <vendor>Intel</vendor>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='ss'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='vmx'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='pcid'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='hypervisor'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='arat'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='umip'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='md-clear'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='stibp'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='ssbd'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='invtsc'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='ibpb'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='ibrs'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='amd-stibp'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='rsba'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='require' name='pschange-mc-no'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='disable' name='erms'/>
Aug 14 18:06:46 user nova-compute[73078]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 18:06:46 user nova-compute[73078]:     </mode>
Aug 14 18:06:46 user nova-compute[73078]:     <mode name='custom' supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>qemu64</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>qemu32</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>phenom</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>pentium3</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>pentium2</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>pentium</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>n270</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>kvm64</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>kvm32</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>coreduo</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>core2duo</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>athlon</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>Westmere-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>Westmere</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Snowridge</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Server</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Skylake-Client</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>SandyBridge</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>Penryn</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Opteron_G5</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Opteron_G4</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Opteron_G3</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Opteron_G2</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>Opteron_G1</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>Nehalem</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>IvyBridge</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Icelake-Server</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Haswell</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>EPYC-Rome</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>EPYC-Milan</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>EPYC</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Dhyana</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Cooperlake</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>Conroe</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='no'>Broadwell</model>
Aug 14 18:06:46 user nova-compute[73078]:       <model usable='yes'>486</model>
Aug 14 18:06:46 user nova-compute[73078]:     </mode>
Aug 14 18:06:46 user nova-compute[73078]:   </cpu>
Aug 14 18:06:46 user nova-compute[73078]:   <memoryBacking supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:     <enum name='sourceType'>
Aug 14 18:06:46 user nova-compute[73078]:       <value>file</value>
Aug 14 18:06:46 user nova-compute[73078]:       <value>anonymous</value>
Aug 14 18:06:46 user nova-compute[73078]:       <value>memfd</value>
Aug 14 18:06:46 user nova-compute[73078]:     </enum>
Aug 14 18:06:46 user nova-compute[73078]:   </memoryBacking>
Aug 14 18:06:46 user nova-compute[73078]:   <devices>
Aug 14 18:06:46 user nova-compute[73078]:     <disk supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='diskDevice'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>disk</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>cdrom</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>floppy</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>lun</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='bus'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>fdc</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>scsi</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>usb</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>sata</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='model'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio-transitional</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio-non-transitional</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </disk>
Aug 14 18:06:46 user nova-compute[73078]:     <graphics supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='type'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>sdl</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>vnc</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>spice</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>egl-headless</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </graphics>
Aug 14 18:06:46 user nova-compute[73078]:     <video supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='modelType'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>vga</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>cirrus</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>vmvga</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>qxl</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>none</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>bochs</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>ramfb</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </video>
Aug 14 18:06:46 user nova-compute[73078]:     <hostdev supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='mode'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>subsystem</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='startupPolicy'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>default</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>mandatory</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>requisite</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>optional</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='subsysType'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>usb</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>pci</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>scsi</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='capsType'/>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='pciBackend'/>
Aug 14 18:06:46 user nova-compute[73078]:     </hostdev>
Aug 14 18:06:46 user nova-compute[73078]:     <rng supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='model'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio-transitional</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtio-non-transitional</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='backendModel'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>random</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>egd</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>builtin</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </rng>
Aug 14 18:06:46 user nova-compute[73078]:     <filesystem supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='driverType'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>path</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>handle</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>virtiofs</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </filesystem>
Aug 14 18:06:46 user nova-compute[73078]:     <tpm supported='yes'>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='model'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>tpm-tis</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>tpm-crb</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:       <enum name='backendModel'>
Aug 14 18:06:46 user nova-compute[73078]:         <value>passthrough</value>
Aug 14 18:06:46 user nova-compute[73078]:         <value>emulator</value>
Aug 14 18:06:46 user nova-compute[73078]:       </enum>
Aug 14 18:06:46 user nova-compute[73078]:     </tpm>
Aug 14 18:06:46 user nova-compute[73078]:   </devices>
Aug 14 18:06:46 user nova-compute[73078]:   <features>
Aug 14 18:06:46 user nova-compute[73078]:     <gic supported='no'/>
Aug 14 18:06:46 user nova-compute[73078]:     <vmcoreinfo supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:     <genid supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:     <backingStoreInput supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:     <backup supported='yes'/>
Aug 14 18:06:46 user nova-compute[73078]:     <sev supported='no'/>
Aug 14 18:06:46 user nova-compute[73078]:   </features>
Aug 14 18:06:46 user nova-compute[73078]: </domainCapabilities>
Aug 14 18:06:46 user nova-compute[73078]:  {{(pid=73078) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=73078) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=73078) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=73078) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=73078) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Checking secure boot support for host arch (x86_64) {{(pid=73078) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 14 18:06:46 user nova-compute[73078]: INFO nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Secure Boot support detected
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] cpu compare xml: <cpu match="exact">
Aug 14 18:06:46 user nova-compute[73078]:   <model>Nehalem</model>
Aug 14 18:06:46 user nova-compute[73078]: </cpu>
Aug 14 18:06:46 user nova-compute[73078]:  {{(pid=73078) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 14 18:06:46 user nova-compute[73078]: INFO nova.virt.node [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Generated node identity af8baf5b-57ff-4012-bdc8-cc28446f0e7b
Aug 14 18:06:46 user nova-compute[73078]: INFO nova.virt.node [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Wrote node identity af8baf5b-57ff-4012-bdc8-cc28446f0e7b to /opt/stack/data/nova/compute_id
Aug 14 18:06:46 user nova-compute[73078]: WARNING nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Compute nodes ['af8baf5b-57ff-4012-bdc8-cc28446f0e7b'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 14 18:06:46 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 14 18:06:46 user nova-compute[73078]: WARNING nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 14 18:06:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:06:46 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:06:46 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Hypervisor/Node resource view: name=user free_ram=10896MB free_disk=26.17755126953125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:06:46 user nova-compute[73078]: WARNING nova.compute.resource_tracker [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] No compute node record for user:af8baf5b-57ff-4012-bdc8-cc28446f0e7b: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host af8baf5b-57ff-4012-bdc8-cc28446f0e7b could not be found.
Aug 14 18:06:46 user nova-compute[73078]: INFO nova.compute.resource_tracker [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Compute node record created for user:user with uuid: af8baf5b-57ff-4012-bdc8-cc28446f0e7b
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:06:46 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [req-3d2761f9-af40-4e5c-927a-d9857fa6d4fb] Created resource provider record via placement API for resource provider with UUID af8baf5b-57ff-4012-bdc8-cc28446f0e7b and name user.
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=73078) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 14 18:06:46 user nova-compute[73078]: INFO nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] kernel doesn't support AMD SEV
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Updating inventory in ProviderTree for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:06:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Libvirt baseline CPU <cpu>
Aug 14 18:06:46 user nova-compute[73078]:   <arch>x86_64</arch>
Aug 14 18:06:46 user nova-compute[73078]:   <model>Nehalem</model>
Aug 14 18:06:46 user nova-compute[73078]:   <vendor>Intel</vendor>
Aug 14 18:06:46 user nova-compute[73078]:   <topology sockets="6" cores="1" threads="1"/>
Aug 14 18:06:46 user nova-compute[73078]: </cpu>
Aug 14 18:06:46 user nova-compute[73078]:  {{(pid=73078) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 14 18:06:47 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Updated inventory for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 14 18:06:47 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Updating resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b generation from 0 to 1 during operation: update_inventory {{(pid=73078) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 14 18:06:47 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Updating inventory in ProviderTree for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 18:06:47 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Updating resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b generation from 1 to 2 during operation: update_traits {{(pid=73078) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 14 18:06:47 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:06:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.625s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:06:47 user nova-compute[73078]: DEBUG nova.service [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Creating RPC server for service compute {{(pid=73078) start /opt/stack/nova/nova/service.py:182}}
Aug 14 18:06:47 user nova-compute[73078]: DEBUG nova.service [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Join ServiceGroup membership for this service compute {{(pid=73078) start /opt/stack/nova/nova/service.py:199}}
Aug 14 18:06:47 user nova-compute[73078]: DEBUG nova.servicegroup.drivers.db [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=73078) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 14 18:06:58 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:06:58 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:07:38 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:07:38 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:07:38 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:07:38 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Rebuilding the list of instances to heal {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 18:07:38 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Didn't find any instances for network info cache update. {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 18:07:38 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:07:38 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:07:38 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:07:38 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:07:38 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:07:38 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:07:38 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:07:38 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:07:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:07:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:07:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:07:38 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:07:38 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:07:38 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:07:38 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=10299MB free_disk=26.081192016601562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:07:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:07:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:07:38 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:07:38 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:07:38 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:07:38 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:07:38 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:07:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:08:38 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:08:38 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:08:38 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:08:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:08:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:08:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:08:38 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:08:38 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:08:38 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:08:38 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=10190MB free_disk=26.12775421142578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:08:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:08:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:08:38 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:08:38 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:08:39 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:08:39 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:08:39 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:08:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:08:39 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:08:39 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:08:39 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:08:39 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:08:39 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:08:40 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:08:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:08:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Rebuilding the list of instances to heal {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 18:08:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Didn't find any instances for network info cache update. {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 18:08:40 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:08:40 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:09:39 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:09:39 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:09:39 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:09:39 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:09:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:09:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:09:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:09:39 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:09:39 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:09:39 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:09:39 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=10183MB free_disk=25.911544799804688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:09:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:09:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:09:39 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:09:39 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:09:39 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:09:39 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:09:39 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:09:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:09:40 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:09:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:09:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Rebuilding the list of instances to heal {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 18:09:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Didn't find any instances for network info cache update. {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 18:09:40 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:09:40 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:09:41 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:09:41 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:09:42 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:10:39 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:10:40 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:10:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:10:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Rebuilding the list of instances to heal {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 18:10:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Didn't find any instances for network info cache update. {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 18:10:41 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:10:41 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:10:41 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:10:41 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:10:41 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:10:41 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:10:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:10:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:10:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:10:41 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:10:41 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:10:41 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:10:41 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=9458MB free_disk=25.934219360351562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:10:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:10:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:10:41 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:10:41 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:10:41 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:10:41 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:10:41 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:10:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:10:42 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:10:42 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:10:43 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:10:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Acquiring lock "c29d7f9d-793f-4511-9203-06b653e52f72" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:10:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Lock "c29d7f9d-793f-4511-9203-06b653e52f72" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:10:47 user nova-compute[73078]: DEBUG nova.compute.manager [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:10:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:10:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:10:47 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:10:47 user nova-compute[73078]: INFO nova.compute.claims [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Claim successful on node user
Aug 14 18:10:47 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:10:47 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:10:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.499s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:10:47 user nova-compute[73078]: DEBUG nova.compute.manager [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:10:48 user nova-compute[73078]: DEBUG nova.compute.manager [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:10:48 user nova-compute[73078]: DEBUG nova.network.neutron [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:10:48 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:10:48 user nova-compute[73078]: DEBUG nova.compute.manager [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:10:48 user nova-compute[73078]: DEBUG nova.compute.manager [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:10:48 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:10:48 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Creating image(s)
Aug 14 18:10:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Acquiring lock "/opt/stack/data/nova/instances/c29d7f9d-793f-4511-9203-06b653e52f72/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:10:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Lock "/opt/stack/data/nova/instances/c29d7f9d-793f-4511-9203-06b653e52f72/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:10:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Lock "/opt/stack/data/nova/instances/c29d7f9d-793f-4511-9203-06b653e52f72/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:10:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:10:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:10:48 user nova-compute[73078]: DEBUG nova.policy [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c08ad4734894a03a61c8f724e428dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc5cc86317d4c90bf119b8bc5ec9c1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:10:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd.part --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:10:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd.part --force-share --output=json" returned: 0 in 0.199s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:10:49 user nova-compute[73078]: DEBUG nova.virt.images [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] 2cbd52c4-773f-4d5a-bbb1-b6f1221c7774 was qcow2, converting to raw {{(pid=73078) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 18:10:49 user nova-compute[73078]: DEBUG nova.privsep.utils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73078) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 18:10:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd.part /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd.converted {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:10:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd.part /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd.converted" returned: 0 in 0.372s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:10:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd.converted --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:10:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:10:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.508s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:10:49 user nova-compute[73078]: INFO oslo.privsep.daemon [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpgw727r3x/privsep.sock']
Aug 14 18:10:49 user sudo[82310]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpgw727r3x/privsep.sock
Aug 14 18:10:49 user sudo[82310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 14 18:10:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "de80e188-9385-4613-8a6c-aa72b624ad55" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:10:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "de80e188-9385-4613-8a6c-aa72b624ad55" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:10:50 user nova-compute[73078]: DEBUG nova.compute.manager [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:10:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:10:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:10:50 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:10:50 user nova-compute[73078]: INFO nova.compute.claims [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Claim successful on node user
Aug 14 18:10:50 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:10:50 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:10:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.282s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:10:50 user nova-compute[73078]: DEBUG nova.compute.manager [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:10:50 user nova-compute[73078]: DEBUG nova.compute.manager [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:10:50 user nova-compute[73078]: DEBUG nova.network.neutron [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:10:50 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:10:50 user nova-compute[73078]: DEBUG nova.compute.manager [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:10:50 user nova-compute[73078]: DEBUG nova.compute.manager [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:10:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:10:50 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Creating image(s)
Aug 14 18:10:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "/opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:10:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "/opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:10:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "/opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:10:51 user nova-compute[73078]: DEBUG nova.policy [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd25ecea70e9e481e8a1957a94d79edfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec53c6018ee44b09ee31ba712a789aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:10:51 user nova-compute[73078]: DEBUG nova.network.neutron [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Successfully created port: 89874ba3-0758-4c32-b1ec-6d0dd813fb71 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:10:51 user sudo[82310]: pam_unix(sudo:session): session closed for user root
Aug 14 18:10:51 user nova-compute[73078]: INFO oslo.privsep.daemon [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Spawned new privsep daemon via rootwrap
Aug 14 18:10:51 user nova-compute[73078]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 14 18:10:51 user nova-compute[73078]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 14 18:10:51 user nova-compute[73078]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 14 18:10:51 user nova-compute[73078]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82314
Aug 14 18:10:51 user nova-compute[73078]: WARNING oslo_privsep.priv_context [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] privsep daemon already running
Aug 14 18:10:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:10:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:10:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.169s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:10:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:10:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:10:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:10:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.209s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:10:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.172s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/c29d7f9d-793f-4511-9203-06b653e52f72/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/c29d7f9d-793f-4511-9203-06b653e52f72/disk 1073741824" returned: 0 in 0.046s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.192s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "1f88cb97-4f22-439e-99f2-d7cb8d5aff36" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "1f88cb97-4f22-439e-99f2-d7cb8d5aff36" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.170s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c29d7f9d-793f-4511-9203-06b653e52f72/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c29d7f9d-793f-4511-9203-06b653e52f72/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG nova.compute.manager [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.210s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk 1073741824" returned: 0 in 0.053s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:10:52 user nova-compute[73078]: INFO nova.compute.claims [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Claim successful on node user
Aug 14 18:10:52 user nova-compute[73078]: DEBUG nova.compute.manager [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c29d7f9d-793f-4511-9203-06b653e52f72/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Cannot resize image /opt/stack/data/nova/instances/c29d7f9d-793f-4511-9203-06b653e52f72/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG nova.objects.instance [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Lazy-loading 'migration_context' on Instance uuid c29d7f9d-793f-4511-9203-06b653e52f72 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Ensure instance console log exists: /opt/stack/data/nova/instances/c29d7f9d-793f-4511-9203-06b653e52f72/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.158s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Cannot resize image /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG nova.objects.instance [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lazy-loading 'migration_context' on Instance uuid de80e188-9385-4613-8a6c-aa72b624ad55 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Ensure instance console log exists: /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.371s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG nova.compute.manager [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.198s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:10:52 user nova-compute[73078]: INFO nova.compute.claims [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Claim successful on node user
Aug 14 18:10:52 user nova-compute[73078]: DEBUG nova.compute.manager [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:10:52 user nova-compute[73078]: DEBUG nova.network.neutron [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:10:52 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:10:52 user nova-compute[73078]: DEBUG nova.compute.manager [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG nova.compute.manager [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:10:53 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Creating image(s)
Aug 14 18:10:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "/opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "/opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "/opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.395s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG nova.compute.manager [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG nova.compute.manager [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG nova.network.neutron [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.201s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:10:53 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:10:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG nova.policy [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0cca1112ab354f9fb31658e18c0d03b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993dd55f40454640824687ffb6a3c581', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG nova.compute.manager [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.165s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG nova.compute.manager [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:10:53 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Creating image(s)
Aug 14 18:10:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "/opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "/opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "/opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk 1073741824" returned: 0 in 0.073s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.179s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.215s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG nova.network.neutron [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Successfully created port: 2afe973c-46fa-4336-996f-b5dcd374c96e {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.157s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG nova.policy [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd25ecea70e9e481e8a1957a94d79edfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec53c6018ee44b09ee31ba712a789aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk 1073741824" returned: 0 in 0.053s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:10:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:10:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:10:54 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Cannot resize image /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:10:54 user nova-compute[73078]: DEBUG nova.objects.instance [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lazy-loading 'migration_context' on Instance uuid 1f88cb97-4f22-439e-99f2-d7cb8d5aff36 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:10:54 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:10:54 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Ensure instance console log exists: /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:10:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:10:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.004s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:10:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:10:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.179s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:10:54 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:10:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:10:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:10:54 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Cannot resize image /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:10:54 user nova-compute[73078]: DEBUG nova.objects.instance [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lazy-loading 'migration_context' on Instance uuid 3c840309-9884-4c8a-a6ee-1acd44f32c4c {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:10:54 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:10:54 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Ensure instance console log exists: /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:10:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:10:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:10:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:10:57 user nova-compute[73078]: DEBUG nova.network.neutron [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Successfully updated port: 89874ba3-0758-4c32-b1ec-6d0dd813fb71 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:10:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Acquiring lock "refresh_cache-c29d7f9d-793f-4511-9203-06b653e52f72" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:10:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Acquired lock "refresh_cache-c29d7f9d-793f-4511-9203-06b653e52f72" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:10:57 user nova-compute[73078]: DEBUG nova.network.neutron [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:10:57 user nova-compute[73078]: DEBUG nova.network.neutron [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:10:57 user nova-compute[73078]: DEBUG nova.compute.manager [req-30ec75e5-902c-4e90-9847-eb29fbbc7d41 req-1c6252b5-d953-40c7-a7b1-666e2be0e6fb service nova] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Received event network-changed-89874ba3-0758-4c32-b1ec-6d0dd813fb71 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:10:57 user nova-compute[73078]: DEBUG nova.compute.manager [req-30ec75e5-902c-4e90-9847-eb29fbbc7d41 req-1c6252b5-d953-40c7-a7b1-666e2be0e6fb service nova] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Refreshing instance network info cache due to event network-changed-89874ba3-0758-4c32-b1ec-6d0dd813fb71. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:10:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-30ec75e5-902c-4e90-9847-eb29fbbc7d41 req-1c6252b5-d953-40c7-a7b1-666e2be0e6fb service nova] Acquiring lock "refresh_cache-c29d7f9d-793f-4511-9203-06b653e52f72" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:10:57 user nova-compute[73078]: DEBUG nova.network.neutron [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Successfully updated port: 2afe973c-46fa-4336-996f-b5dcd374c96e {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:10:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "refresh_cache-de80e188-9385-4613-8a6c-aa72b624ad55" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:10:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquired lock "refresh_cache-de80e188-9385-4613-8a6c-aa72b624ad55" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:10:57 user nova-compute[73078]: DEBUG nova.network.neutron [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:10:58 user nova-compute[73078]: DEBUG nova.network.neutron [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:10:58 user nova-compute[73078]: DEBUG nova.compute.manager [req-b78a00ee-8146-4230-a1d1-5197d36e202c req-ef574ac9-7897-466d-9726-4aff1a24fff4 service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Received event network-changed-2afe973c-46fa-4336-996f-b5dcd374c96e {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:10:58 user nova-compute[73078]: DEBUG nova.compute.manager [req-b78a00ee-8146-4230-a1d1-5197d36e202c req-ef574ac9-7897-466d-9726-4aff1a24fff4 service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Refreshing instance network info cache due to event network-changed-2afe973c-46fa-4336-996f-b5dcd374c96e. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:10:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b78a00ee-8146-4230-a1d1-5197d36e202c req-ef574ac9-7897-466d-9726-4aff1a24fff4 service nova] Acquiring lock "refresh_cache-de80e188-9385-4613-8a6c-aa72b624ad55" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:10:58 user nova-compute[73078]: DEBUG nova.network.neutron [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Successfully created port: 8df77a26-faab-47ca-a39b-3df6930cd1d5 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:10:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Acquiring lock "24c00db3-2457-443d-b5ab-7e6ecaa57515" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:10:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:10:58 user nova-compute[73078]: DEBUG nova.compute.manager [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:10:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:10:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:10:58 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:10:58 user nova-compute[73078]: INFO nova.compute.claims [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Claim successful on node user
Aug 14 18:10:58 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:10:58 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:10:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.366s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:10:58 user nova-compute[73078]: DEBUG nova.compute.manager [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:10:58 user nova-compute[73078]: DEBUG nova.network.neutron [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Successfully created port: 03e9ece7-7612-4a4f-86ab-d85b0c97d723 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:10:58 user nova-compute[73078]: DEBUG nova.compute.manager [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:10:58 user nova-compute[73078]: DEBUG nova.network.neutron [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:10:58 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:10:58 user nova-compute[73078]: DEBUG nova.compute.manager [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.compute.manager [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:10:59 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Creating image(s)
Aug 14 18:10:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Acquiring lock "/opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "/opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "/opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.policy [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ad487c5160a4dd8b9a03d468edf4bef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09794ca2aebc4f50a4ab26cecefb4d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.190s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.network.neutron [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Updating instance_info_cache with network_info: [{"id": "89874ba3-0758-4c32-b1ec-6d0dd813fb71", "address": "fa:16:3e:a4:11:94", "network": {"id": "a97d8218-d78c-43aa-80b9-58e1cda130cf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-617867352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dc5cc86317d4c90bf119b8bc5ec9c1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89874ba3-07", "ovs_interfaceid": "89874ba3-0758-4c32-b1ec-6d0dd813fb71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Releasing lock "refresh_cache-c29d7f9d-793f-4511-9203-06b653e52f72" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.compute.manager [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Instance network_info: |[{"id": "89874ba3-0758-4c32-b1ec-6d0dd813fb71", "address": "fa:16:3e:a4:11:94", "network": {"id": "a97d8218-d78c-43aa-80b9-58e1cda130cf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-617867352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dc5cc86317d4c90bf119b8bc5ec9c1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89874ba3-07", "ovs_interfaceid": "89874ba3-0758-4c32-b1ec-6d0dd813fb71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-30ec75e5-902c-4e90-9847-eb29fbbc7d41 req-1c6252b5-d953-40c7-a7b1-666e2be0e6fb service nova] Acquired lock "refresh_cache-c29d7f9d-793f-4511-9203-06b653e52f72" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.network.neutron [req-30ec75e5-902c-4e90-9847-eb29fbbc7d41 req-1c6252b5-d953-40c7-a7b1-666e2be0e6fb service nova] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Refreshing network info cache for port 89874ba3-0758-4c32-b1ec-6d0dd813fb71 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Start _get_guest_xml network_info=[{"id": "89874ba3-0758-4c32-b1ec-6d0dd813fb71", "address": "fa:16:3e:a4:11:94", "network": {"id": "a97d8218-d78c-43aa-80b9-58e1cda130cf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-617867352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dc5cc86317d4c90bf119b8bc5ec9c1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89874ba3-07", "ovs_interfaceid": "89874ba3-0758-4c32-b1ec-6d0dd813fb71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.209s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:10:59 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:10:59 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:10:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk 1073741824" returned: 0 in 0.047s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.privsep.utils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73078) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-281327118',display_name='tempest-DeleteServersTestJSON-server-281327118',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-281327118',id=1,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8dc5cc86317d4c90bf119b8bc5ec9c1b',ramdisk_id='',reservation_id='r-2mp6oh69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1205702529',owner_user_name='tempest-DeleteServersTestJSON-1205702529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:10:48Z,user_data=None,user_id='8c08ad4734894a03a61c8f724e428dd4',uuid=c29d7f9d-793f-4511-9203-06b653e52f72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89874ba3-0758-4c32-b1ec-6d0dd813fb71", "address": "fa:16:3e:a4:11:94", "network": {"id": "a97d8218-d78c-43aa-80b9-58e1cda130cf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-617867352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dc5cc86317d4c90bf119b8bc5ec9c1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89874ba3-07", "ovs_interfaceid": "89874ba3-0758-4c32-b1ec-6d0dd813fb71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Converting VIF {"id": "89874ba3-0758-4c32-b1ec-6d0dd813fb71", "address": "fa:16:3e:a4:11:94", "network": {"id": "a97d8218-d78c-43aa-80b9-58e1cda130cf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-617867352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dc5cc86317d4c90bf119b8bc5ec9c1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89874ba3-07", "ovs_interfaceid": "89874ba3-0758-4c32-b1ec-6d0dd813fb71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:11:94,bridge_name='br-int',has_traffic_filtering=True,id=89874ba3-0758-4c32-b1ec-6d0dd813fb71,network=Network(a97d8218-d78c-43aa-80b9-58e1cda130cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89874ba3-07') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.objects.instance [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Lazy-loading 'pci_devices' on Instance uuid c29d7f9d-793f-4511-9203-06b653e52f72 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.network.neutron [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Updating instance_info_cache with network_info: [{"id": "2afe973c-46fa-4336-996f-b5dcd374c96e", "address": "fa:16:3e:5d:60:2f", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe973c-46", "ovs_interfaceid": "2afe973c-46fa-4336-996f-b5dcd374c96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:10:59 user nova-compute[73078]:   <uuid>c29d7f9d-793f-4511-9203-06b653e52f72</uuid>
Aug 14 18:10:59 user nova-compute[73078]:   <name>instance-00000001</name>
Aug 14 18:10:59 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:10:59 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:10:59 user nova-compute[73078]:   <metadata>
Aug 14 18:10:59 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:10:59 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:10:59 user nova-compute[73078]:       <nova:name>tempest-DeleteServersTestJSON-server-281327118</nova:name>
Aug 14 18:10:59 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:10:59</nova:creationTime>
Aug 14 18:10:59 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:10:59 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:10:59 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:10:59 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:10:59 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:10:59 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:10:59 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:10:59 user nova-compute[73078]:       <nova:owner>
Aug 14 18:10:59 user nova-compute[73078]:         <nova:user uuid="8c08ad4734894a03a61c8f724e428dd4">tempest-DeleteServersTestJSON-1205702529-project-member</nova:user>
Aug 14 18:10:59 user nova-compute[73078]:         <nova:project uuid="8dc5cc86317d4c90bf119b8bc5ec9c1b">tempest-DeleteServersTestJSON-1205702529</nova:project>
Aug 14 18:10:59 user nova-compute[73078]:       </nova:owner>
Aug 14 18:10:59 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:10:59 user nova-compute[73078]:       <nova:ports>
Aug 14 18:10:59 user nova-compute[73078]:         <nova:port uuid="89874ba3-0758-4c32-b1ec-6d0dd813fb71">
Aug 14 18:10:59 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 18:10:59 user nova-compute[73078]:         </nova:port>
Aug 14 18:10:59 user nova-compute[73078]:       </nova:ports>
Aug 14 18:10:59 user nova-compute[73078]:     </nova:instance>
Aug 14 18:10:59 user nova-compute[73078]:   </metadata>
Aug 14 18:10:59 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:10:59 user nova-compute[73078]:     <system>
Aug 14 18:10:59 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:10:59 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:10:59 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:10:59 user nova-compute[73078]:       <entry name="serial">c29d7f9d-793f-4511-9203-06b653e52f72</entry>
Aug 14 18:10:59 user nova-compute[73078]:       <entry name="uuid">c29d7f9d-793f-4511-9203-06b653e52f72</entry>
Aug 14 18:10:59 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:10:59 user nova-compute[73078]:     </system>
Aug 14 18:10:59 user nova-compute[73078]:   </sysinfo>
Aug 14 18:10:59 user nova-compute[73078]:   <os>
Aug 14 18:10:59 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:10:59 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:10:59 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:10:59 user nova-compute[73078]:   </os>
Aug 14 18:10:59 user nova-compute[73078]:   <features>
Aug 14 18:10:59 user nova-compute[73078]:     <acpi/>
Aug 14 18:10:59 user nova-compute[73078]:     <apic/>
Aug 14 18:10:59 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:10:59 user nova-compute[73078]:   </features>
Aug 14 18:10:59 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:10:59 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:10:59 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:10:59 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:10:59 user nova-compute[73078]:   </clock>
Aug 14 18:10:59 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:10:59 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:10:59 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:10:59 user nova-compute[73078]:   </cpu>
Aug 14 18:10:59 user nova-compute[73078]:   <devices>
Aug 14 18:10:59 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:10:59 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:10:59 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/c29d7f9d-793f-4511-9203-06b653e52f72/disk"/>
Aug 14 18:10:59 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:10:59 user nova-compute[73078]:     </disk>
Aug 14 18:10:59 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:10:59 user nova-compute[73078]:       <mac address="fa:16:3e:a4:11:94"/>
Aug 14 18:10:59 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:10:59 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:10:59 user nova-compute[73078]:       <target dev="tap89874ba3-07"/>
Aug 14 18:10:59 user nova-compute[73078]:     </interface>
Aug 14 18:10:59 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:10:59 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/c29d7f9d-793f-4511-9203-06b653e52f72/console.log" append="off"/>
Aug 14 18:10:59 user nova-compute[73078]:     </serial>
Aug 14 18:10:59 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:10:59 user nova-compute[73078]:     <video>
Aug 14 18:10:59 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:10:59 user nova-compute[73078]:     </video>
Aug 14 18:10:59 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:10:59 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:10:59 user nova-compute[73078]:     </rng>
Aug 14 18:10:59 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:10:59 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:10:59 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:10:59 user nova-compute[73078]:     </memballoon>
Aug 14 18:10:59 user nova-compute[73078]:   </devices>
Aug 14 18:10:59 user nova-compute[73078]: </domain>
Aug 14 18:10:59 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-281327118',display_name='tempest-DeleteServersTestJSON-server-281327118',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-281327118',id=1,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8dc5cc86317d4c90bf119b8bc5ec9c1b',ramdisk_id='',reservation_id='r-2mp6oh69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1205702529',owner_user_name='tempest-DeleteServersTestJSON-1205702529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:10:48Z,user_data=None,user_id='8c08ad4734894a03a61c8f724e428dd4',uuid=c29d7f9d-793f-4511-9203-06b653e52f72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89874ba3-0758-4c32-b1ec-6d0dd813fb71", "address": "fa:16:3e:a4:11:94", "network": {"id": "a97d8218-d78c-43aa-80b9-58e1cda130cf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-617867352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dc5cc86317d4c90bf119b8bc5ec9c1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89874ba3-07", "ovs_interfaceid": "89874ba3-0758-4c32-b1ec-6d0dd813fb71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Converting VIF {"id": "89874ba3-0758-4c32-b1ec-6d0dd813fb71", "address": "fa:16:3e:a4:11:94", "network": {"id": "a97d8218-d78c-43aa-80b9-58e1cda130cf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-617867352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dc5cc86317d4c90bf119b8bc5ec9c1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89874ba3-07", "ovs_interfaceid": "89874ba3-0758-4c32-b1ec-6d0dd813fb71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:11:94,bridge_name='br-int',has_traffic_filtering=True,id=89874ba3-0758-4c32-b1ec-6d0dd813fb71,network=Network(a97d8218-d78c-43aa-80b9-58e1cda130cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89874ba3-07') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG os_vif [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:11:94,bridge_name='br-int',has_traffic_filtering=True,id=89874ba3-0758-4c32-b1ec-6d0dd813fb71,network=Network(a97d8218-d78c-43aa-80b9-58e1cda130cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89874ba3-07') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Releasing lock "refresh_cache-de80e188-9385-4613-8a6c-aa72b624ad55" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.compute.manager [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Instance network_info: |[{"id": "2afe973c-46fa-4336-996f-b5dcd374c96e", "address": "fa:16:3e:5d:60:2f", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe973c-46", "ovs_interfaceid": "2afe973c-46fa-4336-996f-b5dcd374c96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b78a00ee-8146-4230-a1d1-5197d36e202c req-ef574ac9-7897-466d-9726-4aff1a24fff4 service nova] Acquired lock "refresh_cache-de80e188-9385-4613-8a6c-aa72b624ad55" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.network.neutron [req-b78a00ee-8146-4230-a1d1-5197d36e202c req-ef574ac9-7897-466d-9726-4aff1a24fff4 service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Refreshing network info cache for port 2afe973c-46fa-4336-996f-b5dcd374c96e {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Start _get_guest_xml network_info=[{"id": "2afe973c-46fa-4336-996f-b5dcd374c96e", "address": "fa:16:3e:5d:60:2f", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe973c-46", "ovs_interfaceid": "2afe973c-46fa-4336-996f-b5dcd374c96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Created schema index Interface.name {{(pid=73078) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Created schema index Port.name {{(pid=73078) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Created schema index Bridge.name {{(pid=73078) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.294s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "8d257202-d8ab-4161-9b67-045cf1e36772" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "8d257202-d8ab-4161-9b67-045cf1e36772" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Checking if we can resize image /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [POLLOUT] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG nova.compute.manager [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:10:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:10:59 user nova-compute[73078]: INFO oslo.privsep.daemon [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp0s7cs5vj/privsep.sock']
Aug 14 18:11:00 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:11:00 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:11:00 user sudo[82459]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp0s7cs5vj/privsep.sock
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:11:00 user sudo[82459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:10:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2143110433',display_name='tempest-ServerRescueNegativeTestJSON-server-2143110433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2143110433',id=2,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ec53c6018ee44b09ee31ba712a789aa',ramdisk_id='',reservation_id='r-omwxdblo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-38557121',owner_user_name='tempest-ServerRescueNegativeTestJSON-38557121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:10:51Z,user_data=None,user_id='d25ecea70e9e481e8a1957a94d79edfc',uuid=de80e188-9385-4613-8a6c-aa72b624ad55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2afe973c-46fa-4336-996f-b5dcd374c96e", "address": "fa:16:3e:5d:60:2f", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe973c-46", "ovs_interfaceid": "2afe973c-46fa-4336-996f-b5dcd374c96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Converting VIF {"id": "2afe973c-46fa-4336-996f-b5dcd374c96e", "address": "fa:16:3e:5d:60:2f", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe973c-46", "ovs_interfaceid": "2afe973c-46fa-4336-996f-b5dcd374c96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:60:2f,bridge_name='br-int',has_traffic_filtering=True,id=2afe973c-46fa-4336-996f-b5dcd374c96e,network=Network(33518dc6-7963-4995-b4c7-86d60b44a22f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afe973c-46') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.objects.instance [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lazy-loading 'pci_devices' on Instance uuid de80e188-9385-4613-8a6c-aa72b624ad55 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Cannot resize image /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.objects.instance [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lazy-loading 'migration_context' on Instance uuid 24c00db3-2457-443d-b5ab-7e6ecaa57515 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:11:00 user nova-compute[73078]: INFO nova.compute.claims [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Claim successful on node user
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:11:00 user nova-compute[73078]:   <uuid>de80e188-9385-4613-8a6c-aa72b624ad55</uuid>
Aug 14 18:11:00 user nova-compute[73078]:   <name>instance-00000002</name>
Aug 14 18:11:00 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:11:00 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:11:00 user nova-compute[73078]:   <metadata>
Aug 14 18:11:00 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:11:00 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:11:00 user nova-compute[73078]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2143110433</nova:name>
Aug 14 18:11:00 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:11:00</nova:creationTime>
Aug 14 18:11:00 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:11:00 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:11:00 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:11:00 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:11:00 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:11:00 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:11:00 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:11:00 user nova-compute[73078]:       <nova:owner>
Aug 14 18:11:00 user nova-compute[73078]:         <nova:user uuid="d25ecea70e9e481e8a1957a94d79edfc">tempest-ServerRescueNegativeTestJSON-38557121-project-member</nova:user>
Aug 14 18:11:00 user nova-compute[73078]:         <nova:project uuid="4ec53c6018ee44b09ee31ba712a789aa">tempest-ServerRescueNegativeTestJSON-38557121</nova:project>
Aug 14 18:11:00 user nova-compute[73078]:       </nova:owner>
Aug 14 18:11:00 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:11:00 user nova-compute[73078]:       <nova:ports>
Aug 14 18:11:00 user nova-compute[73078]:         <nova:port uuid="2afe973c-46fa-4336-996f-b5dcd374c96e">
Aug 14 18:11:00 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 18:11:00 user nova-compute[73078]:         </nova:port>
Aug 14 18:11:00 user nova-compute[73078]:       </nova:ports>
Aug 14 18:11:00 user nova-compute[73078]:     </nova:instance>
Aug 14 18:11:00 user nova-compute[73078]:   </metadata>
Aug 14 18:11:00 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:11:00 user nova-compute[73078]:     <system>
Aug 14 18:11:00 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:11:00 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:11:00 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:11:00 user nova-compute[73078]:       <entry name="serial">de80e188-9385-4613-8a6c-aa72b624ad55</entry>
Aug 14 18:11:00 user nova-compute[73078]:       <entry name="uuid">de80e188-9385-4613-8a6c-aa72b624ad55</entry>
Aug 14 18:11:00 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:11:00 user nova-compute[73078]:     </system>
Aug 14 18:11:00 user nova-compute[73078]:   </sysinfo>
Aug 14 18:11:00 user nova-compute[73078]:   <os>
Aug 14 18:11:00 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:11:00 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:11:00 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:11:00 user nova-compute[73078]:   </os>
Aug 14 18:11:00 user nova-compute[73078]:   <features>
Aug 14 18:11:00 user nova-compute[73078]:     <acpi/>
Aug 14 18:11:00 user nova-compute[73078]:     <apic/>
Aug 14 18:11:00 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:11:00 user nova-compute[73078]:   </features>
Aug 14 18:11:00 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:11:00 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:11:00 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:11:00 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:11:00 user nova-compute[73078]:   </clock>
Aug 14 18:11:00 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:11:00 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:11:00 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:11:00 user nova-compute[73078]:   </cpu>
Aug 14 18:11:00 user nova-compute[73078]:   <devices>
Aug 14 18:11:00 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:11:00 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:11:00 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk"/>
Aug 14 18:11:00 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:11:00 user nova-compute[73078]:     </disk>
Aug 14 18:11:00 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:11:00 user nova-compute[73078]:       <mac address="fa:16:3e:5d:60:2f"/>
Aug 14 18:11:00 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:11:00 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:11:00 user nova-compute[73078]:       <target dev="tap2afe973c-46"/>
Aug 14 18:11:00 user nova-compute[73078]:     </interface>
Aug 14 18:11:00 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:11:00 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/console.log" append="off"/>
Aug 14 18:11:00 user nova-compute[73078]:     </serial>
Aug 14 18:11:00 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:11:00 user nova-compute[73078]:     <video>
Aug 14 18:11:00 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:11:00 user nova-compute[73078]:     </video>
Aug 14 18:11:00 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:11:00 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:11:00 user nova-compute[73078]:     </rng>
Aug 14 18:11:00 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:11:00 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:11:00 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:11:00 user nova-compute[73078]:     </memballoon>
Aug 14 18:11:00 user nova-compute[73078]:   </devices>
Aug 14 18:11:00 user nova-compute[73078]: </domain>
Aug 14 18:11:00 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:10:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2143110433',display_name='tempest-ServerRescueNegativeTestJSON-server-2143110433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2143110433',id=2,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ec53c6018ee44b09ee31ba712a789aa',ramdisk_id='',reservation_id='r-omwxdblo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-38557121',owner_user_name='tempest-ServerRescueNegativeTestJSON-38557121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:10:51Z,user_data=None,user_id='d25ecea70e9e481e8a1957a94d79edfc',uuid=de80e188-9385-4613-8a6c-aa72b624ad55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2afe973c-46fa-4336-996f-b5dcd374c96e", "address": "fa:16:3e:5d:60:2f", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe973c-46", "ovs_interfaceid": "2afe973c-46fa-4336-996f-b5dcd374c96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Converting VIF {"id": "2afe973c-46fa-4336-996f-b5dcd374c96e", "address": "fa:16:3e:5d:60:2f", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe973c-46", "ovs_interfaceid": "2afe973c-46fa-4336-996f-b5dcd374c96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:60:2f,bridge_name='br-int',has_traffic_filtering=True,id=2afe973c-46fa-4336-996f-b5dcd374c96e,network=Network(33518dc6-7963-4995-b4c7-86d60b44a22f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afe973c-46') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG os_vif [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:60:2f,bridge_name='br-int',has_traffic_filtering=True,id=2afe973c-46fa-4336-996f-b5dcd374c96e,network=Network(33518dc6-7963-4995-b4c7-86d60b44a22f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afe973c-46') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Ensure instance console log exists: /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.344s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.compute.manager [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.compute.manager [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.network.neutron [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:11:00 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.compute.manager [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.compute.manager [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:11:00 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Creating image(s)
Aug 14 18:11:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "/opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "/opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.policy [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b07aecccb704835b6b765325b1d18bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f00de2496804d6eb570f93307f3f088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG nova.network.neutron [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Successfully created port: 99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.241s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.206s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/disk 1073741824" returned: 0 in 0.048s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.163s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:01 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:11:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:01 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Cannot resize image /opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:11:01 user nova-compute[73078]: DEBUG nova.objects.instance [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lazy-loading 'migration_context' on Instance uuid 8d257202-d8ab-4161-9b67-045cf1e36772 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:11:01 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:11:01 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Ensure instance console log exists: /opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:11:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:01 user sudo[82459]: pam_unix(sudo:session): session closed for user root
Aug 14 18:11:01 user nova-compute[73078]: INFO oslo.privsep.daemon [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Spawned new privsep daemon via rootwrap
Aug 14 18:11:01 user nova-compute[73078]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 14 18:11:01 user nova-compute[73078]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 14 18:11:01 user nova-compute[73078]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 14 18:11:01 user nova-compute[73078]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82479
Aug 14 18:11:01 user nova-compute[73078]: WARNING oslo_privsep.priv_context [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] privsep daemon already running
Aug 14 18:11:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:02 user nova-compute[73078]: DEBUG nova.network.neutron [req-b78a00ee-8146-4230-a1d1-5197d36e202c req-ef574ac9-7897-466d-9726-4aff1a24fff4 service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Updated VIF entry in instance network info cache for port 2afe973c-46fa-4336-996f-b5dcd374c96e. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:11:02 user nova-compute[73078]: DEBUG nova.network.neutron [req-b78a00ee-8146-4230-a1d1-5197d36e202c req-ef574ac9-7897-466d-9726-4aff1a24fff4 service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Updating instance_info_cache with network_info: [{"id": "2afe973c-46fa-4336-996f-b5dcd374c96e", "address": "fa:16:3e:5d:60:2f", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe973c-46", "ovs_interfaceid": "2afe973c-46fa-4336-996f-b5dcd374c96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:11:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b78a00ee-8146-4230-a1d1-5197d36e202c req-ef574ac9-7897-466d-9726-4aff1a24fff4 service nova] Releasing lock "refresh_cache-de80e188-9385-4613-8a6c-aa72b624ad55" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:11:02 user nova-compute[73078]: DEBUG nova.network.neutron [req-30ec75e5-902c-4e90-9847-eb29fbbc7d41 req-1c6252b5-d953-40c7-a7b1-666e2be0e6fb service nova] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Updated VIF entry in instance network info cache for port 89874ba3-0758-4c32-b1ec-6d0dd813fb71. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:11:02 user nova-compute[73078]: DEBUG nova.network.neutron [req-30ec75e5-902c-4e90-9847-eb29fbbc7d41 req-1c6252b5-d953-40c7-a7b1-666e2be0e6fb service nova] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Updating instance_info_cache with network_info: [{"id": "89874ba3-0758-4c32-b1ec-6d0dd813fb71", "address": "fa:16:3e:a4:11:94", "network": {"id": "a97d8218-d78c-43aa-80b9-58e1cda130cf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-617867352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dc5cc86317d4c90bf119b8bc5ec9c1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89874ba3-07", "ovs_interfaceid": "89874ba3-0758-4c32-b1ec-6d0dd813fb71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:11:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89874ba3-07, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:11:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap89874ba3-07, col_values=(('external_ids', {'iface-id': '89874ba3-0758-4c32-b1ec-6d0dd813fb71', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:11:94', 'vm-uuid': 'c29d7f9d-793f-4511-9203-06b653e52f72'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:11:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:11:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:02 user nova-compute[73078]: INFO os_vif [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:11:94,bridge_name='br-int',has_traffic_filtering=True,id=89874ba3-0758-4c32-b1ec-6d0dd813fb71,network=Network(a97d8218-d78c-43aa-80b9-58e1cda130cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89874ba3-07')
Aug 14 18:11:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2afe973c-46, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:11:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2afe973c-46, col_values=(('external_ids', {'iface-id': '2afe973c-46fa-4336-996f-b5dcd374c96e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:60:2f', 'vm-uuid': 'de80e188-9385-4613-8a6c-aa72b624ad55'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:11:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-30ec75e5-902c-4e90-9847-eb29fbbc7d41 req-1c6252b5-d953-40c7-a7b1-666e2be0e6fb service nova] Releasing lock "refresh_cache-c29d7f9d-793f-4511-9203-06b653e52f72" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:11:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:11:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:02 user nova-compute[73078]: INFO os_vif [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:60:2f,bridge_name='br-int',has_traffic_filtering=True,id=2afe973c-46fa-4336-996f-b5dcd374c96e,network=Network(33518dc6-7963-4995-b4c7-86d60b44a22f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afe973c-46')
Aug 14 18:11:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:11:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] No VIF found with MAC fa:16:3e:a4:11:94, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:11:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:11:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] No VIF found with MAC fa:16:3e:5d:60:2f, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:11:02 user nova-compute[73078]: DEBUG nova.network.neutron [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Successfully created port: 10688f4a-5919-4a48-9767-92e304a494be {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:11:03 user nova-compute[73078]: DEBUG nova.network.neutron [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Successfully updated port: 99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:11:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Acquiring lock "refresh_cache-24c00db3-2457-443d-b5ab-7e6ecaa57515" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:11:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Acquired lock "refresh_cache-24c00db3-2457-443d-b5ab-7e6ecaa57515" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:11:03 user nova-compute[73078]: DEBUG nova.network.neutron [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:11:03 user nova-compute[73078]: DEBUG nova.network.neutron [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:11:03 user nova-compute[73078]: DEBUG nova.compute.manager [req-28fca1ac-89f0-4612-84d4-4a487531defb req-02a93805-1ebd-41e2-9763-4497eeb615e1 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Received event network-changed-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:11:03 user nova-compute[73078]: DEBUG nova.compute.manager [req-28fca1ac-89f0-4612-84d4-4a487531defb req-02a93805-1ebd-41e2-9763-4497eeb615e1 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Refreshing instance network info cache due to event network-changed-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:11:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-28fca1ac-89f0-4612-84d4-4a487531defb req-02a93805-1ebd-41e2-9763-4497eeb615e1 service nova] Acquiring lock "refresh_cache-24c00db3-2457-443d-b5ab-7e6ecaa57515" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:11:04 user nova-compute[73078]: DEBUG nova.network.neutron [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Successfully updated port: 8df77a26-faab-47ca-a39b-3df6930cd1d5 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:11:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "refresh_cache-1f88cb97-4f22-439e-99f2-d7cb8d5aff36" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:11:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquired lock "refresh_cache-1f88cb97-4f22-439e-99f2-d7cb8d5aff36" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:11:04 user nova-compute[73078]: DEBUG nova.network.neutron [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:11:04 user nova-compute[73078]: DEBUG nova.compute.manager [req-2ae80de5-43fd-4a83-b3f0-d8bcdc63a75a req-6c2bf7e9-ecef-442e-b810-685d06a36bca service nova] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Received event network-changed-8df77a26-faab-47ca-a39b-3df6930cd1d5 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:11:04 user nova-compute[73078]: DEBUG nova.compute.manager [req-2ae80de5-43fd-4a83-b3f0-d8bcdc63a75a req-6c2bf7e9-ecef-442e-b810-685d06a36bca service nova] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Refreshing instance network info cache due to event network-changed-8df77a26-faab-47ca-a39b-3df6930cd1d5. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:11:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-2ae80de5-43fd-4a83-b3f0-d8bcdc63a75a req-6c2bf7e9-ecef-442e-b810-685d06a36bca service nova] Acquiring lock "refresh_cache-1f88cb97-4f22-439e-99f2-d7cb8d5aff36" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:11:04 user nova-compute[73078]: DEBUG nova.network.neutron [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:11:04 user nova-compute[73078]: DEBUG nova.network.neutron [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Successfully updated port: 03e9ece7-7612-4a4f-86ab-d85b0c97d723 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:11:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "refresh_cache-3c840309-9884-4c8a-a6ee-1acd44f32c4c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:11:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquired lock "refresh_cache-3c840309-9884-4c8a-a6ee-1acd44f32c4c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:11:04 user nova-compute[73078]: DEBUG nova.network.neutron [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:11:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG nova.network.neutron [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG nova.network.neutron [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Updating instance_info_cache with network_info: [{"id": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "address": "fa:16:3e:ce:cd:93", "network": {"id": "1ec1577a-2943-44e6-9fd6-9d8308fcf09f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-135315381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09794ca2aebc4f50a4ab26cecefb4d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d8f3d6-2e", "ovs_interfaceid": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Releasing lock "refresh_cache-24c00db3-2457-443d-b5ab-7e6ecaa57515" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG nova.compute.manager [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Instance network_info: |[{"id": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "address": "fa:16:3e:ce:cd:93", "network": {"id": "1ec1577a-2943-44e6-9fd6-9d8308fcf09f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-135315381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09794ca2aebc4f50a4ab26cecefb4d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d8f3d6-2e", "ovs_interfaceid": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-28fca1ac-89f0-4612-84d4-4a487531defb req-02a93805-1ebd-41e2-9763-4497eeb615e1 service nova] Acquired lock "refresh_cache-24c00db3-2457-443d-b5ab-7e6ecaa57515" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG nova.network.neutron [req-28fca1ac-89f0-4612-84d4-4a487531defb req-02a93805-1ebd-41e2-9763-4497eeb615e1 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Refreshing network info cache for port 99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Start _get_guest_xml network_info=[{"id": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "address": "fa:16:3e:ce:cd:93", "network": {"id": "1ec1577a-2943-44e6-9fd6-9d8308fcf09f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-135315381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09794ca2aebc4f50a4ab26cecefb4d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d8f3d6-2e", "ovs_interfaceid": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:11:05 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:11:05 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:11:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-800184995',display_name='tempest-ServerActionsTestOtherB-server-800184995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-800184995',id=5,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbnc7U7feBP7majde5yxGnuBaGos4MxLqvnB0BjKphlc0UqHWP3CzhimKim+Kv31+0a1u5JyxtEQSRk/yFbj17pMkgZ6K1nerehXIw6QXdILWEOhFCV63jMfH8QM13ghA==',key_name='tempest-keypair-2079056104',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09794ca2aebc4f50a4ab26cecefb4d0c',ramdisk_id='',reservation_id='r-ikq8fsl0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-727924132',owner_user_name='tempest-ServerActionsTestOtherB-727924132-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ad487c5160a4dd8b9a03d468edf4bef',uuid=24c00db3-2457-443d-b5ab-7e6ecaa57515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "address": "fa:16:3e:ce:cd:93", "network": {"id": "1ec1577a-2943-44e6-9fd6-9d8308fcf09f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-135315381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09794ca2aebc4f50a4ab26cecefb4d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d8f3d6-2e", "ovs_interfaceid": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Converting VIF {"id": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "address": "fa:16:3e:ce:cd:93", "network": {"id": "1ec1577a-2943-44e6-9fd6-9d8308fcf09f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-135315381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09794ca2aebc4f50a4ab26cecefb4d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d8f3d6-2e", "ovs_interfaceid": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:cd:93,bridge_name='br-int',has_traffic_filtering=True,id=99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563,network=Network(1ec1577a-2943-44e6-9fd6-9d8308fcf09f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d8f3d6-2e') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG nova.objects.instance [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lazy-loading 'pci_devices' on Instance uuid 24c00db3-2457-443d-b5ab-7e6ecaa57515 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:11:05 user nova-compute[73078]:   <uuid>24c00db3-2457-443d-b5ab-7e6ecaa57515</uuid>
Aug 14 18:11:05 user nova-compute[73078]:   <name>instance-00000005</name>
Aug 14 18:11:05 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:11:05 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:11:05 user nova-compute[73078]:   <metadata>
Aug 14 18:11:05 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:11:05 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:11:05 user nova-compute[73078]:       <nova:name>tempest-ServerActionsTestOtherB-server-800184995</nova:name>
Aug 14 18:11:05 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:11:05</nova:creationTime>
Aug 14 18:11:05 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:11:05 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:11:05 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:11:05 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:11:05 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:11:05 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:11:05 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:11:05 user nova-compute[73078]:       <nova:owner>
Aug 14 18:11:05 user nova-compute[73078]:         <nova:user uuid="0ad487c5160a4dd8b9a03d468edf4bef">tempest-ServerActionsTestOtherB-727924132-project-member</nova:user>
Aug 14 18:11:05 user nova-compute[73078]:         <nova:project uuid="09794ca2aebc4f50a4ab26cecefb4d0c">tempest-ServerActionsTestOtherB-727924132</nova:project>
Aug 14 18:11:05 user nova-compute[73078]:       </nova:owner>
Aug 14 18:11:05 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:11:05 user nova-compute[73078]:       <nova:ports>
Aug 14 18:11:05 user nova-compute[73078]:         <nova:port uuid="99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563">
Aug 14 18:11:05 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 14 18:11:05 user nova-compute[73078]:         </nova:port>
Aug 14 18:11:05 user nova-compute[73078]:       </nova:ports>
Aug 14 18:11:05 user nova-compute[73078]:     </nova:instance>
Aug 14 18:11:05 user nova-compute[73078]:   </metadata>
Aug 14 18:11:05 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:11:05 user nova-compute[73078]:     <system>
Aug 14 18:11:05 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:11:05 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:11:05 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:11:05 user nova-compute[73078]:       <entry name="serial">24c00db3-2457-443d-b5ab-7e6ecaa57515</entry>
Aug 14 18:11:05 user nova-compute[73078]:       <entry name="uuid">24c00db3-2457-443d-b5ab-7e6ecaa57515</entry>
Aug 14 18:11:05 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:11:05 user nova-compute[73078]:     </system>
Aug 14 18:11:05 user nova-compute[73078]:   </sysinfo>
Aug 14 18:11:05 user nova-compute[73078]:   <os>
Aug 14 18:11:05 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:11:05 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:11:05 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:11:05 user nova-compute[73078]:   </os>
Aug 14 18:11:05 user nova-compute[73078]:   <features>
Aug 14 18:11:05 user nova-compute[73078]:     <acpi/>
Aug 14 18:11:05 user nova-compute[73078]:     <apic/>
Aug 14 18:11:05 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:11:05 user nova-compute[73078]:   </features>
Aug 14 18:11:05 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:11:05 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:11:05 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:11:05 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:11:05 user nova-compute[73078]:   </clock>
Aug 14 18:11:05 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:11:05 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:11:05 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:11:05 user nova-compute[73078]:   </cpu>
Aug 14 18:11:05 user nova-compute[73078]:   <devices>
Aug 14 18:11:05 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:11:05 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:11:05 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk"/>
Aug 14 18:11:05 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:11:05 user nova-compute[73078]:     </disk>
Aug 14 18:11:05 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:11:05 user nova-compute[73078]:       <mac address="fa:16:3e:ce:cd:93"/>
Aug 14 18:11:05 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:11:05 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:11:05 user nova-compute[73078]:       <target dev="tap99d8f3d6-2e"/>
Aug 14 18:11:05 user nova-compute[73078]:     </interface>
Aug 14 18:11:05 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:11:05 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/console.log" append="off"/>
Aug 14 18:11:05 user nova-compute[73078]:     </serial>
Aug 14 18:11:05 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:11:05 user nova-compute[73078]:     <video>
Aug 14 18:11:05 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:11:05 user nova-compute[73078]:     </video>
Aug 14 18:11:05 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:11:05 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:11:05 user nova-compute[73078]:     </rng>
Aug 14 18:11:05 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:11:05 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:11:05 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:11:05 user nova-compute[73078]:     </memballoon>
Aug 14 18:11:05 user nova-compute[73078]:   </devices>
Aug 14 18:11:05 user nova-compute[73078]: </domain>
Aug 14 18:11:05 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-800184995',display_name='tempest-ServerActionsTestOtherB-server-800184995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-800184995',id=5,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbnc7U7feBP7majde5yxGnuBaGos4MxLqvnB0BjKphlc0UqHWP3CzhimKim+Kv31+0a1u5JyxtEQSRk/yFbj17pMkgZ6K1nerehXIw6QXdILWEOhFCV63jMfH8QM13ghA==',key_name='tempest-keypair-2079056104',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09794ca2aebc4f50a4ab26cecefb4d0c',ramdisk_id='',reservation_id='r-ikq8fsl0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-727924132',owner_user_name='tempest-ServerActionsTestOtherB-727924132-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ad487c5160a4dd8b9a03d468edf4bef',uuid=24c00db3-2457-443d-b5ab-7e6ecaa57515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "address": "fa:16:3e:ce:cd:93", "network": {"id": "1ec1577a-2943-44e6-9fd6-9d8308fcf09f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-135315381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09794ca2aebc4f50a4ab26cecefb4d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d8f3d6-2e", "ovs_interfaceid": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Converting VIF {"id": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "address": "fa:16:3e:ce:cd:93", "network": {"id": "1ec1577a-2943-44e6-9fd6-9d8308fcf09f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-135315381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09794ca2aebc4f50a4ab26cecefb4d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d8f3d6-2e", "ovs_interfaceid": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:cd:93,bridge_name='br-int',has_traffic_filtering=True,id=99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563,network=Network(1ec1577a-2943-44e6-9fd6-9d8308fcf09f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d8f3d6-2e') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG os_vif [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:cd:93,bridge_name='br-int',has_traffic_filtering=True,id=99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563,network=Network(1ec1577a-2943-44e6-9fd6-9d8308fcf09f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d8f3d6-2e') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99d8f3d6-2e, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap99d8f3d6-2e, col_values=(('external_ids', {'iface-id': '99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:cd:93', 'vm-uuid': '24c00db3-2457-443d-b5ab-7e6ecaa57515'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:05 user nova-compute[73078]: INFO os_vif [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:cd:93,bridge_name='br-int',has_traffic_filtering=True,id=99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563,network=Network(1ec1577a-2943-44e6-9fd6-9d8308fcf09f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d8f3d6-2e')
Aug 14 18:11:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:11:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] No VIF found with MAC fa:16:3e:ce:cd:93, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG nova.compute.manager [req-846c7f21-3cd8-4ad7-ba10-35407c43cd01 req-e6a39be3-7df0-4767-92f7-d912c4f5afef service nova] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Received event network-changed-03e9ece7-7612-4a4f-86ab-d85b0c97d723 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG nova.compute.manager [req-846c7f21-3cd8-4ad7-ba10-35407c43cd01 req-e6a39be3-7df0-4767-92f7-d912c4f5afef service nova] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Refreshing instance network info cache due to event network-changed-03e9ece7-7612-4a4f-86ab-d85b0c97d723. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-846c7f21-3cd8-4ad7-ba10-35407c43cd01 req-e6a39be3-7df0-4767-92f7-d912c4f5afef service nova] Acquiring lock "refresh_cache-3c840309-9884-4c8a-a6ee-1acd44f32c4c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG nova.network.neutron [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Updating instance_info_cache with network_info: [{"id": "8df77a26-faab-47ca-a39b-3df6930cd1d5", "address": "fa:16:3e:2d:25:52", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df77a26-fa", "ovs_interfaceid": "8df77a26-faab-47ca-a39b-3df6930cd1d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Releasing lock "refresh_cache-1f88cb97-4f22-439e-99f2-d7cb8d5aff36" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG nova.compute.manager [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Instance network_info: |[{"id": "8df77a26-faab-47ca-a39b-3df6930cd1d5", "address": "fa:16:3e:2d:25:52", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df77a26-fa", "ovs_interfaceid": "8df77a26-faab-47ca-a39b-3df6930cd1d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-2ae80de5-43fd-4a83-b3f0-d8bcdc63a75a req-6c2bf7e9-ecef-442e-b810-685d06a36bca service nova] Acquired lock "refresh_cache-1f88cb97-4f22-439e-99f2-d7cb8d5aff36" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG nova.network.neutron [req-2ae80de5-43fd-4a83-b3f0-d8bcdc63a75a req-6c2bf7e9-ecef-442e-b810-685d06a36bca service nova] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Refreshing network info cache for port 8df77a26-faab-47ca-a39b-3df6930cd1d5 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Start _get_guest_xml network_info=[{"id": "8df77a26-faab-47ca-a39b-3df6930cd1d5", "address": "fa:16:3e:2d:25:52", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df77a26-fa", "ovs_interfaceid": "8df77a26-faab-47ca-a39b-3df6930cd1d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:11:06 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:11:06 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:11:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:10:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1024624425',display_name='tempest-ServerActionsTestOtherA-server-1024624425',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1024624425',id=3,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuBLKmid5aFtC8N9oGYPXkgiYGtDjSt/w1+99DQRyNH3SIh+uGteRP9ufywJ7TgR1607B3dJ2h6LnLGhohKOdL1yNPsWQsmTBErDFfyfHJa2VycZ+ceyQwLi9NhHpa6xg==',key_name='tempest-keypair-1366091689',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='993dd55f40454640824687ffb6a3c581',ramdisk_id='',reservation_id='r-a57kop58',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1876890021',owner_user_name='tempest-ServerActionsTestOtherA-1876890021-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:10:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cca1112ab354f9fb31658e18c0d03b1',uuid=1f88cb97-4f22-439e-99f2-d7cb8d5aff36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8df77a26-faab-47ca-a39b-3df6930cd1d5", "address": "fa:16:3e:2d:25:52", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df77a26-fa", "ovs_interfaceid": "8df77a26-faab-47ca-a39b-3df6930cd1d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Converting VIF {"id": "8df77a26-faab-47ca-a39b-3df6930cd1d5", "address": "fa:16:3e:2d:25:52", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df77a26-fa", "ovs_interfaceid": "8df77a26-faab-47ca-a39b-3df6930cd1d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:25:52,bridge_name='br-int',has_traffic_filtering=True,id=8df77a26-faab-47ca-a39b-3df6930cd1d5,network=Network(bfef9745-5a40-44b6-a6d5-2ef1e77fc5db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8df77a26-fa') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG nova.objects.instance [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f88cb97-4f22-439e-99f2-d7cb8d5aff36 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:11:06 user nova-compute[73078]:   <uuid>1f88cb97-4f22-439e-99f2-d7cb8d5aff36</uuid>
Aug 14 18:11:06 user nova-compute[73078]:   <name>instance-00000003</name>
Aug 14 18:11:06 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:11:06 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:11:06 user nova-compute[73078]:   <metadata>
Aug 14 18:11:06 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:11:06 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:11:06 user nova-compute[73078]:       <nova:name>tempest-ServerActionsTestOtherA-server-1024624425</nova:name>
Aug 14 18:11:06 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:11:06</nova:creationTime>
Aug 14 18:11:06 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:11:06 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:11:06 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:11:06 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:11:06 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:11:06 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:11:06 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:11:06 user nova-compute[73078]:       <nova:owner>
Aug 14 18:11:06 user nova-compute[73078]:         <nova:user uuid="0cca1112ab354f9fb31658e18c0d03b1">tempest-ServerActionsTestOtherA-1876890021-project-member</nova:user>
Aug 14 18:11:06 user nova-compute[73078]:         <nova:project uuid="993dd55f40454640824687ffb6a3c581">tempest-ServerActionsTestOtherA-1876890021</nova:project>
Aug 14 18:11:06 user nova-compute[73078]:       </nova:owner>
Aug 14 18:11:06 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:11:06 user nova-compute[73078]:       <nova:ports>
Aug 14 18:11:06 user nova-compute[73078]:         <nova:port uuid="8df77a26-faab-47ca-a39b-3df6930cd1d5">
Aug 14 18:11:06 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 18:11:06 user nova-compute[73078]:         </nova:port>
Aug 14 18:11:06 user nova-compute[73078]:       </nova:ports>
Aug 14 18:11:06 user nova-compute[73078]:     </nova:instance>
Aug 14 18:11:06 user nova-compute[73078]:   </metadata>
Aug 14 18:11:06 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:11:06 user nova-compute[73078]:     <system>
Aug 14 18:11:06 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:11:06 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:11:06 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:11:06 user nova-compute[73078]:       <entry name="serial">1f88cb97-4f22-439e-99f2-d7cb8d5aff36</entry>
Aug 14 18:11:06 user nova-compute[73078]:       <entry name="uuid">1f88cb97-4f22-439e-99f2-d7cb8d5aff36</entry>
Aug 14 18:11:06 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:11:06 user nova-compute[73078]:     </system>
Aug 14 18:11:06 user nova-compute[73078]:   </sysinfo>
Aug 14 18:11:06 user nova-compute[73078]:   <os>
Aug 14 18:11:06 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:11:06 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:11:06 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:11:06 user nova-compute[73078]:   </os>
Aug 14 18:11:06 user nova-compute[73078]:   <features>
Aug 14 18:11:06 user nova-compute[73078]:     <acpi/>
Aug 14 18:11:06 user nova-compute[73078]:     <apic/>
Aug 14 18:11:06 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:11:06 user nova-compute[73078]:   </features>
Aug 14 18:11:06 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:11:06 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:11:06 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:11:06 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:11:06 user nova-compute[73078]:   </clock>
Aug 14 18:11:06 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:11:06 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:11:06 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:11:06 user nova-compute[73078]:   </cpu>
Aug 14 18:11:06 user nova-compute[73078]:   <devices>
Aug 14 18:11:06 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:11:06 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:11:06 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk"/>
Aug 14 18:11:06 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:11:06 user nova-compute[73078]:     </disk>
Aug 14 18:11:06 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:11:06 user nova-compute[73078]:       <mac address="fa:16:3e:2d:25:52"/>
Aug 14 18:11:06 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:11:06 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:11:06 user nova-compute[73078]:       <target dev="tap8df77a26-fa"/>
Aug 14 18:11:06 user nova-compute[73078]:     </interface>
Aug 14 18:11:06 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:11:06 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/console.log" append="off"/>
Aug 14 18:11:06 user nova-compute[73078]:     </serial>
Aug 14 18:11:06 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:11:06 user nova-compute[73078]:     <video>
Aug 14 18:11:06 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:11:06 user nova-compute[73078]:     </video>
Aug 14 18:11:06 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:11:06 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:11:06 user nova-compute[73078]:     </rng>
Aug 14 18:11:06 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:11:06 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:11:06 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:11:06 user nova-compute[73078]:     </memballoon>
Aug 14 18:11:06 user nova-compute[73078]:   </devices>
Aug 14 18:11:06 user nova-compute[73078]: </domain>
Aug 14 18:11:06 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:10:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1024624425',display_name='tempest-ServerActionsTestOtherA-server-1024624425',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1024624425',id=3,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuBLKmid5aFtC8N9oGYPXkgiYGtDjSt/w1+99DQRyNH3SIh+uGteRP9ufywJ7TgR1607B3dJ2h6LnLGhohKOdL1yNPsWQsmTBErDFfyfHJa2VycZ+ceyQwLi9NhHpa6xg==',key_name='tempest-keypair-1366091689',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='993dd55f40454640824687ffb6a3c581',ramdisk_id='',reservation_id='r-a57kop58',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1876890021',owner_user_name='tempest-ServerActionsTestOtherA-1876890021-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:10:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cca1112ab354f9fb31658e18c0d03b1',uuid=1f88cb97-4f22-439e-99f2-d7cb8d5aff36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8df77a26-faab-47ca-a39b-3df6930cd1d5", "address": "fa:16:3e:2d:25:52", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df77a26-fa", "ovs_interfaceid": "8df77a26-faab-47ca-a39b-3df6930cd1d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Converting VIF {"id": "8df77a26-faab-47ca-a39b-3df6930cd1d5", "address": "fa:16:3e:2d:25:52", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df77a26-fa", "ovs_interfaceid": "8df77a26-faab-47ca-a39b-3df6930cd1d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:25:52,bridge_name='br-int',has_traffic_filtering=True,id=8df77a26-faab-47ca-a39b-3df6930cd1d5,network=Network(bfef9745-5a40-44b6-a6d5-2ef1e77fc5db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8df77a26-fa') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG os_vif [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:25:52,bridge_name='br-int',has_traffic_filtering=True,id=8df77a26-faab-47ca-a39b-3df6930cd1d5,network=Network(bfef9745-5a40-44b6-a6d5-2ef1e77fc5db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8df77a26-fa') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8df77a26-fa, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8df77a26-fa, col_values=(('external_ids', {'iface-id': '8df77a26-faab-47ca-a39b-3df6930cd1d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:25:52', 'vm-uuid': '1f88cb97-4f22-439e-99f2-d7cb8d5aff36'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:06 user nova-compute[73078]: INFO os_vif [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:25:52,bridge_name='br-int',has_traffic_filtering=True,id=8df77a26-faab-47ca-a39b-3df6930cd1d5,network=Network(bfef9745-5a40-44b6-a6d5-2ef1e77fc5db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8df77a26-fa')
Aug 14 18:11:06 user nova-compute[73078]: DEBUG nova.network.neutron [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Successfully updated port: 10688f4a-5919-4a48-9767-92e304a494be {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "refresh_cache-8d257202-d8ab-4161-9b67-045cf1e36772" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquired lock "refresh_cache-8d257202-d8ab-4161-9b67-045cf1e36772" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG nova.network.neutron [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG nova.compute.manager [req-9f758b35-5277-416b-b555-3e8632edbc7f req-793e6e11-6720-4a0f-b64b-495a0ce0aa2c service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Received event network-changed-10688f4a-5919-4a48-9767-92e304a494be {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG nova.compute.manager [req-9f758b35-5277-416b-b555-3e8632edbc7f req-793e6e11-6720-4a0f-b64b-495a0ce0aa2c service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Refreshing instance network info cache due to event network-changed-10688f4a-5919-4a48-9767-92e304a494be. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:11:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9f758b35-5277-416b-b555-3e8632edbc7f req-793e6e11-6720-4a0f-b64b-495a0ce0aa2c service nova] Acquiring lock "refresh_cache-8d257202-d8ab-4161-9b67-045cf1e36772" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] No VIF found with MAC fa:16:3e:2d:25:52, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.network.neutron [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.network.neutron [req-28fca1ac-89f0-4612-84d4-4a487531defb req-02a93805-1ebd-41e2-9763-4497eeb615e1 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Updated VIF entry in instance network info cache for port 99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.network.neutron [req-28fca1ac-89f0-4612-84d4-4a487531defb req-02a93805-1ebd-41e2-9763-4497eeb615e1 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Updating instance_info_cache with network_info: [{"id": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "address": "fa:16:3e:ce:cd:93", "network": {"id": "1ec1577a-2943-44e6-9fd6-9d8308fcf09f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-135315381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09794ca2aebc4f50a4ab26cecefb4d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d8f3d6-2e", "ovs_interfaceid": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-28fca1ac-89f0-4612-84d4-4a487531defb req-02a93805-1ebd-41e2-9763-4497eeb615e1 service nova] Releasing lock "refresh_cache-24c00db3-2457-443d-b5ab-7e6ecaa57515" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.network.neutron [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Updating instance_info_cache with network_info: [{"id": "03e9ece7-7612-4a4f-86ab-d85b0c97d723", "address": "fa:16:3e:70:6a:64", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e9ece7-76", "ovs_interfaceid": "03e9ece7-7612-4a4f-86ab-d85b0c97d723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Releasing lock "refresh_cache-3c840309-9884-4c8a-a6ee-1acd44f32c4c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.compute.manager [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Instance network_info: |[{"id": "03e9ece7-7612-4a4f-86ab-d85b0c97d723", "address": "fa:16:3e:70:6a:64", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e9ece7-76", "ovs_interfaceid": "03e9ece7-7612-4a4f-86ab-d85b0c97d723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-846c7f21-3cd8-4ad7-ba10-35407c43cd01 req-e6a39be3-7df0-4767-92f7-d912c4f5afef service nova] Acquired lock "refresh_cache-3c840309-9884-4c8a-a6ee-1acd44f32c4c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.network.neutron [req-846c7f21-3cd8-4ad7-ba10-35407c43cd01 req-e6a39be3-7df0-4767-92f7-d912c4f5afef service nova] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Refreshing network info cache for port 03e9ece7-7612-4a4f-86ab-d85b0c97d723 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Start _get_guest_xml network_info=[{"id": "03e9ece7-7612-4a4f-86ab-d85b0c97d723", "address": "fa:16:3e:70:6a:64", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e9ece7-76", "ovs_interfaceid": "03e9ece7-7612-4a4f-86ab-d85b0c97d723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:11:07 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:11:07 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:10:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1378236224',display_name='tempest-ServerRescueNegativeTestJSON-server-1378236224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1378236224',id=4,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ec53c6018ee44b09ee31ba712a789aa',ramdisk_id='',reservation_id='r-7hiu473d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-38557121',owner_user_name='tempest-ServerRescueNegativeTestJSON-38557121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:10:53Z,user_data=None,user_id='d25ecea70e9e481e8a1957a94d79edfc',uuid=3c840309-9884-4c8a-a6ee-1acd44f32c4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03e9ece7-7612-4a4f-86ab-d85b0c97d723", "address": "fa:16:3e:70:6a:64", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e9ece7-76", "ovs_interfaceid": "03e9ece7-7612-4a4f-86ab-d85b0c97d723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Converting VIF {"id": "03e9ece7-7612-4a4f-86ab-d85b0c97d723", "address": "fa:16:3e:70:6a:64", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e9ece7-76", "ovs_interfaceid": "03e9ece7-7612-4a4f-86ab-d85b0c97d723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:6a:64,bridge_name='br-int',has_traffic_filtering=True,id=03e9ece7-7612-4a4f-86ab-d85b0c97d723,network=Network(33518dc6-7963-4995-b4c7-86d60b44a22f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03e9ece7-76') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.objects.instance [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c840309-9884-4c8a-a6ee-1acd44f32c4c {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:11:07 user nova-compute[73078]:   <uuid>3c840309-9884-4c8a-a6ee-1acd44f32c4c</uuid>
Aug 14 18:11:07 user nova-compute[73078]:   <name>instance-00000004</name>
Aug 14 18:11:07 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:11:07 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:11:07 user nova-compute[73078]:   <metadata>
Aug 14 18:11:07 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:11:07 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:11:07 user nova-compute[73078]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1378236224</nova:name>
Aug 14 18:11:07 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:11:07</nova:creationTime>
Aug 14 18:11:07 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:11:07 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:11:07 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:11:07 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:11:07 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:11:07 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:11:07 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:11:07 user nova-compute[73078]:       <nova:owner>
Aug 14 18:11:07 user nova-compute[73078]:         <nova:user uuid="d25ecea70e9e481e8a1957a94d79edfc">tempest-ServerRescueNegativeTestJSON-38557121-project-member</nova:user>
Aug 14 18:11:07 user nova-compute[73078]:         <nova:project uuid="4ec53c6018ee44b09ee31ba712a789aa">tempest-ServerRescueNegativeTestJSON-38557121</nova:project>
Aug 14 18:11:07 user nova-compute[73078]:       </nova:owner>
Aug 14 18:11:07 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:11:07 user nova-compute[73078]:       <nova:ports>
Aug 14 18:11:07 user nova-compute[73078]:         <nova:port uuid="03e9ece7-7612-4a4f-86ab-d85b0c97d723">
Aug 14 18:11:07 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 18:11:07 user nova-compute[73078]:         </nova:port>
Aug 14 18:11:07 user nova-compute[73078]:       </nova:ports>
Aug 14 18:11:07 user nova-compute[73078]:     </nova:instance>
Aug 14 18:11:07 user nova-compute[73078]:   </metadata>
Aug 14 18:11:07 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:11:07 user nova-compute[73078]:     <system>
Aug 14 18:11:07 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:11:07 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:11:07 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:11:07 user nova-compute[73078]:       <entry name="serial">3c840309-9884-4c8a-a6ee-1acd44f32c4c</entry>
Aug 14 18:11:07 user nova-compute[73078]:       <entry name="uuid">3c840309-9884-4c8a-a6ee-1acd44f32c4c</entry>
Aug 14 18:11:07 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:11:07 user nova-compute[73078]:     </system>
Aug 14 18:11:07 user nova-compute[73078]:   </sysinfo>
Aug 14 18:11:07 user nova-compute[73078]:   <os>
Aug 14 18:11:07 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:11:07 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:11:07 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:11:07 user nova-compute[73078]:   </os>
Aug 14 18:11:07 user nova-compute[73078]:   <features>
Aug 14 18:11:07 user nova-compute[73078]:     <acpi/>
Aug 14 18:11:07 user nova-compute[73078]:     <apic/>
Aug 14 18:11:07 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:11:07 user nova-compute[73078]:   </features>
Aug 14 18:11:07 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:11:07 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:11:07 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:11:07 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:11:07 user nova-compute[73078]:   </clock>
Aug 14 18:11:07 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:11:07 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:11:07 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:11:07 user nova-compute[73078]:   </cpu>
Aug 14 18:11:07 user nova-compute[73078]:   <devices>
Aug 14 18:11:07 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:11:07 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:11:07 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk"/>
Aug 14 18:11:07 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:11:07 user nova-compute[73078]:     </disk>
Aug 14 18:11:07 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:11:07 user nova-compute[73078]:       <mac address="fa:16:3e:70:6a:64"/>
Aug 14 18:11:07 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:11:07 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:11:07 user nova-compute[73078]:       <target dev="tap03e9ece7-76"/>
Aug 14 18:11:07 user nova-compute[73078]:     </interface>
Aug 14 18:11:07 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:11:07 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/console.log" append="off"/>
Aug 14 18:11:07 user nova-compute[73078]:     </serial>
Aug 14 18:11:07 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:11:07 user nova-compute[73078]:     <video>
Aug 14 18:11:07 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:11:07 user nova-compute[73078]:     </video>
Aug 14 18:11:07 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:11:07 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:11:07 user nova-compute[73078]:     </rng>
Aug 14 18:11:07 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:11:07 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:11:07 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:11:07 user nova-compute[73078]:     </memballoon>
Aug 14 18:11:07 user nova-compute[73078]:   </devices>
Aug 14 18:11:07 user nova-compute[73078]: </domain>
Aug 14 18:11:07 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:10:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1378236224',display_name='tempest-ServerRescueNegativeTestJSON-server-1378236224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1378236224',id=4,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ec53c6018ee44b09ee31ba712a789aa',ramdisk_id='',reservation_id='r-7hiu473d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-38557121',owner_user_name='tempest-ServerRescueNegativeTestJSON-38557121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:10:53Z,user_data=None,user_id='d25ecea70e9e481e8a1957a94d79edfc',uuid=3c840309-9884-4c8a-a6ee-1acd44f32c4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03e9ece7-7612-4a4f-86ab-d85b0c97d723", "address": "fa:16:3e:70:6a:64", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e9ece7-76", "ovs_interfaceid": "03e9ece7-7612-4a4f-86ab-d85b0c97d723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Converting VIF {"id": "03e9ece7-7612-4a4f-86ab-d85b0c97d723", "address": "fa:16:3e:70:6a:64", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e9ece7-76", "ovs_interfaceid": "03e9ece7-7612-4a4f-86ab-d85b0c97d723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:6a:64,bridge_name='br-int',has_traffic_filtering=True,id=03e9ece7-7612-4a4f-86ab-d85b0c97d723,network=Network(33518dc6-7963-4995-b4c7-86d60b44a22f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03e9ece7-76') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG os_vif [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:6a:64,bridge_name='br-int',has_traffic_filtering=True,id=03e9ece7-7612-4a4f-86ab-d85b0c97d723,network=Network(33518dc6-7963-4995-b4c7-86d60b44a22f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03e9ece7-76') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03e9ece7-76, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap03e9ece7-76, col_values=(('external_ids', {'iface-id': '03e9ece7-7612-4a4f-86ab-d85b0c97d723', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:6a:64', 'vm-uuid': '3c840309-9884-4c8a-a6ee-1acd44f32c4c'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:07 user nova-compute[73078]: INFO os_vif [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:6a:64,bridge_name='br-int',has_traffic_filtering=True,id=03e9ece7-7612-4a4f-86ab-d85b0c97d723,network=Network(33518dc6-7963-4995-b4c7-86d60b44a22f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03e9ece7-76')
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] No VIF found with MAC fa:16:3e:70:6a:64, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.network.neutron [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Updating instance_info_cache with network_info: [{"id": "10688f4a-5919-4a48-9767-92e304a494be", "address": "fa:16:3e:a4:3b:fc", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10688f4a-59", "ovs_interfaceid": "10688f4a-5919-4a48-9767-92e304a494be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Releasing lock "refresh_cache-8d257202-d8ab-4161-9b67-045cf1e36772" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.compute.manager [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Instance network_info: |[{"id": "10688f4a-5919-4a48-9767-92e304a494be", "address": "fa:16:3e:a4:3b:fc", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10688f4a-59", "ovs_interfaceid": "10688f4a-5919-4a48-9767-92e304a494be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9f758b35-5277-416b-b555-3e8632edbc7f req-793e6e11-6720-4a0f-b64b-495a0ce0aa2c service nova] Acquired lock "refresh_cache-8d257202-d8ab-4161-9b67-045cf1e36772" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.network.neutron [req-9f758b35-5277-416b-b555-3e8632edbc7f req-793e6e11-6720-4a0f-b64b-495a0ce0aa2c service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Refreshing network info cache for port 10688f4a-5919-4a48-9767-92e304a494be {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:11:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Start _get_guest_xml network_info=[{"id": "10688f4a-5919-4a48-9767-92e304a494be", "address": "fa:16:3e:a4:3b:fc", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10688f4a-59", "ovs_interfaceid": "10688f4a-5919-4a48-9767-92e304a494be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:11:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:08 user nova-compute[73078]: DEBUG nova.network.neutron [req-9f758b35-5277-416b-b555-3e8632edbc7f req-793e6e11-6720-4a0f-b64b-495a0ce0aa2c service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Updated VIF entry in instance network info cache for port 10688f4a-5919-4a48-9767-92e304a494be. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:11:08 user nova-compute[73078]: DEBUG nova.network.neutron [req-9f758b35-5277-416b-b555-3e8632edbc7f req-793e6e11-6720-4a0f-b64b-495a0ce0aa2c service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Updating instance_info_cache with network_info: [{"id": "10688f4a-5919-4a48-9767-92e304a494be", "address": "fa:16:3e:a4:3b:fc", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10688f4a-59", "ovs_interfaceid": "10688f4a-5919-4a48-9767-92e304a494be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:11:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9f758b35-5277-416b-b555-3e8632edbc7f req-793e6e11-6720-4a0f-b64b-495a0ce0aa2c service nova] Releasing lock "refresh_cache-8d257202-d8ab-4161-9b67-045cf1e36772" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:11:09 user nova-compute[73078]: DEBUG nova.network.neutron [req-2ae80de5-43fd-4a83-b3f0-d8bcdc63a75a req-6c2bf7e9-ecef-442e-b810-685d06a36bca service nova] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Updated VIF entry in instance network info cache for port 8df77a26-faab-47ca-a39b-3df6930cd1d5. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:11:09 user nova-compute[73078]: DEBUG nova.network.neutron [req-2ae80de5-43fd-4a83-b3f0-d8bcdc63a75a req-6c2bf7e9-ecef-442e-b810-685d06a36bca service nova] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Updating instance_info_cache with network_info: [{"id": "8df77a26-faab-47ca-a39b-3df6930cd1d5", "address": "fa:16:3e:2d:25:52", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df77a26-fa", "ovs_interfaceid": "8df77a26-faab-47ca-a39b-3df6930cd1d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:11:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-2ae80de5-43fd-4a83-b3f0-d8bcdc63a75a req-6c2bf7e9-ecef-442e-b810-685d06a36bca service nova] Releasing lock "refresh_cache-1f88cb97-4f22-439e-99f2-d7cb8d5aff36" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:11:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:09 user nova-compute[73078]: DEBUG nova.network.neutron [req-846c7f21-3cd8-4ad7-ba10-35407c43cd01 req-e6a39be3-7df0-4767-92f7-d912c4f5afef service nova] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Updated VIF entry in instance network info cache for port 03e9ece7-7612-4a4f-86ab-d85b0c97d723. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:11:09 user nova-compute[73078]: DEBUG nova.network.neutron [req-846c7f21-3cd8-4ad7-ba10-35407c43cd01 req-e6a39be3-7df0-4767-92f7-d912c4f5afef service nova] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Updating instance_info_cache with network_info: [{"id": "03e9ece7-7612-4a4f-86ab-d85b0c97d723", "address": "fa:16:3e:70:6a:64", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e9ece7-76", "ovs_interfaceid": "03e9ece7-7612-4a4f-86ab-d85b0c97d723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:11:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-846c7f21-3cd8-4ad7-ba10-35407c43cd01 req-e6a39be3-7df0-4767-92f7-d912c4f5afef service nova] Releasing lock "refresh_cache-3c840309-9884-4c8a-a6ee-1acd44f32c4c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036670.0231504, c29d7f9d-793f-4511-9203-06b653e52f72 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:11:10 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] VM Resumed (Lifecycle Event)
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.compute.manager [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:11:10 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Instance spawned successfully.
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:11:10 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:11:10 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:10:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-371462966',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-371462966',id=6,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAytc5c0yCOWi5RHK68JcsgGL6T5tQXRdaCO7qK9BUc6YvtuTuce/64y+OO5qRLfFUuylpXSvDyoEGmdGwwQQmepFt4h6dnqNjkgX3t+x5pkguE/gjsJr/ZWvvPydMGAmA==',key_name='tempest-keypair-1699997067',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f00de2496804d6eb570f93307f3f088',ramdisk_id='',reservation_id='r-m6qase30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1593185714',owner_user_name='tempest-AttachVolumeShelveTestJSON-1593185714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:11:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b07aecccb704835b6b765325b1d18bf',uuid=8d257202-d8ab-4161-9b67-045cf1e36772,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10688f4a-5919-4a48-9767-92e304a494be", "address": "fa:16:3e:a4:3b:fc", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10688f4a-59", "ovs_interfaceid": "10688f4a-5919-4a48-9767-92e304a494be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Converting VIF {"id": "10688f4a-5919-4a48-9767-92e304a494be", "address": "fa:16:3e:a4:3b:fc", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10688f4a-59", "ovs_interfaceid": "10688f4a-5919-4a48-9767-92e304a494be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:3b:fc,bridge_name='br-int',has_traffic_filtering=True,id=10688f4a-5919-4a48-9767-92e304a494be,network=Network(a3adc062-ecf8-4c88-84ab-69425b236920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10688f4a-59') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.objects.instance [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d257202-d8ab-4161-9b67-045cf1e36772 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:11:10 user nova-compute[73078]:   <uuid>8d257202-d8ab-4161-9b67-045cf1e36772</uuid>
Aug 14 18:11:10 user nova-compute[73078]:   <name>instance-00000006</name>
Aug 14 18:11:10 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:11:10 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:11:10 user nova-compute[73078]:   <metadata>
Aug 14 18:11:10 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:11:10 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:11:10 user nova-compute[73078]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-371462966</nova:name>
Aug 14 18:11:10 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:11:10</nova:creationTime>
Aug 14 18:11:10 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:11:10 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:11:10 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:11:10 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:11:10 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:11:10 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:11:10 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:11:10 user nova-compute[73078]:       <nova:owner>
Aug 14 18:11:10 user nova-compute[73078]:         <nova:user uuid="2b07aecccb704835b6b765325b1d18bf">tempest-AttachVolumeShelveTestJSON-1593185714-project-member</nova:user>
Aug 14 18:11:10 user nova-compute[73078]:         <nova:project uuid="5f00de2496804d6eb570f93307f3f088">tempest-AttachVolumeShelveTestJSON-1593185714</nova:project>
Aug 14 18:11:10 user nova-compute[73078]:       </nova:owner>
Aug 14 18:11:10 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:11:10 user nova-compute[73078]:       <nova:ports>
Aug 14 18:11:10 user nova-compute[73078]:         <nova:port uuid="10688f4a-5919-4a48-9767-92e304a494be">
Aug 14 18:11:10 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 18:11:10 user nova-compute[73078]:         </nova:port>
Aug 14 18:11:10 user nova-compute[73078]:       </nova:ports>
Aug 14 18:11:10 user nova-compute[73078]:     </nova:instance>
Aug 14 18:11:10 user nova-compute[73078]:   </metadata>
Aug 14 18:11:10 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:11:10 user nova-compute[73078]:     <system>
Aug 14 18:11:10 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:11:10 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:11:10 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:11:10 user nova-compute[73078]:       <entry name="serial">8d257202-d8ab-4161-9b67-045cf1e36772</entry>
Aug 14 18:11:10 user nova-compute[73078]:       <entry name="uuid">8d257202-d8ab-4161-9b67-045cf1e36772</entry>
Aug 14 18:11:10 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:11:10 user nova-compute[73078]:     </system>
Aug 14 18:11:10 user nova-compute[73078]:   </sysinfo>
Aug 14 18:11:10 user nova-compute[73078]:   <os>
Aug 14 18:11:10 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:11:10 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:11:10 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:11:10 user nova-compute[73078]:   </os>
Aug 14 18:11:10 user nova-compute[73078]:   <features>
Aug 14 18:11:10 user nova-compute[73078]:     <acpi/>
Aug 14 18:11:10 user nova-compute[73078]:     <apic/>
Aug 14 18:11:10 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:11:10 user nova-compute[73078]:   </features>
Aug 14 18:11:10 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:11:10 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:11:10 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:11:10 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:11:10 user nova-compute[73078]:   </clock>
Aug 14 18:11:10 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:11:10 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:11:10 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:11:10 user nova-compute[73078]:   </cpu>
Aug 14 18:11:10 user nova-compute[73078]:   <devices>
Aug 14 18:11:10 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:11:10 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:11:10 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/disk"/>
Aug 14 18:11:10 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:11:10 user nova-compute[73078]:     </disk>
Aug 14 18:11:10 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:11:10 user nova-compute[73078]:       <mac address="fa:16:3e:a4:3b:fc"/>
Aug 14 18:11:10 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:11:10 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:11:10 user nova-compute[73078]:       <target dev="tap10688f4a-59"/>
Aug 14 18:11:10 user nova-compute[73078]:     </interface>
Aug 14 18:11:10 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:11:10 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/console.log" append="off"/>
Aug 14 18:11:10 user nova-compute[73078]:     </serial>
Aug 14 18:11:10 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:11:10 user nova-compute[73078]:     <video>
Aug 14 18:11:10 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:11:10 user nova-compute[73078]:     </video>
Aug 14 18:11:10 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:11:10 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:11:10 user nova-compute[73078]:     </rng>
Aug 14 18:11:10 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:11:10 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:11:10 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:11:10 user nova-compute[73078]:     </memballoon>
Aug 14 18:11:10 user nova-compute[73078]:   </devices>
Aug 14 18:11:10 user nova-compute[73078]: </domain>
Aug 14 18:11:10 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:10:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-371462966',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-371462966',id=6,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAytc5c0yCOWi5RHK68JcsgGL6T5tQXRdaCO7qK9BUc6YvtuTuce/64y+OO5qRLfFUuylpXSvDyoEGmdGwwQQmepFt4h6dnqNjkgX3t+x5pkguE/gjsJr/ZWvvPydMGAmA==',key_name='tempest-keypair-1699997067',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f00de2496804d6eb570f93307f3f088',ramdisk_id='',reservation_id='r-m6qase30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1593185714',owner_user_name='tempest-AttachVolumeShelveTestJSON-1593185714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:11:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b07aecccb704835b6b765325b1d18bf',uuid=8d257202-d8ab-4161-9b67-045cf1e36772,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10688f4a-5919-4a48-9767-92e304a494be", "address": "fa:16:3e:a4:3b:fc", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10688f4a-59", "ovs_interfaceid": "10688f4a-5919-4a48-9767-92e304a494be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Converting VIF {"id": "10688f4a-5919-4a48-9767-92e304a494be", "address": "fa:16:3e:a4:3b:fc", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10688f4a-59", "ovs_interfaceid": "10688f4a-5919-4a48-9767-92e304a494be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:3b:fc,bridge_name='br-int',has_traffic_filtering=True,id=10688f4a-5919-4a48-9767-92e304a494be,network=Network(a3adc062-ecf8-4c88-84ab-69425b236920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10688f4a-59') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG os_vif [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:3b:fc,bridge_name='br-int',has_traffic_filtering=True,id=10688f4a-5919-4a48-9767-92e304a494be,network=Network(a3adc062-ecf8-4c88-84ab-69425b236920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10688f4a-59') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10688f4a-59, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap10688f4a-59, col_values=(('external_ids', {'iface-id': '10688f4a-5919-4a48-9767-92e304a494be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:3b:fc', 'vm-uuid': '8d257202-d8ab-4161-9b67-045cf1e36772'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:10 user nova-compute[73078]: INFO os_vif [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:3b:fc,bridge_name='br-int',has_traffic_filtering=True,id=10688f4a-5919-4a48-9767-92e304a494be,network=Network(a3adc062-ecf8-4c88-84ab-69425b236920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10688f4a-59')
Aug 14 18:11:10 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036670.0424385, c29d7f9d-793f-4511-9203-06b653e52f72 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:11:10 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] VM Started (Lifecycle Event)
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] No VIF found with MAC fa:16:3e:a4:3b:fc, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:11:10 user nova-compute[73078]: INFO nova.compute.manager [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Took 22.03 seconds to spawn the instance on the hypervisor.
Aug 14 18:11:10 user nova-compute[73078]: DEBUG nova.compute.manager [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:11:10 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:11:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:12 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036672.9093976, de80e188-9385-4613-8a6c-aa72b624ad55 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:11:12 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] VM Resumed (Lifecycle Event)
Aug 14 18:11:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:11:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:11:12 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Instance spawned successfully.
Aug 14 18:11:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:11:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:11:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:11:13 user nova-compute[73078]: INFO nova.compute.manager [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Took 25.62 seconds to build instance.
Aug 14 18:11:13 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:11:13 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036672.9153204, de80e188-9385-4613-8a6c-aa72b624ad55 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:11:13 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] VM Started (Lifecycle Event)
Aug 14 18:11:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-827d2721-cad2-4562-a4c5-177ac860d13e tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Lock "c29d7f9d-793f-4511-9203-06b653e52f72" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.830s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:13 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:11:13 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:11:13 user nova-compute[73078]: INFO nova.compute.manager [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Took 22.17 seconds to spawn the instance on the hypervisor.
Aug 14 18:11:13 user nova-compute[73078]: DEBUG nova.compute.manager [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:11:13 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:11:13 user nova-compute[73078]: INFO nova.compute.manager [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Took 22.99 seconds to build instance.
Aug 14 18:11:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c4c1e7a0-c7aa-4a2b-900b-25fe6dfc370e tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "de80e188-9385-4613-8a6c-aa72b624ad55" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.137s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:16 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036676.6091883, 24c00db3-2457-443d-b5ab-7e6ecaa57515 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:11:16 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] VM Resumed (Lifecycle Event)
Aug 14 18:11:16 user nova-compute[73078]: DEBUG nova.compute.manager [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:11:16 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:11:16 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Instance spawned successfully.
Aug 14 18:11:16 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:11:16 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:11:16 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:16 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:16 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:16 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:16 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:16 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:16 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:11:16 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:11:16 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036676.6169307, 24c00db3-2457-443d-b5ab-7e6ecaa57515 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:11:16 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] VM Started (Lifecycle Event)
Aug 14 18:11:16 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:11:16 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:11:16 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:11:16 user nova-compute[73078]: INFO nova.compute.manager [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Took 17.89 seconds to spawn the instance on the hypervisor.
Aug 14 18:11:16 user nova-compute[73078]: DEBUG nova.compute.manager [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:11:16 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036676.986897, 1f88cb97-4f22-439e-99f2-d7cb8d5aff36 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:11:16 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] VM Resumed (Lifecycle Event)
Aug 14 18:11:16 user nova-compute[73078]: DEBUG nova.compute.manager [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:11:16 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:11:17 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Instance spawned successfully.
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.compute.manager [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:17 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036676.988521, 1f88cb97-4f22-439e-99f2-d7cb8d5aff36 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:11:17 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] VM Started (Lifecycle Event)
Aug 14 18:11:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:17 user nova-compute[73078]: INFO nova.compute.manager [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Took 18.76 seconds to build instance.
Aug 14 18:11:17 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Instance spawned successfully.
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:11:17 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036677.0480962, 3c840309-9884-4c8a-a6ee-1acd44f32c4c => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:11:17 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] VM Resumed (Lifecycle Event)
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-25e2c076-59fc-41c1-b299-1e9145e4bb55 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.938s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:11:17 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036677.050875, 3c840309-9884-4c8a-a6ee-1acd44f32c4c => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:11:17 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] VM Started (Lifecycle Event)
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:11:17 user nova-compute[73078]: INFO nova.compute.manager [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Took 24.33 seconds to spawn the instance on the hypervisor.
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.compute.manager [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:11:17 user nova-compute[73078]: INFO nova.compute.manager [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Took 23.92 seconds to spawn the instance on the hypervisor.
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.compute.manager [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:11:17 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:11:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Acquiring lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.018s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.compute.manager [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036677.6333034, 8d257202-d8ab-4161-9b67-045cf1e36772 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:11:17 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] VM Resumed (Lifecycle Event)
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.compute.manager [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:11:17 user nova-compute[73078]: INFO nova.compute.manager [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Took 25.08 seconds to build instance.
Aug 14 18:11:17 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Instance spawned successfully.
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:17 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036677.6343477, 8d257202-d8ab-4161-9b67-045cf1e36772 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:11:17 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] VM Started (Lifecycle Event)
Aug 14 18:11:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:17 user nova-compute[73078]: INFO nova.compute.manager [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Took 25.35 seconds to build instance.
Aug 14 18:11:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cfcbe1e3-708a-4dda-97bd-87a366e33d25 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.340s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-676c753d-6c1f-45b5-995a-eca2887c5390 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "1f88cb97-4f22-439e-99f2-d7cb8d5aff36" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.615s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:17 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:11:17 user nova-compute[73078]: INFO nova.compute.claims [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Claim successful on node user
Aug 14 18:11:17 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:11:18 user nova-compute[73078]: INFO nova.compute.manager [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Took 17.37 seconds to spawn the instance on the hypervisor.
Aug 14 18:11:18 user nova-compute[73078]: DEBUG nova.compute.manager [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:11:18 user nova-compute[73078]: INFO nova.compute.manager [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Took 18.23 seconds to build instance.
Aug 14 18:11:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-747dfa1d-1e92-48bb-90b5-6048dc3bcfad tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "8d257202-d8ab-4161-9b67-045cf1e36772" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.463s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Acquiring lock "10f9d4a9-ee3f-45bd-95e4-edd4819dcf30" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "10f9d4a9-ee3f-45bd-95e4-edd4819dcf30" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:18 user nova-compute[73078]: DEBUG nova.compute.manager [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:11:18 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:11:18 user nova-compute[73078]: DEBUG nova.compute.manager [req-bbc0cdca-9559-4c50-89b2-e51036850b64 req-f522edcc-4104-4b40-9aae-0b34887ba0e7 service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Received event network-vif-plugged-10688f4a-5919-4a48-9767-92e304a494be {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:11:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-bbc0cdca-9559-4c50-89b2-e51036850b64 req-f522edcc-4104-4b40-9aae-0b34887ba0e7 service nova] Acquiring lock "8d257202-d8ab-4161-9b67-045cf1e36772-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-bbc0cdca-9559-4c50-89b2-e51036850b64 req-f522edcc-4104-4b40-9aae-0b34887ba0e7 service nova] Lock "8d257202-d8ab-4161-9b67-045cf1e36772-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-bbc0cdca-9559-4c50-89b2-e51036850b64 req-f522edcc-4104-4b40-9aae-0b34887ba0e7 service nova] Lock "8d257202-d8ab-4161-9b67-045cf1e36772-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:18 user nova-compute[73078]: DEBUG nova.compute.manager [req-bbc0cdca-9559-4c50-89b2-e51036850b64 req-f522edcc-4104-4b40-9aae-0b34887ba0e7 service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] No waiting events found dispatching network-vif-plugged-10688f4a-5919-4a48-9767-92e304a494be {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:11:18 user nova-compute[73078]: WARNING nova.compute.manager [req-bbc0cdca-9559-4c50-89b2-e51036850b64 req-f522edcc-4104-4b40-9aae-0b34887ba0e7 service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Received unexpected event network-vif-plugged-10688f4a-5919-4a48-9767-92e304a494be for instance with vm_state active and task_state None.
Aug 14 18:11:18 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:11:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.974s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:18 user nova-compute[73078]: DEBUG nova.compute.manager [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:11:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:18 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:11:18 user nova-compute[73078]: INFO nova.compute.claims [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Claim successful on node user
Aug 14 18:11:19 user nova-compute[73078]: DEBUG nova.compute.manager [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:11:19 user nova-compute[73078]: DEBUG nova.network.neutron [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:11:19 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 14 18:11:19 user nova-compute[73078]: DEBUG nova.compute.manager [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:11:19 user nova-compute[73078]: DEBUG nova.compute.manager [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:11:19 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:11:19 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Creating image(s)
Aug 14 18:11:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Acquiring lock "/opt/stack/data/nova/instances/0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Lock "/opt/stack/data/nova/instances/0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Lock "/opt/stack/data/nova/instances/0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Acquiring lock "ec7b1abca4d0e6ba0d98bb0e5a30edc2d662df94" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Lock "ec7b1abca4d0e6ba0d98bb0e5a30edc2d662df94" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:19 user nova-compute[73078]: DEBUG nova.policy [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1cc41673ab284557a5f88bc6487a2ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff3894cf6eba466da26bad6c3bd978f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:11:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec7b1abca4d0e6ba0d98bb0e5a30edc2d662df94.part --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:20 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:11:20 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:20 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:11:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.389s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:20 user nova-compute[73078]: DEBUG nova.compute.manager [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:11:20 user nova-compute[73078]: DEBUG nova.compute.manager [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:11:20 user nova-compute[73078]: DEBUG nova.network.neutron [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:11:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec7b1abca4d0e6ba0d98bb0e5a30edc2d662df94.part --force-share --output=json" returned: 0 in 0.358s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:20 user nova-compute[73078]: DEBUG nova.virt.images [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] 7df27413-ba0c-438f-9f0b-994325e5ab25 was qcow2, converting to raw {{(pid=73078) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 18:11:20 user nova-compute[73078]: DEBUG nova.privsep.utils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73078) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 18:11:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ec7b1abca4d0e6ba0d98bb0e5a30edc2d662df94.part /opt/stack/data/nova/instances/_base/ec7b1abca4d0e6ba0d98bb0e5a30edc2d662df94.converted {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:20 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:11:20 user nova-compute[73078]: DEBUG nova.compute.manager [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:11:20 user nova-compute[73078]: DEBUG nova.compute.manager [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:11:20 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:11:20 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Creating image(s)
Aug 14 18:11:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Acquiring lock "/opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "/opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "/opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ec7b1abca4d0e6ba0d98bb0e5a30edc2d662df94.part /opt/stack/data/nova/instances/_base/ec7b1abca4d0e6ba0d98bb0e5a30edc2d662df94.converted" returned: 0 in 0.334s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec7b1abca4d0e6ba0d98bb0e5a30edc2d662df94.converted --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:20 user nova-compute[73078]: DEBUG nova.policy [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2a4b9a2ffd4947ce8fb65976b48b112d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0d923a445747d8a812c1b7b4510398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:11:20 user nova-compute[73078]: DEBUG nova.compute.manager [req-562307a1-7940-44b8-8858-cfa457973e37 req-36d723e4-97e1-4837-955a-295587d58b92 service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Received event network-vif-plugged-10688f4a-5919-4a48-9767-92e304a494be {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:11:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-562307a1-7940-44b8-8858-cfa457973e37 req-36d723e4-97e1-4837-955a-295587d58b92 service nova] Acquiring lock "8d257202-d8ab-4161-9b67-045cf1e36772-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-562307a1-7940-44b8-8858-cfa457973e37 req-36d723e4-97e1-4837-955a-295587d58b92 service nova] Lock "8d257202-d8ab-4161-9b67-045cf1e36772-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-562307a1-7940-44b8-8858-cfa457973e37 req-36d723e4-97e1-4837-955a-295587d58b92 service nova] Lock "8d257202-d8ab-4161-9b67-045cf1e36772-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:20 user nova-compute[73078]: DEBUG nova.compute.manager [req-562307a1-7940-44b8-8858-cfa457973e37 req-36d723e4-97e1-4837-955a-295587d58b92 service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] No waiting events found dispatching network-vif-plugged-10688f4a-5919-4a48-9767-92e304a494be {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:11:20 user nova-compute[73078]: WARNING nova.compute.manager [req-562307a1-7940-44b8-8858-cfa457973e37 req-36d723e4-97e1-4837-955a-295587d58b92 service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Received unexpected event network-vif-plugged-10688f4a-5919-4a48-9767-92e304a494be for instance with vm_state active and task_state None.
Aug 14 18:11:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.249s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec7b1abca4d0e6ba0d98bb0e5a30edc2d662df94.converted --force-share --output=json" returned: 0 in 0.330s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Lock "ec7b1abca4d0e6ba0d98bb0e5a30edc2d662df94" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.732s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec7b1abca4d0e6ba0d98bb0e5a30edc2d662df94 --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.333s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30/disk 1073741824" returned: 0 in 0.109s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.459s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec7b1abca4d0e6ba0d98bb0e5a30edc2d662df94 --force-share --output=json" returned: 0 in 0.343s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Acquiring lock "ec7b1abca4d0e6ba0d98bb0e5a30edc2d662df94" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Lock "ec7b1abca4d0e6ba0d98bb0e5a30edc2d662df94" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec7b1abca4d0e6ba0d98bb0e5a30edc2d662df94 --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec7b1abca4d0e6ba0d98bb0e5a30edc2d662df94 --force-share --output=json" returned: 0 in 0.450s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.508s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ec7b1abca4d0e6ba0d98bb0e5a30edc2d662df94,backing_fmt=raw /opt/stack/data/nova/instances/0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:22 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Checking if we can resize image /opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:11:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ec7b1abca4d0e6ba0d98bb0e5a30edc2d662df94,backing_fmt=raw /opt/stack/data/nova/instances/0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a/disk 1073741824" returned: 0 in 0.158s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Lock "ec7b1abca4d0e6ba0d98bb0e5a30edc2d662df94" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.617s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec7b1abca4d0e6ba0d98bb0e5a30edc2d662df94 --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec7b1abca4d0e6ba0d98bb0e5a30edc2d662df94 --force-share --output=json" returned: 0 in 0.309s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:22 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:11:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30/disk --force-share --output=json" returned: 0 in 0.491s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:22 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Cannot resize image /opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:11:22 user nova-compute[73078]: DEBUG nova.objects.instance [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lazy-loading 'migration_context' on Instance uuid 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:11:22 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:11:22 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Ensure instance console log exists: /opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:11:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:22 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Cannot resize image /opt/stack/data/nova/instances/0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:11:22 user nova-compute[73078]: DEBUG nova.objects.instance [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Lazy-loading 'migration_context' on Instance uuid 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:11:22 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:11:22 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Ensure instance console log exists: /opt/stack/data/nova/instances/0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:11:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:25 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:25 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:25 user nova-compute[73078]: DEBUG nova.network.neutron [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Successfully created port: 733825c5-0713-4980-9e5d-4a1120fb1598 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:11:25 user nova-compute[73078]: DEBUG nova.network.neutron [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Successfully created port: 0e2c0a61-c9ce-49a5-891d-97803d8557e1 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:11:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Acquiring lock "b97b330e-7a72-4d3c-8810-98a4f3a27ce7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Lock "b97b330e-7a72-4d3c-8810-98a4f3a27ce7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:26 user nova-compute[73078]: DEBUG nova.compute.manager [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:11:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:27 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:11:27 user nova-compute[73078]: INFO nova.compute.claims [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Claim successful on node user
Aug 14 18:11:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:27 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:11:27 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:11:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.925s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:27 user nova-compute[73078]: DEBUG nova.compute.manager [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:11:28 user nova-compute[73078]: DEBUG nova.compute.manager [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:11:28 user nova-compute[73078]: DEBUG nova.network.neutron [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:11:28 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:11:28 user nova-compute[73078]: DEBUG nova.compute.manager [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:11:28 user nova-compute[73078]: DEBUG nova.policy [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f3e1886d42204be983df5b9b99cc3050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e318b0d535142f2989495f416995a1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:11:28 user nova-compute[73078]: DEBUG nova.network.neutron [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Successfully updated port: 0e2c0a61-c9ce-49a5-891d-97803d8557e1 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:11:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Acquiring lock "refresh_cache-10f9d4a9-ee3f-45bd-95e4-edd4819dcf30" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:11:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Acquired lock "refresh_cache-10f9d4a9-ee3f-45bd-95e4-edd4819dcf30" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:11:28 user nova-compute[73078]: DEBUG nova.network.neutron [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:11:28 user nova-compute[73078]: DEBUG nova.compute.manager [req-dd8f1b66-869f-4069-a270-c40ba2e4bf62 req-affff365-7ef6-4a15-808c-098914f667f6 service nova] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Received event network-changed-0e2c0a61-c9ce-49a5-891d-97803d8557e1 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:11:28 user nova-compute[73078]: DEBUG nova.compute.manager [req-dd8f1b66-869f-4069-a270-c40ba2e4bf62 req-affff365-7ef6-4a15-808c-098914f667f6 service nova] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Refreshing instance network info cache due to event network-changed-0e2c0a61-c9ce-49a5-891d-97803d8557e1. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:11:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-dd8f1b66-869f-4069-a270-c40ba2e4bf62 req-affff365-7ef6-4a15-808c-098914f667f6 service nova] Acquiring lock "refresh_cache-10f9d4a9-ee3f-45bd-95e4-edd4819dcf30" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:11:28 user nova-compute[73078]: DEBUG nova.compute.manager [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:11:28 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:11:28 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Creating image(s)
Aug 14 18:11:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Acquiring lock "/opt/stack/data/nova/instances/b97b330e-7a72-4d3c-8810-98a4f3a27ce7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Lock "/opt/stack/data/nova/instances/b97b330e-7a72-4d3c-8810-98a4f3a27ce7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Lock "/opt/stack/data/nova/instances/b97b330e-7a72-4d3c-8810-98a4f3a27ce7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:28 user nova-compute[73078]: DEBUG nova.network.neutron [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:11:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Acquiring lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:28 user nova-compute[73078]: DEBUG nova.compute.manager [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:11:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.372s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.022s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:28 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:11:28 user nova-compute[73078]: INFO nova.compute.claims [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Claim successful on node user
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.network.neutron [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Successfully updated port: 733825c5-0713-4980-9e5d-4a1120fb1598 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.286s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/b97b330e-7a72-4d3c-8810-98a4f3a27ce7/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Acquiring lock "refresh_cache-0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Acquired lock "refresh_cache-0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.network.neutron [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/b97b330e-7a72-4d3c-8810-98a4f3a27ce7/disk 1073741824" returned: 0 in 0.111s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.406s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.network.neutron [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Successfully created port: a8a4ff9c-da83-430a-aa65-d8eaf189416e {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.network.neutron [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.213s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b97b330e-7a72-4d3c-8810-98a4f3a27ce7/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b97b330e-7a72-4d3c-8810-98a4f3a27ce7/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.network.neutron [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Updating instance_info_cache with network_info: [{"id": "0e2c0a61-c9ce-49a5-891d-97803d8557e1", "address": "fa:16:3e:63:16:7b", "network": {"id": "bcbb9361-92bf-48f3-9d61-e5cdb5d21980", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1013223391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d0d923a445747d8a812c1b7b4510398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e2c0a61-c9", "ovs_interfaceid": "0e2c0a61-c9ce-49a5-891d-97803d8557e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Acquiring lock "e8ad453e-67b1-4af2-b85b-a5e100c11446" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Lock "e8ad453e-67b1-4af2-b85b-a5e100c11446" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.compute.manager [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Releasing lock "refresh_cache-10f9d4a9-ee3f-45bd-95e4-edd4819dcf30" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.compute.manager [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Instance network_info: |[{"id": "0e2c0a61-c9ce-49a5-891d-97803d8557e1", "address": "fa:16:3e:63:16:7b", "network": {"id": "bcbb9361-92bf-48f3-9d61-e5cdb5d21980", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1013223391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d0d923a445747d8a812c1b7b4510398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e2c0a61-c9", "ovs_interfaceid": "0e2c0a61-c9ce-49a5-891d-97803d8557e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-dd8f1b66-869f-4069-a270-c40ba2e4bf62 req-affff365-7ef6-4a15-808c-098914f667f6 service nova] Acquired lock "refresh_cache-10f9d4a9-ee3f-45bd-95e4-edd4819dcf30" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.network.neutron [req-dd8f1b66-869f-4069-a270-c40ba2e4bf62 req-affff365-7ef6-4a15-808c-098914f667f6 service nova] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Refreshing network info cache for port 0e2c0a61-c9ce-49a5-891d-97803d8557e1 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Start _get_guest_xml network_info=[{"id": "0e2c0a61-c9ce-49a5-891d-97803d8557e1", "address": "fa:16:3e:63:16:7b", "network": {"id": "bcbb9361-92bf-48f3-9d61-e5cdb5d21980", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1013223391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d0d923a445747d8a812c1b7b4510398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e2c0a61-c9", "ovs_interfaceid": "0e2c0a61-c9ce-49a5-891d-97803d8557e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:11:29 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:11:29 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b97b330e-7a72-4d3c-8810-98a4f3a27ce7/disk --force-share --output=json" returned: 0 in 0.306s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Cannot resize image /opt/stack/data/nova/instances/b97b330e-7a72-4d3c-8810-98a4f3a27ce7/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.objects.instance [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Lazy-loading 'migration_context' on Instance uuid b97b330e-7a72-4d3c-8810-98a4f3a27ce7 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1229416704',display_name='tempest-VolumesAdminNegativeTest-server-1229416704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1229416704',id=8,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL/e0arVJj00ekjB5q3VvUCkhgo+KqaamcMsu31WGLM+jn12dW9YePCbHY8SkAvTiAD1hM6rwZd/oPMx/RAudoGEvNO/33/GQlMCXTKB5rvfACcTbcAbtIeqYwa1h0VnA==',key_name='tempest-keypair-1680478252',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d0d923a445747d8a812c1b7b4510398',ramdisk_id='',reservation_id='r-25qetqjt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1778130930',owner_user_name='tempest-VolumesAdminNegativeTest-1778130930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:11:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a4b9a2ffd4947ce8fb65976b48b112d',uuid=10f9d4a9-ee3f-45bd-95e4-edd4819dcf30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e2c0a61-c9ce-49a5-891d-97803d8557e1", "address": "fa:16:3e:63:16:7b", "network": {"id": "bcbb9361-92bf-48f3-9d61-e5cdb5d21980", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1013223391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d0d923a445747d8a812c1b7b4510398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e2c0a61-c9", "ovs_interfaceid": "0e2c0a61-c9ce-49a5-891d-97803d8557e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Converting VIF {"id": "0e2c0a61-c9ce-49a5-891d-97803d8557e1", "address": "fa:16:3e:63:16:7b", "network": {"id": "bcbb9361-92bf-48f3-9d61-e5cdb5d21980", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1013223391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d0d923a445747d8a812c1b7b4510398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e2c0a61-c9", "ovs_interfaceid": "0e2c0a61-c9ce-49a5-891d-97803d8557e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:16:7b,bridge_name='br-int',has_traffic_filtering=True,id=0e2c0a61-c9ce-49a5-891d-97803d8557e1,network=Network(bcbb9361-92bf-48f3-9d61-e5cdb5d21980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e2c0a61-c9') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.objects.instance [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lazy-loading 'pci_devices' on Instance uuid 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Ensure instance console log exists: /opt/stack/data/nova/instances/b97b330e-7a72-4d3c-8810-98a4f3a27ce7/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:11:29 user nova-compute[73078]:   <uuid>10f9d4a9-ee3f-45bd-95e4-edd4819dcf30</uuid>
Aug 14 18:11:29 user nova-compute[73078]:   <name>instance-00000008</name>
Aug 14 18:11:29 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:11:29 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:11:29 user nova-compute[73078]:   <metadata>
Aug 14 18:11:29 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:11:29 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:11:29 user nova-compute[73078]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1229416704</nova:name>
Aug 14 18:11:29 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:11:29</nova:creationTime>
Aug 14 18:11:29 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:11:29 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:11:29 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:11:29 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:11:29 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:11:29 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:11:29 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:11:29 user nova-compute[73078]:       <nova:owner>
Aug 14 18:11:29 user nova-compute[73078]:         <nova:user uuid="2a4b9a2ffd4947ce8fb65976b48b112d">tempest-VolumesAdminNegativeTest-1778130930-project-member</nova:user>
Aug 14 18:11:29 user nova-compute[73078]:         <nova:project uuid="1d0d923a445747d8a812c1b7b4510398">tempest-VolumesAdminNegativeTest-1778130930</nova:project>
Aug 14 18:11:29 user nova-compute[73078]:       </nova:owner>
Aug 14 18:11:29 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:11:29 user nova-compute[73078]:       <nova:ports>
Aug 14 18:11:29 user nova-compute[73078]:         <nova:port uuid="0e2c0a61-c9ce-49a5-891d-97803d8557e1">
Aug 14 18:11:29 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 18:11:29 user nova-compute[73078]:         </nova:port>
Aug 14 18:11:29 user nova-compute[73078]:       </nova:ports>
Aug 14 18:11:29 user nova-compute[73078]:     </nova:instance>
Aug 14 18:11:29 user nova-compute[73078]:   </metadata>
Aug 14 18:11:29 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:11:29 user nova-compute[73078]:     <system>
Aug 14 18:11:29 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:11:29 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:11:29 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:11:29 user nova-compute[73078]:       <entry name="serial">10f9d4a9-ee3f-45bd-95e4-edd4819dcf30</entry>
Aug 14 18:11:29 user nova-compute[73078]:       <entry name="uuid">10f9d4a9-ee3f-45bd-95e4-edd4819dcf30</entry>
Aug 14 18:11:29 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:11:29 user nova-compute[73078]:     </system>
Aug 14 18:11:29 user nova-compute[73078]:   </sysinfo>
Aug 14 18:11:29 user nova-compute[73078]:   <os>
Aug 14 18:11:29 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:11:29 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:11:29 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:11:29 user nova-compute[73078]:   </os>
Aug 14 18:11:29 user nova-compute[73078]:   <features>
Aug 14 18:11:29 user nova-compute[73078]:     <acpi/>
Aug 14 18:11:29 user nova-compute[73078]:     <apic/>
Aug 14 18:11:29 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:11:29 user nova-compute[73078]:   </features>
Aug 14 18:11:29 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:11:29 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:11:29 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:11:29 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:11:29 user nova-compute[73078]:   </clock>
Aug 14 18:11:29 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:11:29 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:11:29 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:11:29 user nova-compute[73078]:   </cpu>
Aug 14 18:11:29 user nova-compute[73078]:   <devices>
Aug 14 18:11:29 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:11:29 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:11:29 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30/disk"/>
Aug 14 18:11:29 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:11:29 user nova-compute[73078]:     </disk>
Aug 14 18:11:29 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:11:29 user nova-compute[73078]:       <mac address="fa:16:3e:63:16:7b"/>
Aug 14 18:11:29 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:11:29 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:11:29 user nova-compute[73078]:       <target dev="tap0e2c0a61-c9"/>
Aug 14 18:11:29 user nova-compute[73078]:     </interface>
Aug 14 18:11:29 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:11:29 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30/console.log" append="off"/>
Aug 14 18:11:29 user nova-compute[73078]:     </serial>
Aug 14 18:11:29 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:11:29 user nova-compute[73078]:     <video>
Aug 14 18:11:29 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:11:29 user nova-compute[73078]:     </video>
Aug 14 18:11:29 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:11:29 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:11:29 user nova-compute[73078]:     </rng>
Aug 14 18:11:29 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:11:29 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:11:29 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:11:29 user nova-compute[73078]:     </memballoon>
Aug 14 18:11:29 user nova-compute[73078]:   </devices>
Aug 14 18:11:29 user nova-compute[73078]: </domain>
Aug 14 18:11:29 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1229416704',display_name='tempest-VolumesAdminNegativeTest-server-1229416704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1229416704',id=8,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL/e0arVJj00ekjB5q3VvUCkhgo+KqaamcMsu31WGLM+jn12dW9YePCbHY8SkAvTiAD1hM6rwZd/oPMx/RAudoGEvNO/33/GQlMCXTKB5rvfACcTbcAbtIeqYwa1h0VnA==',key_name='tempest-keypair-1680478252',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d0d923a445747d8a812c1b7b4510398',ramdisk_id='',reservation_id='r-25qetqjt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1778130930',owner_user_name='tempest-VolumesAdminNegativeTest-1778130930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:11:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a4b9a2ffd4947ce8fb65976b48b112d',uuid=10f9d4a9-ee3f-45bd-95e4-edd4819dcf30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e2c0a61-c9ce-49a5-891d-97803d8557e1", "address": "fa:16:3e:63:16:7b", "network": {"id": "bcbb9361-92bf-48f3-9d61-e5cdb5d21980", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1013223391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d0d923a445747d8a812c1b7b4510398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e2c0a61-c9", "ovs_interfaceid": "0e2c0a61-c9ce-49a5-891d-97803d8557e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Converting VIF {"id": "0e2c0a61-c9ce-49a5-891d-97803d8557e1", "address": "fa:16:3e:63:16:7b", "network": {"id": "bcbb9361-92bf-48f3-9d61-e5cdb5d21980", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1013223391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d0d923a445747d8a812c1b7b4510398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e2c0a61-c9", "ovs_interfaceid": "0e2c0a61-c9ce-49a5-891d-97803d8557e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:16:7b,bridge_name='br-int',has_traffic_filtering=True,id=0e2c0a61-c9ce-49a5-891d-97803d8557e1,network=Network(bcbb9361-92bf-48f3-9d61-e5cdb5d21980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e2c0a61-c9') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG os_vif [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:16:7b,bridge_name='br-int',has_traffic_filtering=True,id=0e2c0a61-c9ce-49a5-891d-97803d8557e1,network=Network(bcbb9361-92bf-48f3-9d61-e5cdb5d21980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e2c0a61-c9') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e2c0a61-c9, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0e2c0a61-c9, col_values=(('external_ids', {'iface-id': '0e2c0a61-c9ce-49a5-891d-97803d8557e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:16:7b', 'vm-uuid': '10f9d4a9-ee3f-45bd-95e4-edd4819dcf30'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:30 user nova-compute[73078]: INFO os_vif [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:16:7b,bridge_name='br-int',has_traffic_filtering=True,id=0e2c0a61-c9ce-49a5-891d-97803d8557e1,network=Network(bcbb9361-92bf-48f3-9d61-e5cdb5d21980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e2c0a61-c9')
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] No VIF found with MAC fa:16:3e:63:16:7b, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.261s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.compute.manager [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.275s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.network.neutron [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Updating instance_info_cache with network_info: [{"id": "733825c5-0713-4980-9e5d-4a1120fb1598", "address": "fa:16:3e:e5:43:d0", "network": {"id": "3f423cdf-1eb1-4a1b-acf0-37ef2a8dfdca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1815766145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff3894cf6eba466da26bad6c3bd978f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap733825c5-07", "ovs_interfaceid": "733825c5-0713-4980-9e5d-4a1120fb1598", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:11:30 user nova-compute[73078]: INFO nova.compute.claims [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Claim successful on node user
Aug 14 18:11:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Releasing lock "refresh_cache-0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.compute.manager [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Instance network_info: |[{"id": "733825c5-0713-4980-9e5d-4a1120fb1598", "address": "fa:16:3e:e5:43:d0", "network": {"id": "3f423cdf-1eb1-4a1b-acf0-37ef2a8dfdca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1815766145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff3894cf6eba466da26bad6c3bd978f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap733825c5-07", "ovs_interfaceid": "733825c5-0713-4980-9e5d-4a1120fb1598", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Start _get_guest_xml network_info=[{"id": "733825c5-0713-4980-9e5d-4a1120fb1598", "address": "fa:16:3e:e5:43:d0", "network": {"id": "3f423cdf-1eb1-4a1b-acf0-37ef2a8dfdca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1815766145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff3894cf6eba466da26bad6c3bd978f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap733825c5-07", "ovs_interfaceid": "733825c5-0713-4980-9e5d-4a1120fb1598", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:11:07Z,direct_url=<?>,disk_format='qcow2',id=7df27413-ba0c-438f-9f0b-994325e5ab25,min_disk=0,min_ram=0,name='',owner='b2a5536ca6814f889805195c775d646d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:11:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/sda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'scsi', 'guest_format': None, 'size': 0, 'image_id': '7df27413-ba0c-438f-9f0b-994325e5ab25'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.compute.manager [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.network.neutron [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:11:30 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:11:30 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:11:30 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.compute.manager [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:11:07Z,direct_url=<?>,disk_format='qcow2',id=7df27413-ba0c-438f-9f0b-994325e5ab25,min_disk=0,min_ram=0,name='',owner='b2a5536ca6814f889805195c775d646d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:11:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:11:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2062379060',display_name='tempest-AttachSCSIVolumeTestJSON-server-2062379060',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2062379060',id=7,image_ref='7df27413-ba0c-438f-9f0b-994325e5ab25',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5begJ0RpTUBw/BhoW7yA3Hl8+N5qtFQsI21CQInuxm9BUSoyfj7Y3GNhE37GUGawAca3iEnAVf6ncr6AJRwd6+6hticeA8Pa/igPXCOkR2HipnVX44Ub+Jy7QfRbAhUg==',key_name='tempest-keypair-1308980545',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff3894cf6eba466da26bad6c3bd978f7',ramdisk_id='',reservation_id='r-gsq12z9z',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7df27413-ba0c-438f-9f0b-994325e5ab25',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1163083945',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1163083945-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:11:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1cc41673ab284557a5f88bc6487a2ad2',uuid=0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "733825c5-0713-4980-9e5d-4a1120fb1598", "address": "fa:16:3e:e5:43:d0", "network": {"id": "3f423cdf-1eb1-4a1b-acf0-37ef2a8dfdca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1815766145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff3894cf6eba466da26bad6c3bd978f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap733825c5-07", "ovs_interfaceid": "733825c5-0713-4980-9e5d-4a1120fb1598", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Converting VIF {"id": "733825c5-0713-4980-9e5d-4a1120fb1598", "address": "fa:16:3e:e5:43:d0", "network": {"id": "3f423cdf-1eb1-4a1b-acf0-37ef2a8dfdca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1815766145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff3894cf6eba466da26bad6c3bd978f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap733825c5-07", "ovs_interfaceid": "733825c5-0713-4980-9e5d-4a1120fb1598", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:43:d0,bridge_name='br-int',has_traffic_filtering=True,id=733825c5-0713-4980-9e5d-4a1120fb1598,network=Network(3f423cdf-1eb1-4a1b-acf0-37ef2a8dfdca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap733825c5-07') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.objects.instance [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:11:30 user nova-compute[73078]:   <uuid>0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a</uuid>
Aug 14 18:11:30 user nova-compute[73078]:   <name>instance-00000007</name>
Aug 14 18:11:30 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:11:30 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:11:30 user nova-compute[73078]:   <metadata>
Aug 14 18:11:30 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:11:30 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:11:30 user nova-compute[73078]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-2062379060</nova:name>
Aug 14 18:11:30 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:11:30</nova:creationTime>
Aug 14 18:11:30 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:11:30 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:11:30 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:11:30 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:11:30 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:11:30 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:11:30 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:11:30 user nova-compute[73078]:       <nova:owner>
Aug 14 18:11:30 user nova-compute[73078]:         <nova:user uuid="1cc41673ab284557a5f88bc6487a2ad2">tempest-AttachSCSIVolumeTestJSON-1163083945-project-member</nova:user>
Aug 14 18:11:30 user nova-compute[73078]:         <nova:project uuid="ff3894cf6eba466da26bad6c3bd978f7">tempest-AttachSCSIVolumeTestJSON-1163083945</nova:project>
Aug 14 18:11:30 user nova-compute[73078]:       </nova:owner>
Aug 14 18:11:30 user nova-compute[73078]:       <nova:root type="image" uuid="7df27413-ba0c-438f-9f0b-994325e5ab25"/>
Aug 14 18:11:30 user nova-compute[73078]:       <nova:ports>
Aug 14 18:11:30 user nova-compute[73078]:         <nova:port uuid="733825c5-0713-4980-9e5d-4a1120fb1598">
Aug 14 18:11:30 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 18:11:30 user nova-compute[73078]:         </nova:port>
Aug 14 18:11:30 user nova-compute[73078]:       </nova:ports>
Aug 14 18:11:30 user nova-compute[73078]:     </nova:instance>
Aug 14 18:11:30 user nova-compute[73078]:   </metadata>
Aug 14 18:11:30 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:11:30 user nova-compute[73078]:     <system>
Aug 14 18:11:30 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:11:30 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:11:30 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:11:30 user nova-compute[73078]:       <entry name="serial">0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a</entry>
Aug 14 18:11:30 user nova-compute[73078]:       <entry name="uuid">0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a</entry>
Aug 14 18:11:30 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:11:30 user nova-compute[73078]:     </system>
Aug 14 18:11:30 user nova-compute[73078]:   </sysinfo>
Aug 14 18:11:30 user nova-compute[73078]:   <os>
Aug 14 18:11:30 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:11:30 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:11:30 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:11:30 user nova-compute[73078]:   </os>
Aug 14 18:11:30 user nova-compute[73078]:   <features>
Aug 14 18:11:30 user nova-compute[73078]:     <acpi/>
Aug 14 18:11:30 user nova-compute[73078]:     <apic/>
Aug 14 18:11:30 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:11:30 user nova-compute[73078]:   </features>
Aug 14 18:11:30 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:11:30 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:11:30 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:11:30 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:11:30 user nova-compute[73078]:   </clock>
Aug 14 18:11:30 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:11:30 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:11:30 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:11:30 user nova-compute[73078]:   </cpu>
Aug 14 18:11:30 user nova-compute[73078]:   <devices>
Aug 14 18:11:30 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:11:30 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:11:30 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a/disk"/>
Aug 14 18:11:30 user nova-compute[73078]:       <target dev="sda" bus="scsi"/>
Aug 14 18:11:30 user nova-compute[73078]:       <address type="drive" controller="0" unit="0"/>
Aug 14 18:11:30 user nova-compute[73078]:     </disk>
Aug 14 18:11:30 user nova-compute[73078]:     <disk type="file" device="cdrom">
Aug 14 18:11:30 user nova-compute[73078]:       <driver name="qemu" type="raw" cache="none"/>
Aug 14 18:11:30 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a/disk.config"/>
Aug 14 18:11:30 user nova-compute[73078]:       <target dev="sdb" bus="scsi"/>
Aug 14 18:11:30 user nova-compute[73078]:       <address type="drive" controller="0" unit="1"/>
Aug 14 18:11:30 user nova-compute[73078]:     </disk>
Aug 14 18:11:30 user nova-compute[73078]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 14 18:11:30 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:11:30 user nova-compute[73078]:       <mac address="fa:16:3e:e5:43:d0"/>
Aug 14 18:11:30 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:11:30 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:11:30 user nova-compute[73078]:       <target dev="tap733825c5-07"/>
Aug 14 18:11:30 user nova-compute[73078]:     </interface>
Aug 14 18:11:30 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:11:30 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a/console.log" append="off"/>
Aug 14 18:11:30 user nova-compute[73078]:     </serial>
Aug 14 18:11:30 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:11:30 user nova-compute[73078]:     <video>
Aug 14 18:11:30 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:11:30 user nova-compute[73078]:     </video>
Aug 14 18:11:30 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:11:30 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:11:30 user nova-compute[73078]:     </rng>
Aug 14 18:11:30 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:11:30 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:11:30 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:11:30 user nova-compute[73078]:     </memballoon>
Aug 14 18:11:30 user nova-compute[73078]:   </devices>
Aug 14 18:11:30 user nova-compute[73078]: </domain>
Aug 14 18:11:30 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:11:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2062379060',display_name='tempest-AttachSCSIVolumeTestJSON-server-2062379060',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2062379060',id=7,image_ref='7df27413-ba0c-438f-9f0b-994325e5ab25',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5begJ0RpTUBw/BhoW7yA3Hl8+N5qtFQsI21CQInuxm9BUSoyfj7Y3GNhE37GUGawAca3iEnAVf6ncr6AJRwd6+6hticeA8Pa/igPXCOkR2HipnVX44Ub+Jy7QfRbAhUg==',key_name='tempest-keypair-1308980545',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff3894cf6eba466da26bad6c3bd978f7',ramdisk_id='',reservation_id='r-gsq12z9z',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7df27413-ba0c-438f-9f0b-994325e5ab25',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1163083945',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1163083945-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:11:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1cc41673ab284557a5f88bc6487a2ad2',uuid=0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "733825c5-0713-4980-9e5d-4a1120fb1598", "address": "fa:16:3e:e5:43:d0", "network": {"id": "3f423cdf-1eb1-4a1b-acf0-37ef2a8dfdca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1815766145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff3894cf6eba466da26bad6c3bd978f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap733825c5-07", "ovs_interfaceid": "733825c5-0713-4980-9e5d-4a1120fb1598", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Converting VIF {"id": "733825c5-0713-4980-9e5d-4a1120fb1598", "address": "fa:16:3e:e5:43:d0", "network": {"id": "3f423cdf-1eb1-4a1b-acf0-37ef2a8dfdca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1815766145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff3894cf6eba466da26bad6c3bd978f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap733825c5-07", "ovs_interfaceid": "733825c5-0713-4980-9e5d-4a1120fb1598", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:43:d0,bridge_name='br-int',has_traffic_filtering=True,id=733825c5-0713-4980-9e5d-4a1120fb1598,network=Network(3f423cdf-1eb1-4a1b-acf0-37ef2a8dfdca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap733825c5-07') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG os_vif [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:43:d0,bridge_name='br-int',has_traffic_filtering=True,id=733825c5-0713-4980-9e5d-4a1120fb1598,network=Network(3f423cdf-1eb1-4a1b-acf0-37ef2a8dfdca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap733825c5-07') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap733825c5-07, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap733825c5-07, col_values=(('external_ids', {'iface-id': '733825c5-0713-4980-9e5d-4a1120fb1598', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:43:d0', 'vm-uuid': '0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.compute.manager [req-d187409a-a8dc-4889-ba9c-16b38b5daa04 req-3298d7da-d54c-4747-a497-2795bb122a4d service nova] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Received event network-changed-733825c5-0713-4980-9e5d-4a1120fb1598 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.compute.manager [req-d187409a-a8dc-4889-ba9c-16b38b5daa04 req-3298d7da-d54c-4747-a497-2795bb122a4d service nova] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Refreshing instance network info cache due to event network-changed-733825c5-0713-4980-9e5d-4a1120fb1598. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d187409a-a8dc-4889-ba9c-16b38b5daa04 req-3298d7da-d54c-4747-a497-2795bb122a4d service nova] Acquiring lock "refresh_cache-0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d187409a-a8dc-4889-ba9c-16b38b5daa04 req-3298d7da-d54c-4747-a497-2795bb122a4d service nova] Acquired lock "refresh_cache-0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.network.neutron [req-d187409a-a8dc-4889-ba9c-16b38b5daa04 req-3298d7da-d54c-4747-a497-2795bb122a4d service nova] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Refreshing network info cache for port 733825c5-0713-4980-9e5d-4a1120fb1598 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:11:30 user nova-compute[73078]: INFO os_vif [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:43:d0,bridge_name='br-int',has_traffic_filtering=True,id=733825c5-0713-4980-9e5d-4a1120fb1598,network=Network(3f423cdf-1eb1-4a1b-acf0-37ef2a8dfdca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap733825c5-07')
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.compute.manager [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:11:30 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Creating image(s)
Aug 14 18:11:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Acquiring lock "/opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lock "/opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lock "/opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.network.neutron [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Successfully updated port: a8a4ff9c-da83-430a-aa65-d8eaf189416e {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] No BDM found with device name sda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] No VIF found with MAC fa:16:3e:e5:43:d0, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:11:30 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Using config drive
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.compute.manager [req-153334f4-6dda-44cc-bf2d-43f65a1da06f req-0956bc4a-6eca-433b-91c0-139e4343b370 service nova] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Received event network-changed-a8a4ff9c-da83-430a-aa65-d8eaf189416e {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.compute.manager [req-153334f4-6dda-44cc-bf2d-43f65a1da06f req-0956bc4a-6eca-433b-91c0-139e4343b370 service nova] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Refreshing instance network info cache due to event network-changed-a8a4ff9c-da83-430a-aa65-d8eaf189416e. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-153334f4-6dda-44cc-bf2d-43f65a1da06f req-0956bc4a-6eca-433b-91c0-139e4343b370 service nova] Acquiring lock "refresh_cache-b97b330e-7a72-4d3c-8810-98a4f3a27ce7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-153334f4-6dda-44cc-bf2d-43f65a1da06f req-0956bc4a-6eca-433b-91c0-139e4343b370 service nova] Acquired lock "refresh_cache-b97b330e-7a72-4d3c-8810-98a4f3a27ce7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG nova.network.neutron [req-153334f4-6dda-44cc-bf2d-43f65a1da06f req-0956bc4a-6eca-433b-91c0-139e4343b370 service nova] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Refreshing network info cache for port a8a4ff9c-da83-430a-aa65-d8eaf189416e {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Acquiring lock "refresh_cache-b97b330e-7a72-4d3c-8810-98a4f3a27ce7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.268s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:31 user nova-compute[73078]: DEBUG nova.network.neutron [req-153334f4-6dda-44cc-bf2d-43f65a1da06f req-0956bc4a-6eca-433b-91c0-139e4343b370 service nova] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:11:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.215s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:31 user nova-compute[73078]: DEBUG nova.network.neutron [req-153334f4-6dda-44cc-bf2d-43f65a1da06f req-0956bc4a-6eca-433b-91c0-139e4343b370 service nova] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:11:31 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:11:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-153334f4-6dda-44cc-bf2d-43f65a1da06f req-0956bc4a-6eca-433b-91c0-139e4343b370 service nova] Releasing lock "refresh_cache-b97b330e-7a72-4d3c-8810-98a4f3a27ce7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:11:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Acquired lock "refresh_cache-b97b330e-7a72-4d3c-8810-98a4f3a27ce7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:11:31 user nova-compute[73078]: DEBUG nova.network.neutron [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:11:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/disk 1073741824" returned: 0 in 0.461s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.680s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:31 user nova-compute[73078]: DEBUG nova.policy [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '218142bc464f4083b053a755d818afca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a3016859146b4b30ae80e5fae6e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:11:31 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:11:31 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Creating config drive at /opt/stack/data/nova/instances/0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a/disk.config
Aug 14 18:11:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptit9snyz {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.624s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:31 user nova-compute[73078]: DEBUG nova.compute.manager [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:11:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptit9snyz" returned: 0 in 0.116s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.274s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:31 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:11:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:31 user nova-compute[73078]: DEBUG nova.network.neutron [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.compute.manager [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.network.neutron [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:11:32 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:11:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.compute.manager [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/disk --force-share --output=json" returned: 0 in 0.322s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Cannot resize image /opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.objects.instance [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lazy-loading 'migration_context' on Instance uuid ad1d1145-1a70-4a9c-b563-6bda437dc0cc {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Ensure instance console log exists: /opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.network.neutron [req-dd8f1b66-869f-4069-a270-c40ba2e4bf62 req-affff365-7ef6-4a15-808c-098914f667f6 service nova] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Updated VIF entry in instance network info cache for port 0e2c0a61-c9ce-49a5-891d-97803d8557e1. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.network.neutron [req-dd8f1b66-869f-4069-a270-c40ba2e4bf62 req-affff365-7ef6-4a15-808c-098914f667f6 service nova] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Updating instance_info_cache with network_info: [{"id": "0e2c0a61-c9ce-49a5-891d-97803d8557e1", "address": "fa:16:3e:63:16:7b", "network": {"id": "bcbb9361-92bf-48f3-9d61-e5cdb5d21980", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1013223391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d0d923a445747d8a812c1b7b4510398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e2c0a61-c9", "ovs_interfaceid": "0e2c0a61-c9ce-49a5-891d-97803d8557e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.compute.manager [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:11:32 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Creating image(s)
Aug 14 18:11:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Acquiring lock "/opt/stack/data/nova/instances/e8ad453e-67b1-4af2-b85b-a5e100c11446/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Lock "/opt/stack/data/nova/instances/e8ad453e-67b1-4af2-b85b-a5e100c11446/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.006s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Lock "/opt/stack/data/nova/instances/e8ad453e-67b1-4af2-b85b-a5e100c11446/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-dd8f1b66-869f-4069-a270-c40ba2e4bf62 req-affff365-7ef6-4a15-808c-098914f667f6 service nova] Releasing lock "refresh_cache-10f9d4a9-ee3f-45bd-95e4-edd4819dcf30" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.network.neutron [req-d187409a-a8dc-4889-ba9c-16b38b5daa04 req-3298d7da-d54c-4747-a497-2795bb122a4d service nova] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Updated VIF entry in instance network info cache for port 733825c5-0713-4980-9e5d-4a1120fb1598. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.network.neutron [req-d187409a-a8dc-4889-ba9c-16b38b5daa04 req-3298d7da-d54c-4747-a497-2795bb122a4d service nova] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Updating instance_info_cache with network_info: [{"id": "733825c5-0713-4980-9e5d-4a1120fb1598", "address": "fa:16:3e:e5:43:d0", "network": {"id": "3f423cdf-1eb1-4a1b-acf0-37ef2a8dfdca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1815766145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff3894cf6eba466da26bad6c3bd978f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap733825c5-07", "ovs_interfaceid": "733825c5-0713-4980-9e5d-4a1120fb1598", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d187409a-a8dc-4889-ba9c-16b38b5daa04 req-3298d7da-d54c-4747-a497-2795bb122a4d service nova] Releasing lock "refresh_cache-0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.network.neutron [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Updating instance_info_cache with network_info: [{"id": "a8a4ff9c-da83-430a-aa65-d8eaf189416e", "address": "fa:16:3e:5b:79:d0", "network": {"id": "2a3295c2-a3cc-40eb-858f-32f664e73d8f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1030215120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e318b0d535142f2989495f416995a1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a4ff9c-da", "ovs_interfaceid": "a8a4ff9c-da83-430a-aa65-d8eaf189416e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.299s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Releasing lock "refresh_cache-b97b330e-7a72-4d3c-8810-98a4f3a27ce7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.compute.manager [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Instance network_info: |[{"id": "a8a4ff9c-da83-430a-aa65-d8eaf189416e", "address": "fa:16:3e:5b:79:d0", "network": {"id": "2a3295c2-a3cc-40eb-858f-32f664e73d8f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1030215120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e318b0d535142f2989495f416995a1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a4ff9c-da", "ovs_interfaceid": "a8a4ff9c-da83-430a-aa65-d8eaf189416e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Start _get_guest_xml network_info=[{"id": "a8a4ff9c-da83-430a-aa65-d8eaf189416e", "address": "fa:16:3e:5b:79:d0", "network": {"id": "2a3295c2-a3cc-40eb-858f-32f664e73d8f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1030215120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e318b0d535142f2989495f416995a1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a4ff9c-da", "ovs_interfaceid": "a8a4ff9c-da83-430a-aa65-d8eaf189416e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:11:32 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:11:32 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-78896495',display_name='tempest-VolumesAssistedSnapshotsTest-server-78896495',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-78896495',id=9,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEe8mU50QsNZLPpOcn+22HXSWa2eB13BOVxZVx1mvVZfzXrZAf8I6+uo0CmMNQgJoL3LeSR7L87RS2NAVRRLisJjA/3hQ+MklNctbas3n3I/N8H8R3zSS1AoFnl2k/2PGQ==',key_name='tempest-keypair-1806011428',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e318b0d535142f2989495f416995a1b',ramdisk_id='',reservation_id='r-rbe50gm7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-678819927',owner_user_name='tempest-VolumesAssistedSnapshotsTest-678819927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:11:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f3e1886d42204be983df5b9b99cc3050',uuid=b97b330e-7a72-4d3c-8810-98a4f3a27ce7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8a4ff9c-da83-430a-aa65-d8eaf189416e", "address": "fa:16:3e:5b:79:d0", "network": {"id": "2a3295c2-a3cc-40eb-858f-32f664e73d8f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1030215120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e318b0d535142f2989495f416995a1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a4ff9c-da", "ovs_interfaceid": "a8a4ff9c-da83-430a-aa65-d8eaf189416e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Converting VIF {"id": "a8a4ff9c-da83-430a-aa65-d8eaf189416e", "address": "fa:16:3e:5b:79:d0", "network": {"id": "2a3295c2-a3cc-40eb-858f-32f664e73d8f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1030215120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e318b0d535142f2989495f416995a1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a4ff9c-da", "ovs_interfaceid": "a8a4ff9c-da83-430a-aa65-d8eaf189416e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:79:d0,bridge_name='br-int',has_traffic_filtering=True,id=a8a4ff9c-da83-430a-aa65-d8eaf189416e,network=Network(2a3295c2-a3cc-40eb-858f-32f664e73d8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8a4ff9c-da') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.objects.instance [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Lazy-loading 'pci_devices' on Instance uuid b97b330e-7a72-4d3c-8810-98a4f3a27ce7 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.policy [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dcd61cb2421c4613b2b13d1e03639f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db9e1b022b443dda66d26e1bf57e984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.compute.manager [req-53f6b0e0-d8f3-4ee8-9009-f9c46a55577e req-f22535a5-ae65-4b2a-a9ed-811e78565910 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Received event network-vif-plugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-53f6b0e0-d8f3-4ee8-9009-f9c46a55577e req-f22535a5-ae65-4b2a-a9ed-811e78565910 service nova] Acquiring lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-53f6b0e0-d8f3-4ee8-9009-f9c46a55577e req-f22535a5-ae65-4b2a-a9ed-811e78565910 service nova] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-53f6b0e0-d8f3-4ee8-9009-f9c46a55577e req-f22535a5-ae65-4b2a-a9ed-811e78565910 service nova] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.compute.manager [req-53f6b0e0-d8f3-4ee8-9009-f9c46a55577e req-f22535a5-ae65-4b2a-a9ed-811e78565910 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] No waiting events found dispatching network-vif-plugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:11:32 user nova-compute[73078]: WARNING nova.compute.manager [req-53f6b0e0-d8f3-4ee8-9009-f9c46a55577e req-f22535a5-ae65-4b2a-a9ed-811e78565910 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Received unexpected event network-vif-plugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 for instance with vm_state active and task_state None.
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:11:32 user nova-compute[73078]:   <uuid>b97b330e-7a72-4d3c-8810-98a4f3a27ce7</uuid>
Aug 14 18:11:32 user nova-compute[73078]:   <name>instance-00000009</name>
Aug 14 18:11:32 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:11:32 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:11:32 user nova-compute[73078]:   <metadata>
Aug 14 18:11:32 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:11:32 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:11:32 user nova-compute[73078]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-78896495</nova:name>
Aug 14 18:11:32 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:11:32</nova:creationTime>
Aug 14 18:11:32 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:11:32 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:11:32 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:11:32 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:11:32 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:11:32 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:11:32 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:11:32 user nova-compute[73078]:       <nova:owner>
Aug 14 18:11:32 user nova-compute[73078]:         <nova:user uuid="f3e1886d42204be983df5b9b99cc3050">tempest-VolumesAssistedSnapshotsTest-678819927-project-member</nova:user>
Aug 14 18:11:32 user nova-compute[73078]:         <nova:project uuid="1e318b0d535142f2989495f416995a1b">tempest-VolumesAssistedSnapshotsTest-678819927</nova:project>
Aug 14 18:11:32 user nova-compute[73078]:       </nova:owner>
Aug 14 18:11:32 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:11:32 user nova-compute[73078]:       <nova:ports>
Aug 14 18:11:32 user nova-compute[73078]:         <nova:port uuid="a8a4ff9c-da83-430a-aa65-d8eaf189416e">
Aug 14 18:11:32 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 18:11:32 user nova-compute[73078]:         </nova:port>
Aug 14 18:11:32 user nova-compute[73078]:       </nova:ports>
Aug 14 18:11:32 user nova-compute[73078]:     </nova:instance>
Aug 14 18:11:32 user nova-compute[73078]:   </metadata>
Aug 14 18:11:32 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:11:32 user nova-compute[73078]:     <system>
Aug 14 18:11:32 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:11:32 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:11:32 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:11:32 user nova-compute[73078]:       <entry name="serial">b97b330e-7a72-4d3c-8810-98a4f3a27ce7</entry>
Aug 14 18:11:32 user nova-compute[73078]:       <entry name="uuid">b97b330e-7a72-4d3c-8810-98a4f3a27ce7</entry>
Aug 14 18:11:32 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:11:32 user nova-compute[73078]:     </system>
Aug 14 18:11:32 user nova-compute[73078]:   </sysinfo>
Aug 14 18:11:32 user nova-compute[73078]:   <os>
Aug 14 18:11:32 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:11:32 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:11:32 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:11:32 user nova-compute[73078]:   </os>
Aug 14 18:11:32 user nova-compute[73078]:   <features>
Aug 14 18:11:32 user nova-compute[73078]:     <acpi/>
Aug 14 18:11:32 user nova-compute[73078]:     <apic/>
Aug 14 18:11:32 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:11:32 user nova-compute[73078]:   </features>
Aug 14 18:11:32 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:11:32 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:11:32 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:11:32 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:11:32 user nova-compute[73078]:   </clock>
Aug 14 18:11:32 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:11:32 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:11:32 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:11:32 user nova-compute[73078]:   </cpu>
Aug 14 18:11:32 user nova-compute[73078]:   <devices>
Aug 14 18:11:32 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:11:32 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:11:32 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/b97b330e-7a72-4d3c-8810-98a4f3a27ce7/disk"/>
Aug 14 18:11:32 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:11:32 user nova-compute[73078]:     </disk>
Aug 14 18:11:32 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:11:32 user nova-compute[73078]:       <mac address="fa:16:3e:5b:79:d0"/>
Aug 14 18:11:32 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:11:32 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:11:32 user nova-compute[73078]:       <target dev="tapa8a4ff9c-da"/>
Aug 14 18:11:32 user nova-compute[73078]:     </interface>
Aug 14 18:11:32 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:11:32 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/b97b330e-7a72-4d3c-8810-98a4f3a27ce7/console.log" append="off"/>
Aug 14 18:11:32 user nova-compute[73078]:     </serial>
Aug 14 18:11:32 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:11:32 user nova-compute[73078]:     <video>
Aug 14 18:11:32 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:11:32 user nova-compute[73078]:     </video>
Aug 14 18:11:32 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:11:32 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:11:32 user nova-compute[73078]:     </rng>
Aug 14 18:11:32 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:11:32 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:11:32 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:11:32 user nova-compute[73078]:     </memballoon>
Aug 14 18:11:32 user nova-compute[73078]:   </devices>
Aug 14 18:11:32 user nova-compute[73078]: </domain>
Aug 14 18:11:32 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-78896495',display_name='tempest-VolumesAssistedSnapshotsTest-server-78896495',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-78896495',id=9,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEe8mU50QsNZLPpOcn+22HXSWa2eB13BOVxZVx1mvVZfzXrZAf8I6+uo0CmMNQgJoL3LeSR7L87RS2NAVRRLisJjA/3hQ+MklNctbas3n3I/N8H8R3zSS1AoFnl2k/2PGQ==',key_name='tempest-keypair-1806011428',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e318b0d535142f2989495f416995a1b',ramdisk_id='',reservation_id='r-rbe50gm7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-678819927',owner_user_name='tempest-VolumesAssistedSnapshotsTest-678819927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:11:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f3e1886d42204be983df5b9b99cc3050',uuid=b97b330e-7a72-4d3c-8810-98a4f3a27ce7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8a4ff9c-da83-430a-aa65-d8eaf189416e", "address": "fa:16:3e:5b:79:d0", "network": {"id": "2a3295c2-a3cc-40eb-858f-32f664e73d8f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1030215120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e318b0d535142f2989495f416995a1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a4ff9c-da", "ovs_interfaceid": "a8a4ff9c-da83-430a-aa65-d8eaf189416e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Converting VIF {"id": "a8a4ff9c-da83-430a-aa65-d8eaf189416e", "address": "fa:16:3e:5b:79:d0", "network": {"id": "2a3295c2-a3cc-40eb-858f-32f664e73d8f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1030215120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e318b0d535142f2989495f416995a1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a4ff9c-da", "ovs_interfaceid": "a8a4ff9c-da83-430a-aa65-d8eaf189416e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:79:d0,bridge_name='br-int',has_traffic_filtering=True,id=a8a4ff9c-da83-430a-aa65-d8eaf189416e,network=Network(2a3295c2-a3cc-40eb-858f-32f664e73d8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8a4ff9c-da') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG os_vif [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:79:d0,bridge_name='br-int',has_traffic_filtering=True,id=a8a4ff9c-da83-430a-aa65-d8eaf189416e,network=Network(2a3295c2-a3cc-40eb-858f-32f664e73d8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8a4ff9c-da') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8a4ff9c-da, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa8a4ff9c-da, col_values=(('external_ids', {'iface-id': 'a8a4ff9c-da83-430a-aa65-d8eaf189416e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:79:d0', 'vm-uuid': 'b97b330e-7a72-4d3c-8810-98a4f3a27ce7'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:11:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:33 user nova-compute[73078]: INFO os_vif [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:79:d0,bridge_name='br-int',has_traffic_filtering=True,id=a8a4ff9c-da83-430a-aa65-d8eaf189416e,network=Network(2a3295c2-a3cc-40eb-858f-32f664e73d8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8a4ff9c-da')
Aug 14 18:11:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.298s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/e8ad453e-67b1-4af2-b85b-a5e100c11446/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:33 user nova-compute[73078]: DEBUG nova.compute.manager [req-fdbe2f03-16cc-42d4-b915-04c677ed0d51 req-cd16727d-992e-451d-b395-09e13b6efb85 service nova] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Received event network-vif-plugged-0e2c0a61-c9ce-49a5-891d-97803d8557e1 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:11:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-fdbe2f03-16cc-42d4-b915-04c677ed0d51 req-cd16727d-992e-451d-b395-09e13b6efb85 service nova] Acquiring lock "10f9d4a9-ee3f-45bd-95e4-edd4819dcf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-fdbe2f03-16cc-42d4-b915-04c677ed0d51 req-cd16727d-992e-451d-b395-09e13b6efb85 service nova] Lock "10f9d4a9-ee3f-45bd-95e4-edd4819dcf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-fdbe2f03-16cc-42d4-b915-04c677ed0d51 req-cd16727d-992e-451d-b395-09e13b6efb85 service nova] Lock "10f9d4a9-ee3f-45bd-95e4-edd4819dcf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:33 user nova-compute[73078]: DEBUG nova.compute.manager [req-fdbe2f03-16cc-42d4-b915-04c677ed0d51 req-cd16727d-992e-451d-b395-09e13b6efb85 service nova] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] No waiting events found dispatching network-vif-plugged-0e2c0a61-c9ce-49a5-891d-97803d8557e1 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:11:33 user nova-compute[73078]: WARNING nova.compute.manager [req-fdbe2f03-16cc-42d4-b915-04c677ed0d51 req-cd16727d-992e-451d-b395-09e13b6efb85 service nova] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Received unexpected event network-vif-plugged-0e2c0a61-c9ce-49a5-891d-97803d8557e1 for instance with vm_state building and task_state spawning.
Aug 14 18:11:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/e8ad453e-67b1-4af2-b85b-a5e100c11446/disk 1073741824" returned: 0 in 0.238s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.539s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:33 user nova-compute[73078]: DEBUG nova.network.neutron [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Successfully created port: b1c66b74-5403-4bfb-9826-7d95c1e92356 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:11:33 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:11:33 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] No VIF found with MAC fa:16:3e:5b:79:d0, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:11:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.209s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:33 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e8ad453e-67b1-4af2-b85b-a5e100c11446/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:11:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8ad453e-67b1-4af2-b85b-a5e100c11446/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8ad453e-67b1-4af2-b85b-a5e100c11446/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:33 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Cannot resize image /opt/stack/data/nova/instances/e8ad453e-67b1-4af2-b85b-a5e100c11446/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:11:33 user nova-compute[73078]: DEBUG nova.objects.instance [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Lazy-loading 'migration_context' on Instance uuid e8ad453e-67b1-4af2-b85b-a5e100c11446 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:11:33 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:11:33 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Ensure instance console log exists: /opt/stack/data/nova/instances/e8ad453e-67b1-4af2-b85b-a5e100c11446/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:11:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:34 user nova-compute[73078]: DEBUG nova.network.neutron [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Successfully created port: 90186594-310a-4bfa-8593-6a6f54bb2b9b {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:11:34 user nova-compute[73078]: DEBUG nova.network.neutron [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Successfully updated port: b1c66b74-5403-4bfb-9826-7d95c1e92356 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:11:34 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Acquiring lock "refresh_cache-ad1d1145-1a70-4a9c-b563-6bda437dc0cc" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:11:34 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Acquired lock "refresh_cache-ad1d1145-1a70-4a9c-b563-6bda437dc0cc" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:11:34 user nova-compute[73078]: DEBUG nova.network.neutron [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:11:34 user nova-compute[73078]: DEBUG nova.compute.manager [req-9bcec6d9-13b3-4681-bc5d-aa8f049203d8 req-88b1521b-88cf-4930-b914-360ce1b987df service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Received event network-changed-b1c66b74-5403-4bfb-9826-7d95c1e92356 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:11:34 user nova-compute[73078]: DEBUG nova.compute.manager [req-9bcec6d9-13b3-4681-bc5d-aa8f049203d8 req-88b1521b-88cf-4930-b914-360ce1b987df service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Refreshing instance network info cache due to event network-changed-b1c66b74-5403-4bfb-9826-7d95c1e92356. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:11:34 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9bcec6d9-13b3-4681-bc5d-aa8f049203d8 req-88b1521b-88cf-4930-b914-360ce1b987df service nova] Acquiring lock "refresh_cache-ad1d1145-1a70-4a9c-b563-6bda437dc0cc" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.compute.manager [req-e22c3339-8b93-4752-8841-a10641f3abca req-9accdae3-7d3b-44a1-a1b2-1279381817a1 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Received event network-vif-plugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e22c3339-8b93-4752-8841-a10641f3abca req-9accdae3-7d3b-44a1-a1b2-1279381817a1 service nova] Acquiring lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e22c3339-8b93-4752-8841-a10641f3abca req-9accdae3-7d3b-44a1-a1b2-1279381817a1 service nova] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e22c3339-8b93-4752-8841-a10641f3abca req-9accdae3-7d3b-44a1-a1b2-1279381817a1 service nova] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.compute.manager [req-e22c3339-8b93-4752-8841-a10641f3abca req-9accdae3-7d3b-44a1-a1b2-1279381817a1 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] No waiting events found dispatching network-vif-plugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:11:35 user nova-compute[73078]: WARNING nova.compute.manager [req-e22c3339-8b93-4752-8841-a10641f3abca req-9accdae3-7d3b-44a1-a1b2-1279381817a1 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Received unexpected event network-vif-plugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 for instance with vm_state active and task_state None.
Aug 14 18:11:35 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.network.neutron [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.network.neutron [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Successfully updated port: 90186594-310a-4bfa-8593-6a6f54bb2b9b {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Acquiring lock "refresh_cache-e8ad453e-67b1-4af2-b85b-a5e100c11446" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Acquired lock "refresh_cache-e8ad453e-67b1-4af2-b85b-a5e100c11446" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.network.neutron [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.compute.manager [req-18b7a351-f2ba-4586-a5f0-e4053e5c3660 req-d93017c8-658f-4af7-8b14-0b6df3ffe0f4 service nova] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Received event network-vif-plugged-0e2c0a61-c9ce-49a5-891d-97803d8557e1 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-18b7a351-f2ba-4586-a5f0-e4053e5c3660 req-d93017c8-658f-4af7-8b14-0b6df3ffe0f4 service nova] Acquiring lock "10f9d4a9-ee3f-45bd-95e4-edd4819dcf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-18b7a351-f2ba-4586-a5f0-e4053e5c3660 req-d93017c8-658f-4af7-8b14-0b6df3ffe0f4 service nova] Lock "10f9d4a9-ee3f-45bd-95e4-edd4819dcf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-18b7a351-f2ba-4586-a5f0-e4053e5c3660 req-d93017c8-658f-4af7-8b14-0b6df3ffe0f4 service nova] Lock "10f9d4a9-ee3f-45bd-95e4-edd4819dcf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.compute.manager [req-18b7a351-f2ba-4586-a5f0-e4053e5c3660 req-d93017c8-658f-4af7-8b14-0b6df3ffe0f4 service nova] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] No waiting events found dispatching network-vif-plugged-0e2c0a61-c9ce-49a5-891d-97803d8557e1 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:11:35 user nova-compute[73078]: WARNING nova.compute.manager [req-18b7a351-f2ba-4586-a5f0-e4053e5c3660 req-d93017c8-658f-4af7-8b14-0b6df3ffe0f4 service nova] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Received unexpected event network-vif-plugged-0e2c0a61-c9ce-49a5-891d-97803d8557e1 for instance with vm_state building and task_state spawning.
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.compute.manager [req-18b7a351-f2ba-4586-a5f0-e4053e5c3660 req-d93017c8-658f-4af7-8b14-0b6df3ffe0f4 service nova] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Received event network-changed-90186594-310a-4bfa-8593-6a6f54bb2b9b {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.compute.manager [req-18b7a351-f2ba-4586-a5f0-e4053e5c3660 req-d93017c8-658f-4af7-8b14-0b6df3ffe0f4 service nova] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Refreshing instance network info cache due to event network-changed-90186594-310a-4bfa-8593-6a6f54bb2b9b. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-18b7a351-f2ba-4586-a5f0-e4053e5c3660 req-d93017c8-658f-4af7-8b14-0b6df3ffe0f4 service nova] Acquiring lock "refresh_cache-e8ad453e-67b1-4af2-b85b-a5e100c11446" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.network.neutron [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.network.neutron [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Updating instance_info_cache with network_info: [{"id": "90186594-310a-4bfa-8593-6a6f54bb2b9b", "address": "fa:16:3e:2d:b8:f6", "network": {"id": "da640f78-a5e9-4ca4-9daa-cbe9f39866a7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1049608594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3db9e1b022b443dda66d26e1bf57e984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90186594-31", "ovs_interfaceid": "90186594-310a-4bfa-8593-6a6f54bb2b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Releasing lock "refresh_cache-e8ad453e-67b1-4af2-b85b-a5e100c11446" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.compute.manager [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Instance network_info: |[{"id": "90186594-310a-4bfa-8593-6a6f54bb2b9b", "address": "fa:16:3e:2d:b8:f6", "network": {"id": "da640f78-a5e9-4ca4-9daa-cbe9f39866a7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1049608594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3db9e1b022b443dda66d26e1bf57e984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90186594-31", "ovs_interfaceid": "90186594-310a-4bfa-8593-6a6f54bb2b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-18b7a351-f2ba-4586-a5f0-e4053e5c3660 req-d93017c8-658f-4af7-8b14-0b6df3ffe0f4 service nova] Acquired lock "refresh_cache-e8ad453e-67b1-4af2-b85b-a5e100c11446" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.network.neutron [req-18b7a351-f2ba-4586-a5f0-e4053e5c3660 req-d93017c8-658f-4af7-8b14-0b6df3ffe0f4 service nova] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Refreshing network info cache for port 90186594-310a-4bfa-8593-6a6f54bb2b9b {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Start _get_guest_xml network_info=[{"id": "90186594-310a-4bfa-8593-6a6f54bb2b9b", "address": "fa:16:3e:2d:b8:f6", "network": {"id": "da640f78-a5e9-4ca4-9daa-cbe9f39866a7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1049608594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3db9e1b022b443dda66d26e1bf57e984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90186594-31", "ovs_interfaceid": "90186594-310a-4bfa-8593-6a6f54bb2b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.network.neutron [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Updating instance_info_cache with network_info: [{"id": "b1c66b74-5403-4bfb-9826-7d95c1e92356", "address": "fa:16:3e:56:c1:dd", "network": {"id": "371d3de4-ece5-41b8-8adc-277ac218f7ee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1480740037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a49a3016859146b4b30ae80e5fae6e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c66b74-54", "ovs_interfaceid": "b1c66b74-5403-4bfb-9826-7d95c1e92356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:11:35 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:11:35 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:11:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Releasing lock "refresh_cache-ad1d1145-1a70-4a9c-b563-6bda437dc0cc" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.compute.manager [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Instance network_info: |[{"id": "b1c66b74-5403-4bfb-9826-7d95c1e92356", "address": "fa:16:3e:56:c1:dd", "network": {"id": "371d3de4-ece5-41b8-8adc-277ac218f7ee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1480740037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a49a3016859146b4b30ae80e5fae6e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c66b74-54", "ovs_interfaceid": "b1c66b74-5403-4bfb-9826-7d95c1e92356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9bcec6d9-13b3-4681-bc5d-aa8f049203d8 req-88b1521b-88cf-4930-b914-360ce1b987df service nova] Acquired lock "refresh_cache-ad1d1145-1a70-4a9c-b563-6bda437dc0cc" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.network.neutron [req-9bcec6d9-13b3-4681-bc5d-aa8f049203d8 req-88b1521b-88cf-4930-b914-360ce1b987df service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Refreshing network info cache for port b1c66b74-5403-4bfb-9826-7d95c1e92356 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Start _get_guest_xml network_info=[{"id": "b1c66b74-5403-4bfb-9826-7d95c1e92356", "address": "fa:16:3e:56:c1:dd", "network": {"id": "371d3de4-ece5-41b8-8adc-277ac218f7ee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1480740037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a49a3016859146b4b30ae80e5fae6e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c66b74-54", "ovs_interfaceid": "b1c66b74-5403-4bfb-9826-7d95c1e92356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:11:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1932067530',display_name='tempest-TestVolumeSwap-server-1932067530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1932067530',id=11,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1qD74k+0A+CGZH4FmLSk7pczeoOLYVT4w4voMOha8WcIJ0XkevKDGlOWb/p8s4XbdwrPYPr3ffaebu8wIFk0SP0izdJHS5i48ERdCP8s5M5lQ8m6wuzGM3RTuHiR96BA==',key_name='tempest-keypair-220951710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3db9e1b022b443dda66d26e1bf57e984',ramdisk_id='',reservation_id='r-81nzjlca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-353943783',owner_user_name='tempest-TestVolumeSwap-353943783-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:11:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcd61cb2421c4613b2b13d1e03639f0c',uuid=e8ad453e-67b1-4af2-b85b-a5e100c11446,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90186594-310a-4bfa-8593-6a6f54bb2b9b", "address": "fa:16:3e:2d:b8:f6", "network": {"id": "da640f78-a5e9-4ca4-9daa-cbe9f39866a7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1049608594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3db9e1b022b443dda66d26e1bf57e984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90186594-31", "ovs_interfaceid": "90186594-310a-4bfa-8593-6a6f54bb2b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Converting VIF {"id": "90186594-310a-4bfa-8593-6a6f54bb2b9b", "address": "fa:16:3e:2d:b8:f6", "network": {"id": "da640f78-a5e9-4ca4-9daa-cbe9f39866a7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1049608594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3db9e1b022b443dda66d26e1bf57e984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90186594-31", "ovs_interfaceid": "90186594-310a-4bfa-8593-6a6f54bb2b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:b8:f6,bridge_name='br-int',has_traffic_filtering=True,id=90186594-310a-4bfa-8593-6a6f54bb2b9b,network=Network(da640f78-a5e9-4ca4-9daa-cbe9f39866a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90186594-31') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.objects.instance [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Lazy-loading 'pci_devices' on Instance uuid e8ad453e-67b1-4af2-b85b-a5e100c11446 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:11:35 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:11:35 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:11:35 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:11:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-954582950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-954582950',id=10,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoZf8Rqz7EiN0P+Qjv1ph9KYV+Un7MKTbl1dwK14KSEc1xx5BX1LfWxWzRq6aPqPl/92nhScUmx3GJQuV5xlN5gzpJdNxWJ8eHGLQ/HA+DwQ8SXejqjnnPB+yC1+OGwhQ==',key_name='tempest-keypair-1334960197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a49a3016859146b4b30ae80e5fae6e31',ramdisk_id='',reservation_id='r-cn5ox3sk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1236088660',owner_user_name='tempest-TaggedAttachmentsTest-1236088660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:11:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='218142bc464f4083b053a755d818afca',uuid=ad1d1145-1a70-4a9c-b563-6bda437dc0cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1c66b74-5403-4bfb-9826-7d95c1e92356", "address": "fa:16:3e:56:c1:dd", "network": {"id": "371d3de4-ece5-41b8-8adc-277ac218f7ee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1480740037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a49a3016859146b4b30ae80e5fae6e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c66b74-54", "ovs_interfaceid": "b1c66b74-5403-4bfb-9826-7d95c1e92356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Converting VIF {"id": "b1c66b74-5403-4bfb-9826-7d95c1e92356", "address": "fa:16:3e:56:c1:dd", "network": {"id": "371d3de4-ece5-41b8-8adc-277ac218f7ee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1480740037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a49a3016859146b4b30ae80e5fae6e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c66b74-54", "ovs_interfaceid": "b1c66b74-5403-4bfb-9826-7d95c1e92356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:c1:dd,bridge_name='br-int',has_traffic_filtering=True,id=b1c66b74-5403-4bfb-9826-7d95c1e92356,network=Network(371d3de4-ece5-41b8-8adc-277ac218f7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c66b74-54') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG nova.objects.instance [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lazy-loading 'pci_devices' on Instance uuid ad1d1145-1a70-4a9c-b563-6bda437dc0cc {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:11:36 user nova-compute[73078]:   <uuid>e8ad453e-67b1-4af2-b85b-a5e100c11446</uuid>
Aug 14 18:11:36 user nova-compute[73078]:   <name>instance-0000000b</name>
Aug 14 18:11:36 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:11:36 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:11:36 user nova-compute[73078]:   <metadata>
Aug 14 18:11:36 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:11:36 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:11:36 user nova-compute[73078]:       <nova:name>tempest-TestVolumeSwap-server-1932067530</nova:name>
Aug 14 18:11:36 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:11:35</nova:creationTime>
Aug 14 18:11:36 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:11:36 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:11:36 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:11:36 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:11:36 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:11:36 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:11:36 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:11:36 user nova-compute[73078]:       <nova:owner>
Aug 14 18:11:36 user nova-compute[73078]:         <nova:user uuid="dcd61cb2421c4613b2b13d1e03639f0c">tempest-TestVolumeSwap-353943783-project-member</nova:user>
Aug 14 18:11:36 user nova-compute[73078]:         <nova:project uuid="3db9e1b022b443dda66d26e1bf57e984">tempest-TestVolumeSwap-353943783</nova:project>
Aug 14 18:11:36 user nova-compute[73078]:       </nova:owner>
Aug 14 18:11:36 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:11:36 user nova-compute[73078]:       <nova:ports>
Aug 14 18:11:36 user nova-compute[73078]:         <nova:port uuid="90186594-310a-4bfa-8593-6a6f54bb2b9b">
Aug 14 18:11:36 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 18:11:36 user nova-compute[73078]:         </nova:port>
Aug 14 18:11:36 user nova-compute[73078]:       </nova:ports>
Aug 14 18:11:36 user nova-compute[73078]:     </nova:instance>
Aug 14 18:11:36 user nova-compute[73078]:   </metadata>
Aug 14 18:11:36 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:11:36 user nova-compute[73078]:     <system>
Aug 14 18:11:36 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:11:36 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:11:36 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:11:36 user nova-compute[73078]:       <entry name="serial">e8ad453e-67b1-4af2-b85b-a5e100c11446</entry>
Aug 14 18:11:36 user nova-compute[73078]:       <entry name="uuid">e8ad453e-67b1-4af2-b85b-a5e100c11446</entry>
Aug 14 18:11:36 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:11:36 user nova-compute[73078]:     </system>
Aug 14 18:11:36 user nova-compute[73078]:   </sysinfo>
Aug 14 18:11:36 user nova-compute[73078]:   <os>
Aug 14 18:11:36 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:11:36 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:11:36 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:11:36 user nova-compute[73078]:   </os>
Aug 14 18:11:36 user nova-compute[73078]:   <features>
Aug 14 18:11:36 user nova-compute[73078]:     <acpi/>
Aug 14 18:11:36 user nova-compute[73078]:     <apic/>
Aug 14 18:11:36 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:11:36 user nova-compute[73078]:   </features>
Aug 14 18:11:36 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:11:36 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:11:36 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:11:36 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:11:36 user nova-compute[73078]:   </clock>
Aug 14 18:11:36 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:11:36 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:11:36 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:11:36 user nova-compute[73078]:   </cpu>
Aug 14 18:11:36 user nova-compute[73078]:   <devices>
Aug 14 18:11:36 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:11:36 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:11:36 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/e8ad453e-67b1-4af2-b85b-a5e100c11446/disk"/>
Aug 14 18:11:36 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:11:36 user nova-compute[73078]:     </disk>
Aug 14 18:11:36 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:11:36 user nova-compute[73078]:       <mac address="fa:16:3e:2d:b8:f6"/>
Aug 14 18:11:36 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:11:36 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:11:36 user nova-compute[73078]:       <target dev="tap90186594-31"/>
Aug 14 18:11:36 user nova-compute[73078]:     </interface>
Aug 14 18:11:36 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:11:36 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/e8ad453e-67b1-4af2-b85b-a5e100c11446/console.log" append="off"/>
Aug 14 18:11:36 user nova-compute[73078]:     </serial>
Aug 14 18:11:36 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:11:36 user nova-compute[73078]:     <video>
Aug 14 18:11:36 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:11:36 user nova-compute[73078]:     </video>
Aug 14 18:11:36 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:11:36 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:11:36 user nova-compute[73078]:     </rng>
Aug 14 18:11:36 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:11:36 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:11:36 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:11:36 user nova-compute[73078]:     </memballoon>
Aug 14 18:11:36 user nova-compute[73078]:   </devices>
Aug 14 18:11:36 user nova-compute[73078]: </domain>
Aug 14 18:11:36 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:11:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1932067530',display_name='tempest-TestVolumeSwap-server-1932067530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1932067530',id=11,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1qD74k+0A+CGZH4FmLSk7pczeoOLYVT4w4voMOha8WcIJ0XkevKDGlOWb/p8s4XbdwrPYPr3ffaebu8wIFk0SP0izdJHS5i48ERdCP8s5M5lQ8m6wuzGM3RTuHiR96BA==',key_name='tempest-keypair-220951710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3db9e1b022b443dda66d26e1bf57e984',ramdisk_id='',reservation_id='r-81nzjlca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-353943783',owner_user_name='tempest-TestVolumeSwap-353943783-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:11:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcd61cb2421c4613b2b13d1e03639f0c',uuid=e8ad453e-67b1-4af2-b85b-a5e100c11446,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90186594-310a-4bfa-8593-6a6f54bb2b9b", "address": "fa:16:3e:2d:b8:f6", "network": {"id": "da640f78-a5e9-4ca4-9daa-cbe9f39866a7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1049608594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3db9e1b022b443dda66d26e1bf57e984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90186594-31", "ovs_interfaceid": "90186594-310a-4bfa-8593-6a6f54bb2b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Converting VIF {"id": "90186594-310a-4bfa-8593-6a6f54bb2b9b", "address": "fa:16:3e:2d:b8:f6", "network": {"id": "da640f78-a5e9-4ca4-9daa-cbe9f39866a7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1049608594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3db9e1b022b443dda66d26e1bf57e984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90186594-31", "ovs_interfaceid": "90186594-310a-4bfa-8593-6a6f54bb2b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:b8:f6,bridge_name='br-int',has_traffic_filtering=True,id=90186594-310a-4bfa-8593-6a6f54bb2b9b,network=Network(da640f78-a5e9-4ca4-9daa-cbe9f39866a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90186594-31') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG os_vif [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:b8:f6,bridge_name='br-int',has_traffic_filtering=True,id=90186594-310a-4bfa-8593-6a6f54bb2b9b,network=Network(da640f78-a5e9-4ca4-9daa-cbe9f39866a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90186594-31') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90186594-31, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap90186594-31, col_values=(('external_ids', {'iface-id': '90186594-310a-4bfa-8593-6a6f54bb2b9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:b8:f6', 'vm-uuid': 'e8ad453e-67b1-4af2-b85b-a5e100c11446'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:11:36 user nova-compute[73078]:   <uuid>ad1d1145-1a70-4a9c-b563-6bda437dc0cc</uuid>
Aug 14 18:11:36 user nova-compute[73078]:   <name>instance-0000000a</name>
Aug 14 18:11:36 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:11:36 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:11:36 user nova-compute[73078]:   <metadata>
Aug 14 18:11:36 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:11:36 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:11:36 user nova-compute[73078]:       <nova:name>tempest-device-tagging-server-954582950</nova:name>
Aug 14 18:11:36 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:11:35</nova:creationTime>
Aug 14 18:11:36 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:11:36 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:11:36 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:11:36 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:11:36 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:11:36 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:11:36 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:11:36 user nova-compute[73078]:       <nova:owner>
Aug 14 18:11:36 user nova-compute[73078]:         <nova:user uuid="218142bc464f4083b053a755d818afca">tempest-TaggedAttachmentsTest-1236088660-project-member</nova:user>
Aug 14 18:11:36 user nova-compute[73078]:         <nova:project uuid="a49a3016859146b4b30ae80e5fae6e31">tempest-TaggedAttachmentsTest-1236088660</nova:project>
Aug 14 18:11:36 user nova-compute[73078]:       </nova:owner>
Aug 14 18:11:36 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:11:36 user nova-compute[73078]:       <nova:ports>
Aug 14 18:11:36 user nova-compute[73078]:         <nova:port uuid="b1c66b74-5403-4bfb-9826-7d95c1e92356">
Aug 14 18:11:36 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 18:11:36 user nova-compute[73078]:         </nova:port>
Aug 14 18:11:36 user nova-compute[73078]:       </nova:ports>
Aug 14 18:11:36 user nova-compute[73078]:     </nova:instance>
Aug 14 18:11:36 user nova-compute[73078]:   </metadata>
Aug 14 18:11:36 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:11:36 user nova-compute[73078]:     <system>
Aug 14 18:11:36 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:11:36 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:11:36 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:11:36 user nova-compute[73078]:       <entry name="serial">ad1d1145-1a70-4a9c-b563-6bda437dc0cc</entry>
Aug 14 18:11:36 user nova-compute[73078]:       <entry name="uuid">ad1d1145-1a70-4a9c-b563-6bda437dc0cc</entry>
Aug 14 18:11:36 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:11:36 user nova-compute[73078]:     </system>
Aug 14 18:11:36 user nova-compute[73078]:   </sysinfo>
Aug 14 18:11:36 user nova-compute[73078]:   <os>
Aug 14 18:11:36 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:11:36 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:11:36 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:11:36 user nova-compute[73078]:   </os>
Aug 14 18:11:36 user nova-compute[73078]:   <features>
Aug 14 18:11:36 user nova-compute[73078]:     <acpi/>
Aug 14 18:11:36 user nova-compute[73078]:     <apic/>
Aug 14 18:11:36 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:11:36 user nova-compute[73078]:   </features>
Aug 14 18:11:36 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:11:36 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:11:36 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:11:36 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:11:36 user nova-compute[73078]:   </clock>
Aug 14 18:11:36 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:11:36 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:11:36 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:11:36 user nova-compute[73078]:   </cpu>
Aug 14 18:11:36 user nova-compute[73078]:   <devices>
Aug 14 18:11:36 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:11:36 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:11:36 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/disk"/>
Aug 14 18:11:36 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:11:36 user nova-compute[73078]:     </disk>
Aug 14 18:11:36 user nova-compute[73078]:     <disk type="file" device="cdrom">
Aug 14 18:11:36 user nova-compute[73078]:       <driver name="qemu" type="raw" cache="none"/>
Aug 14 18:11:36 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/disk.config"/>
Aug 14 18:11:36 user nova-compute[73078]:       <target dev="hda" bus="ide"/>
Aug 14 18:11:36 user nova-compute[73078]:     </disk>
Aug 14 18:11:36 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:11:36 user nova-compute[73078]:       <mac address="fa:16:3e:56:c1:dd"/>
Aug 14 18:11:36 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:11:36 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:11:36 user nova-compute[73078]:       <target dev="tapb1c66b74-54"/>
Aug 14 18:11:36 user nova-compute[73078]:     </interface>
Aug 14 18:11:36 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:11:36 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/console.log" append="off"/>
Aug 14 18:11:36 user nova-compute[73078]:     </serial>
Aug 14 18:11:36 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:11:36 user nova-compute[73078]:     <video>
Aug 14 18:11:36 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:11:36 user nova-compute[73078]:     </video>
Aug 14 18:11:36 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:11:36 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:11:36 user nova-compute[73078]:     </rng>
Aug 14 18:11:36 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:11:36 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:11:36 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:11:36 user nova-compute[73078]:     </memballoon>
Aug 14 18:11:36 user nova-compute[73078]:   </devices>
Aug 14 18:11:36 user nova-compute[73078]: </domain>
Aug 14 18:11:36 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:11:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-954582950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-954582950',id=10,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoZf8Rqz7EiN0P+Qjv1ph9KYV+Un7MKTbl1dwK14KSEc1xx5BX1LfWxWzRq6aPqPl/92nhScUmx3GJQuV5xlN5gzpJdNxWJ8eHGLQ/HA+DwQ8SXejqjnnPB+yC1+OGwhQ==',key_name='tempest-keypair-1334960197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a49a3016859146b4b30ae80e5fae6e31',ramdisk_id='',reservation_id='r-cn5ox3sk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1236088660',owner_user_name='tempest-TaggedAttachmentsTest-1236088660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:11:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='218142bc464f4083b053a755d818afca',uuid=ad1d1145-1a70-4a9c-b563-6bda437dc0cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1c66b74-5403-4bfb-9826-7d95c1e92356", "address": "fa:16:3e:56:c1:dd", "network": {"id": "371d3de4-ece5-41b8-8adc-277ac218f7ee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1480740037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a49a3016859146b4b30ae80e5fae6e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c66b74-54", "ovs_interfaceid": "b1c66b74-5403-4bfb-9826-7d95c1e92356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Converting VIF {"id": "b1c66b74-5403-4bfb-9826-7d95c1e92356", "address": "fa:16:3e:56:c1:dd", "network": {"id": "371d3de4-ece5-41b8-8adc-277ac218f7ee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1480740037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a49a3016859146b4b30ae80e5fae6e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c66b74-54", "ovs_interfaceid": "b1c66b74-5403-4bfb-9826-7d95c1e92356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:c1:dd,bridge_name='br-int',has_traffic_filtering=True,id=b1c66b74-5403-4bfb-9826-7d95c1e92356,network=Network(371d3de4-ece5-41b8-8adc-277ac218f7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c66b74-54') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG os_vif [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:c1:dd,bridge_name='br-int',has_traffic_filtering=True,id=b1c66b74-5403-4bfb-9826-7d95c1e92356,network=Network(371d3de4-ece5-41b8-8adc-277ac218f7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c66b74-54') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:36 user nova-compute[73078]: INFO os_vif [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:b8:f6,bridge_name='br-int',has_traffic_filtering=True,id=90186594-310a-4bfa-8593-6a6f54bb2b9b,network=Network(da640f78-a5e9-4ca4-9daa-cbe9f39866a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90186594-31')
Aug 14 18:11:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1c66b74-54, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb1c66b74-54, col_values=(('external_ids', {'iface-id': 'b1c66b74-5403-4bfb-9826-7d95c1e92356', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:c1:dd', 'vm-uuid': 'ad1d1145-1a70-4a9c-b563-6bda437dc0cc'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:36 user nova-compute[73078]: INFO os_vif [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:c1:dd,bridge_name='br-int',has_traffic_filtering=True,id=b1c66b74-5403-4bfb-9826-7d95c1e92356,network=Network(371d3de4-ece5-41b8-8adc-277ac218f7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c66b74-54')
Aug 14 18:11:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] No VIF found with MAC fa:16:3e:2d:b8:f6, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] No BDM found with device name hda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] No VIF found with MAC fa:16:3e:56:c1:dd, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:11:36 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Using config drive
Aug 14 18:11:36 user nova-compute[73078]: DEBUG nova.network.neutron [req-9bcec6d9-13b3-4681-bc5d-aa8f049203d8 req-88b1521b-88cf-4930-b914-360ce1b987df service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Updated VIF entry in instance network info cache for port b1c66b74-5403-4bfb-9826-7d95c1e92356. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG nova.network.neutron [req-9bcec6d9-13b3-4681-bc5d-aa8f049203d8 req-88b1521b-88cf-4930-b914-360ce1b987df service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Updating instance_info_cache with network_info: [{"id": "b1c66b74-5403-4bfb-9826-7d95c1e92356", "address": "fa:16:3e:56:c1:dd", "network": {"id": "371d3de4-ece5-41b8-8adc-277ac218f7ee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1480740037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a49a3016859146b4b30ae80e5fae6e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c66b74-54", "ovs_interfaceid": "b1c66b74-5403-4bfb-9826-7d95c1e92356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9bcec6d9-13b3-4681-bc5d-aa8f049203d8 req-88b1521b-88cf-4930-b914-360ce1b987df service nova] Releasing lock "refresh_cache-ad1d1145-1a70-4a9c-b563-6bda437dc0cc" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:36 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Creating config drive at /opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/disk.config
Aug 14 18:11:36 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpod1gc075 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:36 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpod1gc075" returned: 0 in 0.071s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:37 user nova-compute[73078]: DEBUG nova.compute.manager [req-130c511b-6872-44ae-a73a-1b301e919688 req-065952ae-0c7e-42f3-be1f-5c8de1fae4ce service nova] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Received event network-vif-plugged-a8a4ff9c-da83-430a-aa65-d8eaf189416e {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:11:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-130c511b-6872-44ae-a73a-1b301e919688 req-065952ae-0c7e-42f3-be1f-5c8de1fae4ce service nova] Acquiring lock "b97b330e-7a72-4d3c-8810-98a4f3a27ce7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-130c511b-6872-44ae-a73a-1b301e919688 req-065952ae-0c7e-42f3-be1f-5c8de1fae4ce service nova] Lock "b97b330e-7a72-4d3c-8810-98a4f3a27ce7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-130c511b-6872-44ae-a73a-1b301e919688 req-065952ae-0c7e-42f3-be1f-5c8de1fae4ce service nova] Lock "b97b330e-7a72-4d3c-8810-98a4f3a27ce7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:37 user nova-compute[73078]: DEBUG nova.compute.manager [req-130c511b-6872-44ae-a73a-1b301e919688 req-065952ae-0c7e-42f3-be1f-5c8de1fae4ce service nova] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] No waiting events found dispatching network-vif-plugged-a8a4ff9c-da83-430a-aa65-d8eaf189416e {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:11:37 user nova-compute[73078]: WARNING nova.compute.manager [req-130c511b-6872-44ae-a73a-1b301e919688 req-065952ae-0c7e-42f3-be1f-5c8de1fae4ce service nova] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Received unexpected event network-vif-plugged-a8a4ff9c-da83-430a-aa65-d8eaf189416e for instance with vm_state building and task_state spawning.
Aug 14 18:11:37 user nova-compute[73078]: DEBUG nova.compute.manager [req-130c511b-6872-44ae-a73a-1b301e919688 req-065952ae-0c7e-42f3-be1f-5c8de1fae4ce service nova] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Received event network-vif-plugged-a8a4ff9c-da83-430a-aa65-d8eaf189416e {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:11:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-130c511b-6872-44ae-a73a-1b301e919688 req-065952ae-0c7e-42f3-be1f-5c8de1fae4ce service nova] Acquiring lock "b97b330e-7a72-4d3c-8810-98a4f3a27ce7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-130c511b-6872-44ae-a73a-1b301e919688 req-065952ae-0c7e-42f3-be1f-5c8de1fae4ce service nova] Lock "b97b330e-7a72-4d3c-8810-98a4f3a27ce7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-130c511b-6872-44ae-a73a-1b301e919688 req-065952ae-0c7e-42f3-be1f-5c8de1fae4ce service nova] Lock "b97b330e-7a72-4d3c-8810-98a4f3a27ce7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:37 user nova-compute[73078]: DEBUG nova.compute.manager [req-130c511b-6872-44ae-a73a-1b301e919688 req-065952ae-0c7e-42f3-be1f-5c8de1fae4ce service nova] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] No waiting events found dispatching network-vif-plugged-a8a4ff9c-da83-430a-aa65-d8eaf189416e {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:11:37 user nova-compute[73078]: WARNING nova.compute.manager [req-130c511b-6872-44ae-a73a-1b301e919688 req-065952ae-0c7e-42f3-be1f-5c8de1fae4ce service nova] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Received unexpected event network-vif-plugged-a8a4ff9c-da83-430a-aa65-d8eaf189416e for instance with vm_state building and task_state spawning.
Aug 14 18:11:37 user nova-compute[73078]: DEBUG nova.network.neutron [req-18b7a351-f2ba-4586-a5f0-e4053e5c3660 req-d93017c8-658f-4af7-8b14-0b6df3ffe0f4 service nova] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Updated VIF entry in instance network info cache for port 90186594-310a-4bfa-8593-6a6f54bb2b9b. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:11:37 user nova-compute[73078]: DEBUG nova.network.neutron [req-18b7a351-f2ba-4586-a5f0-e4053e5c3660 req-d93017c8-658f-4af7-8b14-0b6df3ffe0f4 service nova] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Updating instance_info_cache with network_info: [{"id": "90186594-310a-4bfa-8593-6a6f54bb2b9b", "address": "fa:16:3e:2d:b8:f6", "network": {"id": "da640f78-a5e9-4ca4-9daa-cbe9f39866a7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1049608594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3db9e1b022b443dda66d26e1bf57e984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90186594-31", "ovs_interfaceid": "90186594-310a-4bfa-8593-6a6f54bb2b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:11:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-18b7a351-f2ba-4586-a5f0-e4053e5c3660 req-d93017c8-658f-4af7-8b14-0b6df3ffe0f4 service nova] Releasing lock "refresh_cache-e8ad453e-67b1-4af2-b85b-a5e100c11446" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:11:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:38 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:11:38 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Cleaning up deleted instances {{(pid=73078) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 18:11:38 user nova-compute[73078]: DEBUG nova.compute.manager [req-e263777b-00e8-4639-8d40-385f15ff888f req-1d96bf22-2f9c-4782-85ff-5eb12c437bdb service nova] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Received event network-vif-plugged-90186594-310a-4bfa-8593-6a6f54bb2b9b {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:11:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e263777b-00e8-4639-8d40-385f15ff888f req-1d96bf22-2f9c-4782-85ff-5eb12c437bdb service nova] Acquiring lock "e8ad453e-67b1-4af2-b85b-a5e100c11446-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e263777b-00e8-4639-8d40-385f15ff888f req-1d96bf22-2f9c-4782-85ff-5eb12c437bdb service nova] Lock "e8ad453e-67b1-4af2-b85b-a5e100c11446-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e263777b-00e8-4639-8d40-385f15ff888f req-1d96bf22-2f9c-4782-85ff-5eb12c437bdb service nova] Lock "e8ad453e-67b1-4af2-b85b-a5e100c11446-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:38 user nova-compute[73078]: DEBUG nova.compute.manager [req-e263777b-00e8-4639-8d40-385f15ff888f req-1d96bf22-2f9c-4782-85ff-5eb12c437bdb service nova] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] No waiting events found dispatching network-vif-plugged-90186594-310a-4bfa-8593-6a6f54bb2b9b {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:11:38 user nova-compute[73078]: WARNING nova.compute.manager [req-e263777b-00e8-4639-8d40-385f15ff888f req-1d96bf22-2f9c-4782-85ff-5eb12c437bdb service nova] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Received unexpected event network-vif-plugged-90186594-310a-4bfa-8593-6a6f54bb2b9b for instance with vm_state building and task_state spawning.
Aug 14 18:11:38 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] There are 0 instances to clean {{(pid=73078) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 18:11:38 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036698.1480315, 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:11:38 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] VM Resumed (Lifecycle Event)
Aug 14 18:11:38 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:11:38 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73078) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 18:11:38 user nova-compute[73078]: DEBUG nova.compute.manager [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:11:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:11:38 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:11:38 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Instance spawned successfully.
Aug 14 18:11:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:11:38 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:11:38 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:11:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:38 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:11:38 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036698.1556776, 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:11:38 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] VM Started (Lifecycle Event)
Aug 14 18:11:38 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:11:38 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:11:38 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:11:38 user nova-compute[73078]: INFO nova.compute.manager [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Took 17.61 seconds to spawn the instance on the hypervisor.
Aug 14 18:11:38 user nova-compute[73078]: DEBUG nova.compute.manager [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:11:38 user nova-compute[73078]: INFO nova.compute.manager [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Took 19.62 seconds to build instance.
Aug 14 18:11:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0404e6d6-84d4-4af5-ab2d-3a8e48d8653b tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "10f9d4a9-ee3f-45bd-95e4-edd4819dcf30" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.881s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:39 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036699.2260582, 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:11:39 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] VM Resumed (Lifecycle Event)
Aug 14 18:11:39 user nova-compute[73078]: DEBUG nova.compute.manager [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:11:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:11:39 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Instance spawned successfully.
Aug 14 18:11:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:11:39 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:11:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:39 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:11:39 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:11:39 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036699.2297518, 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:11:39 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] VM Started (Lifecycle Event)
Aug 14 18:11:39 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:11:39 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:11:39 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:11:39 user nova-compute[73078]: INFO nova.compute.manager [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Took 20.05 seconds to spawn the instance on the hypervisor.
Aug 14 18:11:39 user nova-compute[73078]: DEBUG nova.compute.manager [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:11:39 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036699.5410638, b97b330e-7a72-4d3c-8810-98a4f3a27ce7 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:11:39 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] VM Resumed (Lifecycle Event)
Aug 14 18:11:39 user nova-compute[73078]: DEBUG nova.compute.manager [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:11:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:11:39 user nova-compute[73078]: INFO nova.compute.manager [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Took 21.70 seconds to build instance.
Aug 14 18:11:39 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Instance spawned successfully.
Aug 14 18:11:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:11:39 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:11:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-bbb34c03-3347-4a7b-8143-e411a4a5bcd8 tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.026s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:39 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:11:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:39 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:11:39 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036699.5462158, b97b330e-7a72-4d3c-8810-98a4f3a27ce7 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:11:39 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] VM Started (Lifecycle Event)
Aug 14 18:11:39 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:11:39 user nova-compute[73078]: INFO nova.compute.manager [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Took 11.30 seconds to spawn the instance on the hypervisor.
Aug 14 18:11:39 user nova-compute[73078]: DEBUG nova.compute.manager [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:11:39 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:11:39 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:11:39 user nova-compute[73078]: INFO nova.compute.manager [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Took 12.86 seconds to build instance.
Aug 14 18:11:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c8b62aae-e4cd-4134-9e13-85f3284262e4 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Lock "b97b330e-7a72-4d3c-8810-98a4f3a27ce7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.006s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:40 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:40 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:40 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:11:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:11:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Rebuilding the list of instances to heal {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 18:11:40 user nova-compute[73078]: DEBUG nova.compute.manager [req-e0f18f6d-63ad-42a7-8857-d86c48162d73 req-ecf019af-f778-4c98-8ca4-850052da9b43 service nova] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Received event network-vif-plugged-90186594-310a-4bfa-8593-6a6f54bb2b9b {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:11:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e0f18f6d-63ad-42a7-8857-d86c48162d73 req-ecf019af-f778-4c98-8ca4-850052da9b43 service nova] Acquiring lock "e8ad453e-67b1-4af2-b85b-a5e100c11446-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e0f18f6d-63ad-42a7-8857-d86c48162d73 req-ecf019af-f778-4c98-8ca4-850052da9b43 service nova] Lock "e8ad453e-67b1-4af2-b85b-a5e100c11446-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e0f18f6d-63ad-42a7-8857-d86c48162d73 req-ecf019af-f778-4c98-8ca4-850052da9b43 service nova] Lock "e8ad453e-67b1-4af2-b85b-a5e100c11446-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:40 user nova-compute[73078]: DEBUG nova.compute.manager [req-e0f18f6d-63ad-42a7-8857-d86c48162d73 req-ecf019af-f778-4c98-8ca4-850052da9b43 service nova] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] No waiting events found dispatching network-vif-plugged-90186594-310a-4bfa-8593-6a6f54bb2b9b {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:11:40 user nova-compute[73078]: WARNING nova.compute.manager [req-e0f18f6d-63ad-42a7-8857-d86c48162d73 req-ecf019af-f778-4c98-8ca4-850052da9b43 service nova] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Received unexpected event network-vif-plugged-90186594-310a-4bfa-8593-6a6f54bb2b9b for instance with vm_state building and task_state spawning.
Aug 14 18:11:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Skipping network cache update for instance because it is Building. {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 14 18:11:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Skipping network cache update for instance because it is Building. {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 14 18:11:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-c29d7f9d-793f-4511-9203-06b653e52f72" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:11:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-c29d7f9d-793f-4511-9203-06b653e52f72" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:11:40 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:11:40 user nova-compute[73078]: DEBUG nova.objects.instance [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lazy-loading 'info_cache' on Instance uuid c29d7f9d-793f-4511-9203-06b653e52f72 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:11:41 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Updating instance_info_cache with network_info: [{"id": "89874ba3-0758-4c32-b1ec-6d0dd813fb71", "address": "fa:16:3e:a4:11:94", "network": {"id": "a97d8218-d78c-43aa-80b9-58e1cda130cf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-617867352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dc5cc86317d4c90bf119b8bc5ec9c1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89874ba3-07", "ovs_interfaceid": "89874ba3-0758-4c32-b1ec-6d0dd813fb71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:11:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-c29d7f9d-793f-4511-9203-06b653e52f72" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:11:41 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:11:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:41 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:11:41 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036701.9934096, e8ad453e-67b1-4af2-b85b-a5e100c11446 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:11:41 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] VM Resumed (Lifecycle Event)
Aug 14 18:11:41 user nova-compute[73078]: DEBUG nova.compute.manager [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:11:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:11:42 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Instance spawned successfully.
Aug 14 18:11:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:11:42 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:11:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:42 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:11:42 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:11:42 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:11:42 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:11:42 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:11:42 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:11:42 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:11:42 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036701.9971337, e8ad453e-67b1-4af2-b85b-a5e100c11446 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:11:42 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] VM Started (Lifecycle Event)
Aug 14 18:11:42 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:11:42 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:11:42 user nova-compute[73078]: INFO nova.compute.manager [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Took 9.80 seconds to spawn the instance on the hypervisor.
Aug 14 18:11:42 user nova-compute[73078]: DEBUG nova.compute.manager [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:11:42 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:11:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:42 user nova-compute[73078]: INFO nova.compute.manager [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Took 12.40 seconds to build instance.
Aug 14 18:11:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-eadc508b-323d-4b5c-a812-c86ef76270c4 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Lock "e8ad453e-67b1-4af2-b85b-a5e100c11446" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.716s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:42 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036702.4570017, ad1d1145-1a70-4a9c-b563-6bda437dc0cc => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:11:42 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] VM Resumed (Lifecycle Event)
Aug 14 18:11:42 user nova-compute[73078]: DEBUG nova.compute.manager [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:11:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:11:42 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Instance spawned successfully.
Aug 14 18:11:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:11:42 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:11:42 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:11:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:11:42 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:11:42 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036702.470516, ad1d1145-1a70-4a9c-b563-6bda437dc0cc => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:11:42 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] VM Started (Lifecycle Event)
Aug 14 18:11:42 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:11:42 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:11:42 user nova-compute[73078]: INFO nova.compute.manager [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Took 12.01 seconds to spawn the instance on the hypervisor.
Aug 14 18:11:42 user nova-compute[73078]: DEBUG nova.compute.manager [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:11:42 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:11:42 user nova-compute[73078]: INFO nova.compute.manager [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Took 13.98 seconds to build instance.
Aug 14 18:11:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-de114865-b0b6-4249-b209-a21582043598 tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.244s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:43 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:11:43 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:11:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:43 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:11:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.370s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.309s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c29d7f9d-793f-4511-9203-06b653e52f72/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c29d7f9d-793f-4511-9203-06b653e52f72/disk --force-share --output=json" returned: 0 in 0.415s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c29d7f9d-793f-4511-9203-06b653e52f72/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c29d7f9d-793f-4511-9203-06b653e52f72/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b97b330e-7a72-4d3c-8810-98a4f3a27ce7/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b97b330e-7a72-4d3c-8810-98a4f3a27ce7/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b97b330e-7a72-4d3c-8810-98a4f3a27ce7/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b97b330e-7a72-4d3c-8810-98a4f3a27ce7/disk --force-share --output=json" returned: 0 in 0.323s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json" returned: 0 in 0.356s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json" returned: 0 in 0.355s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8ad453e-67b1-4af2-b85b-a5e100c11446/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8ad453e-67b1-4af2-b85b-a5e100c11446/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8ad453e-67b1-4af2-b85b-a5e100c11446/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:49 user nova-compute[73078]: DEBUG nova.compute.manager [req-1c75da64-c388-4273-9223-45601a82e5fe req-4efd76b1-9f89-4ed1-92d5-ea91bdb9ecf8 service nova] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Received event network-vif-plugged-89874ba3-0758-4c32-b1ec-6d0dd813fb71 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:11:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1c75da64-c388-4273-9223-45601a82e5fe req-4efd76b1-9f89-4ed1-92d5-ea91bdb9ecf8 service nova] Acquiring lock "c29d7f9d-793f-4511-9203-06b653e52f72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1c75da64-c388-4273-9223-45601a82e5fe req-4efd76b1-9f89-4ed1-92d5-ea91bdb9ecf8 service nova] Lock "c29d7f9d-793f-4511-9203-06b653e52f72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1c75da64-c388-4273-9223-45601a82e5fe req-4efd76b1-9f89-4ed1-92d5-ea91bdb9ecf8 service nova] Lock "c29d7f9d-793f-4511-9203-06b653e52f72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:49 user nova-compute[73078]: DEBUG nova.compute.manager [req-1c75da64-c388-4273-9223-45601a82e5fe req-4efd76b1-9f89-4ed1-92d5-ea91bdb9ecf8 service nova] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] No waiting events found dispatching network-vif-plugged-89874ba3-0758-4c32-b1ec-6d0dd813fb71 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:11:49 user nova-compute[73078]: WARNING nova.compute.manager [req-1c75da64-c388-4273-9223-45601a82e5fe req-4efd76b1-9f89-4ed1-92d5-ea91bdb9ecf8 service nova] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Received unexpected event network-vif-plugged-89874ba3-0758-4c32-b1ec-6d0dd813fb71 for instance with vm_state active and task_state None.
Aug 14 18:11:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8ad453e-67b1-4af2-b85b-a5e100c11446/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:50 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:11:50 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:11:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=7486MB free_disk=25.615753173828125GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:11:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance c29d7f9d-793f-4511-9203-06b653e52f72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:11:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance de80e188-9385-4613-8a6c-aa72b624ad55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:11:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 1f88cb97-4f22-439e-99f2-d7cb8d5aff36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:11:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 3c840309-9884-4c8a-a6ee-1acd44f32c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:11:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 24c00db3-2457-443d-b5ab-7e6ecaa57515 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:11:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 8d257202-d8ab-4161-9b67-045cf1e36772 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:11:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:11:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:11:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance b97b330e-7a72-4d3c-8810-98a4f3a27ce7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:11:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance ad1d1145-1a70-4a9c-b563-6bda437dc0cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:11:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance e8ad453e-67b1-4af2-b85b-a5e100c11446 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:11:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:11:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:11:50 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Refreshing inventories for resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 18:11:50 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Updating ProviderTree inventory for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 18:11:50 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Updating inventory in ProviderTree for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 18:11:50 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Refreshing aggregate associations for resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b, aggregates: None {{(pid=73078) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 18:11:50 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Refreshing trait associations for resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV {{(pid=73078) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 18:11:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-71f158c3-e0af-4a64-a075-2d37573f887d req-d215ae7f-5337-4f7c-ae1b-505f2ceeb20e service nova] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Received event network-vif-plugged-89874ba3-0758-4c32-b1ec-6d0dd813fb71 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:11:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-71f158c3-e0af-4a64-a075-2d37573f887d req-d215ae7f-5337-4f7c-ae1b-505f2ceeb20e service nova] Acquiring lock "c29d7f9d-793f-4511-9203-06b653e52f72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-71f158c3-e0af-4a64-a075-2d37573f887d req-d215ae7f-5337-4f7c-ae1b-505f2ceeb20e service nova] Lock "c29d7f9d-793f-4511-9203-06b653e52f72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-71f158c3-e0af-4a64-a075-2d37573f887d req-d215ae7f-5337-4f7c-ae1b-505f2ceeb20e service nova] Lock "c29d7f9d-793f-4511-9203-06b653e52f72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-71f158c3-e0af-4a64-a075-2d37573f887d req-d215ae7f-5337-4f7c-ae1b-505f2ceeb20e service nova] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] No waiting events found dispatching network-vif-plugged-89874ba3-0758-4c32-b1ec-6d0dd813fb71 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:11:51 user nova-compute[73078]: WARNING nova.compute.manager [req-71f158c3-e0af-4a64-a075-2d37573f887d req-d215ae7f-5337-4f7c-ae1b-505f2ceeb20e service nova] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Received unexpected event network-vif-plugged-89874ba3-0758-4c32-b1ec-6d0dd813fb71 for instance with vm_state active and task_state None.
Aug 14 18:11:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-71f158c3-e0af-4a64-a075-2d37573f887d req-d215ae7f-5337-4f7c-ae1b-505f2ceeb20e service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Received event network-vif-plugged-2afe973c-46fa-4336-996f-b5dcd374c96e {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:11:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-71f158c3-e0af-4a64-a075-2d37573f887d req-d215ae7f-5337-4f7c-ae1b-505f2ceeb20e service nova] Acquiring lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-71f158c3-e0af-4a64-a075-2d37573f887d req-d215ae7f-5337-4f7c-ae1b-505f2ceeb20e service nova] Lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-71f158c3-e0af-4a64-a075-2d37573f887d req-d215ae7f-5337-4f7c-ae1b-505f2ceeb20e service nova] Lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-71f158c3-e0af-4a64-a075-2d37573f887d req-d215ae7f-5337-4f7c-ae1b-505f2ceeb20e service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] No waiting events found dispatching network-vif-plugged-2afe973c-46fa-4336-996f-b5dcd374c96e {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:11:51 user nova-compute[73078]: WARNING nova.compute.manager [req-71f158c3-e0af-4a64-a075-2d37573f887d req-d215ae7f-5337-4f7c-ae1b-505f2ceeb20e service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Received unexpected event network-vif-plugged-2afe973c-46fa-4336-996f-b5dcd374c96e for instance with vm_state active and task_state None.
Aug 14 18:11:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-71f158c3-e0af-4a64-a075-2d37573f887d req-d215ae7f-5337-4f7c-ae1b-505f2ceeb20e service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Received event network-vif-plugged-2afe973c-46fa-4336-996f-b5dcd374c96e {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:11:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-71f158c3-e0af-4a64-a075-2d37573f887d req-d215ae7f-5337-4f7c-ae1b-505f2ceeb20e service nova] Acquiring lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-71f158c3-e0af-4a64-a075-2d37573f887d req-d215ae7f-5337-4f7c-ae1b-505f2ceeb20e service nova] Lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-71f158c3-e0af-4a64-a075-2d37573f887d req-d215ae7f-5337-4f7c-ae1b-505f2ceeb20e service nova] Lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-71f158c3-e0af-4a64-a075-2d37573f887d req-d215ae7f-5337-4f7c-ae1b-505f2ceeb20e service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] No waiting events found dispatching network-vif-plugged-2afe973c-46fa-4336-996f-b5dcd374c96e {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:11:51 user nova-compute[73078]: WARNING nova.compute.manager [req-71f158c3-e0af-4a64-a075-2d37573f887d req-d215ae7f-5337-4f7c-ae1b-505f2ceeb20e service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Received unexpected event network-vif-plugged-2afe973c-46fa-4336-996f-b5dcd374c96e for instance with vm_state active and task_state None.
Aug 14 18:11:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:51 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:11:51 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:11:51 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:11:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.955s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:52 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:11:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Acquiring lock "d5d44771-7499-43ac-972a-22b9d9fd6840" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lock "d5d44771-7499-43ac-972a-22b9d9fd6840" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:57 user nova-compute[73078]: DEBUG nova.compute.manager [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:11:57 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:57 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:11:57 user nova-compute[73078]: INFO nova.compute.claims [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Claim successful on node user
Aug 14 18:11:57 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:11:57 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:11:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.498s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:57 user nova-compute[73078]: DEBUG nova.compute.manager [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:11:57 user nova-compute[73078]: DEBUG nova.compute.manager [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:11:57 user nova-compute[73078]: DEBUG nova.network.neutron [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:11:57 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:11:57 user nova-compute[73078]: DEBUG nova.compute.manager [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:11:57 user nova-compute[73078]: DEBUG nova.policy [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31255ab4abf34860a048d6f74033c64c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed80f7f96d14ae490e428db42e1f6f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:11:57 user nova-compute[73078]: DEBUG nova.compute.manager [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:11:57 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:11:57 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Creating image(s)
Aug 14 18:11:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5d44771-7499-43ac-972a-22b9d9fd6840/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lock "/opt/stack/data/nova/instances/d5d44771-7499-43ac-972a-22b9d9fd6840/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lock "/opt/stack/data/nova/instances/d5d44771-7499-43ac-972a-22b9d9fd6840/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.193s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.173s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/d5d44771-7499-43ac-972a-22b9d9fd6840/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/d5d44771-7499-43ac-972a-22b9d9fd6840/disk 1073741824" returned: 0 in 0.048s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:58 user nova-compute[73078]: DEBUG nova.network.neutron [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Successfully created port: 37e13a55-0707-43d4-ab51-064fe38c2377 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:11:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.178s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:58 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d5d44771-7499-43ac-972a-22b9d9fd6840/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:11:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d44771-7499-43ac-972a-22b9d9fd6840/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:11:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d44771-7499-43ac-972a-22b9d9fd6840/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:11:58 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Cannot resize image /opt/stack/data/nova/instances/d5d44771-7499-43ac-972a-22b9d9fd6840/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:11:58 user nova-compute[73078]: DEBUG nova.objects.instance [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lazy-loading 'migration_context' on Instance uuid d5d44771-7499-43ac-972a-22b9d9fd6840 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:11:58 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:11:58 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Ensure instance console log exists: /opt/stack/data/nova/instances/d5d44771-7499-43ac-972a-22b9d9fd6840/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:11:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:11:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:11:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG nova.network.neutron [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Successfully updated port: 37e13a55-0707-43d4-ab51-064fe38c2377 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Acquiring lock "refresh_cache-d5d44771-7499-43ac-972a-22b9d9fd6840" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Acquired lock "refresh_cache-d5d44771-7499-43ac-972a-22b9d9fd6840" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG nova.network.neutron [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG nova.compute.manager [req-dc7c437d-ecbc-4eed-baf9-dfcea7d9b84a req-b0ebb984-40a7-4197-a526-b76a4d741149 service nova] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Received event network-changed-37e13a55-0707-43d4-ab51-064fe38c2377 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG nova.compute.manager [req-dc7c437d-ecbc-4eed-baf9-dfcea7d9b84a req-b0ebb984-40a7-4197-a526-b76a4d741149 service nova] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Refreshing instance network info cache due to event network-changed-37e13a55-0707-43d4-ab51-064fe38c2377. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-dc7c437d-ecbc-4eed-baf9-dfcea7d9b84a req-b0ebb984-40a7-4197-a526-b76a4d741149 service nova] Acquiring lock "refresh_cache-d5d44771-7499-43ac-972a-22b9d9fd6840" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG nova.network.neutron [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG nova.network.neutron [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Updating instance_info_cache with network_info: [{"id": "37e13a55-0707-43d4-ab51-064fe38c2377", "address": "fa:16:3e:92:2c:35", "network": {"id": "747446a8-4755-480b-a3b1-44648769bb00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1534750515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed80f7f96d14ae490e428db42e1f6f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e13a55-07", "ovs_interfaceid": "37e13a55-0707-43d4-ab51-064fe38c2377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Releasing lock "refresh_cache-d5d44771-7499-43ac-972a-22b9d9fd6840" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG nova.compute.manager [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Instance network_info: |[{"id": "37e13a55-0707-43d4-ab51-064fe38c2377", "address": "fa:16:3e:92:2c:35", "network": {"id": "747446a8-4755-480b-a3b1-44648769bb00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1534750515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed80f7f96d14ae490e428db42e1f6f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e13a55-07", "ovs_interfaceid": "37e13a55-0707-43d4-ab51-064fe38c2377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-dc7c437d-ecbc-4eed-baf9-dfcea7d9b84a req-b0ebb984-40a7-4197-a526-b76a4d741149 service nova] Acquired lock "refresh_cache-d5d44771-7499-43ac-972a-22b9d9fd6840" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG nova.network.neutron [req-dc7c437d-ecbc-4eed-baf9-dfcea7d9b84a req-b0ebb984-40a7-4197-a526-b76a4d741149 service nova] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Refreshing network info cache for port 37e13a55-0707-43d4-ab51-064fe38c2377 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Start _get_guest_xml network_info=[{"id": "37e13a55-0707-43d4-ab51-064fe38c2377", "address": "fa:16:3e:92:2c:35", "network": {"id": "747446a8-4755-480b-a3b1-44648769bb00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1534750515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed80f7f96d14ae490e428db42e1f6f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e13a55-07", "ovs_interfaceid": "37e13a55-0707-43d4-ab51-064fe38c2377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:11:59 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:11:59 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:11:59 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:11:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1982726398',display_name='tempest-VolumesActionsTest-instance-1982726398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1982726398',id=12,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eed80f7f96d14ae490e428db42e1f6f3',ramdisk_id='',reservation_id='r-4len85c6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1155799078',owner_user_name='tempest-VolumesActionsTest-1155799078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:11:58Z,user_data=None,user_id='31255ab4abf34860a048d6f74033c64c',uuid=d5d44771-7499-43ac-972a-22b9d9fd6840,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37e13a55-0707-43d4-ab51-064fe38c2377", "address": "fa:16:3e:92:2c:35", "network": {"id": "747446a8-4755-480b-a3b1-44648769bb00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1534750515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed80f7f96d14ae490e428db42e1f6f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e13a55-07", "ovs_interfaceid": "37e13a55-0707-43d4-ab51-064fe38c2377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Converting VIF {"id": "37e13a55-0707-43d4-ab51-064fe38c2377", "address": "fa:16:3e:92:2c:35", "network": {"id": "747446a8-4755-480b-a3b1-44648769bb00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1534750515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed80f7f96d14ae490e428db42e1f6f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e13a55-07", "ovs_interfaceid": "37e13a55-0707-43d4-ab51-064fe38c2377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:2c:35,bridge_name='br-int',has_traffic_filtering=True,id=37e13a55-0707-43d4-ab51-064fe38c2377,network=Network(747446a8-4755-480b-a3b1-44648769bb00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e13a55-07') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG nova.objects.instance [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lazy-loading 'pci_devices' on Instance uuid d5d44771-7499-43ac-972a-22b9d9fd6840 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:11:59 user nova-compute[73078]:   <uuid>d5d44771-7499-43ac-972a-22b9d9fd6840</uuid>
Aug 14 18:11:59 user nova-compute[73078]:   <name>instance-0000000c</name>
Aug 14 18:11:59 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:11:59 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:11:59 user nova-compute[73078]:   <metadata>
Aug 14 18:11:59 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:11:59 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:11:59 user nova-compute[73078]:       <nova:name>tempest-VolumesActionsTest-instance-1982726398</nova:name>
Aug 14 18:11:59 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:11:59</nova:creationTime>
Aug 14 18:11:59 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:11:59 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:11:59 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:11:59 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:11:59 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:11:59 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:11:59 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:11:59 user nova-compute[73078]:       <nova:owner>
Aug 14 18:11:59 user nova-compute[73078]:         <nova:user uuid="31255ab4abf34860a048d6f74033c64c">tempest-VolumesActionsTest-1155799078-project-member</nova:user>
Aug 14 18:11:59 user nova-compute[73078]:         <nova:project uuid="eed80f7f96d14ae490e428db42e1f6f3">tempest-VolumesActionsTest-1155799078</nova:project>
Aug 14 18:11:59 user nova-compute[73078]:       </nova:owner>
Aug 14 18:11:59 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:11:59 user nova-compute[73078]:       <nova:ports>
Aug 14 18:11:59 user nova-compute[73078]:         <nova:port uuid="37e13a55-0707-43d4-ab51-064fe38c2377">
Aug 14 18:11:59 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 18:11:59 user nova-compute[73078]:         </nova:port>
Aug 14 18:11:59 user nova-compute[73078]:       </nova:ports>
Aug 14 18:11:59 user nova-compute[73078]:     </nova:instance>
Aug 14 18:11:59 user nova-compute[73078]:   </metadata>
Aug 14 18:11:59 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:11:59 user nova-compute[73078]:     <system>
Aug 14 18:11:59 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:11:59 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:11:59 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:11:59 user nova-compute[73078]:       <entry name="serial">d5d44771-7499-43ac-972a-22b9d9fd6840</entry>
Aug 14 18:11:59 user nova-compute[73078]:       <entry name="uuid">d5d44771-7499-43ac-972a-22b9d9fd6840</entry>
Aug 14 18:11:59 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:11:59 user nova-compute[73078]:     </system>
Aug 14 18:11:59 user nova-compute[73078]:   </sysinfo>
Aug 14 18:11:59 user nova-compute[73078]:   <os>
Aug 14 18:11:59 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:11:59 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:11:59 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:11:59 user nova-compute[73078]:   </os>
Aug 14 18:11:59 user nova-compute[73078]:   <features>
Aug 14 18:11:59 user nova-compute[73078]:     <acpi/>
Aug 14 18:11:59 user nova-compute[73078]:     <apic/>
Aug 14 18:11:59 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:11:59 user nova-compute[73078]:   </features>
Aug 14 18:11:59 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:11:59 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:11:59 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:11:59 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:11:59 user nova-compute[73078]:   </clock>
Aug 14 18:11:59 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:11:59 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:11:59 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:11:59 user nova-compute[73078]:   </cpu>
Aug 14 18:11:59 user nova-compute[73078]:   <devices>
Aug 14 18:11:59 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:11:59 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:11:59 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/d5d44771-7499-43ac-972a-22b9d9fd6840/disk"/>
Aug 14 18:11:59 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:11:59 user nova-compute[73078]:     </disk>
Aug 14 18:11:59 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:11:59 user nova-compute[73078]:       <mac address="fa:16:3e:92:2c:35"/>
Aug 14 18:11:59 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:11:59 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:11:59 user nova-compute[73078]:       <target dev="tap37e13a55-07"/>
Aug 14 18:11:59 user nova-compute[73078]:     </interface>
Aug 14 18:11:59 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:11:59 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/d5d44771-7499-43ac-972a-22b9d9fd6840/console.log" append="off"/>
Aug 14 18:11:59 user nova-compute[73078]:     </serial>
Aug 14 18:11:59 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:11:59 user nova-compute[73078]:     <video>
Aug 14 18:11:59 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:11:59 user nova-compute[73078]:     </video>
Aug 14 18:11:59 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:11:59 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:11:59 user nova-compute[73078]:     </rng>
Aug 14 18:11:59 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:11:59 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:11:59 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:11:59 user nova-compute[73078]:     </memballoon>
Aug 14 18:11:59 user nova-compute[73078]:   </devices>
Aug 14 18:11:59 user nova-compute[73078]: </domain>
Aug 14 18:11:59 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:11:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1982726398',display_name='tempest-VolumesActionsTest-instance-1982726398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1982726398',id=12,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eed80f7f96d14ae490e428db42e1f6f3',ramdisk_id='',reservation_id='r-4len85c6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1155799078',owner_user_name='tempest-VolumesActionsTest-1155799078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:11:58Z,user_data=None,user_id='31255ab4abf34860a048d6f74033c64c',uuid=d5d44771-7499-43ac-972a-22b9d9fd6840,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37e13a55-0707-43d4-ab51-064fe38c2377", "address": "fa:16:3e:92:2c:35", "network": {"id": "747446a8-4755-480b-a3b1-44648769bb00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1534750515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed80f7f96d14ae490e428db42e1f6f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e13a55-07", "ovs_interfaceid": "37e13a55-0707-43d4-ab51-064fe38c2377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Converting VIF {"id": "37e13a55-0707-43d4-ab51-064fe38c2377", "address": "fa:16:3e:92:2c:35", "network": {"id": "747446a8-4755-480b-a3b1-44648769bb00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1534750515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed80f7f96d14ae490e428db42e1f6f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e13a55-07", "ovs_interfaceid": "37e13a55-0707-43d4-ab51-064fe38c2377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:2c:35,bridge_name='br-int',has_traffic_filtering=True,id=37e13a55-0707-43d4-ab51-064fe38c2377,network=Network(747446a8-4755-480b-a3b1-44648769bb00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e13a55-07') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG os_vif [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:2c:35,bridge_name='br-int',has_traffic_filtering=True,id=37e13a55-0707-43d4-ab51-064fe38c2377,network=Network(747446a8-4755-480b-a3b1-44648769bb00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e13a55-07') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37e13a55-07, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap37e13a55-07, col_values=(('external_ids', {'iface-id': '37e13a55-0707-43d4-ab51-064fe38c2377', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:2c:35', 'vm-uuid': 'd5d44771-7499-43ac-972a-22b9d9fd6840'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:11:59 user nova-compute[73078]: INFO os_vif [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:2c:35,bridge_name='br-int',has_traffic_filtering=True,id=37e13a55-0707-43d4-ab51-064fe38c2377,network=Network(747446a8-4755-480b-a3b1-44648769bb00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e13a55-07')
Aug 14 18:11:59 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:11:59 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] No VIF found with MAC fa:16:3e:92:2c:35, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:12:00 user nova-compute[73078]: DEBUG nova.network.neutron [req-dc7c437d-ecbc-4eed-baf9-dfcea7d9b84a req-b0ebb984-40a7-4197-a526-b76a4d741149 service nova] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Updated VIF entry in instance network info cache for port 37e13a55-0707-43d4-ab51-064fe38c2377. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:12:00 user nova-compute[73078]: DEBUG nova.network.neutron [req-dc7c437d-ecbc-4eed-baf9-dfcea7d9b84a req-b0ebb984-40a7-4197-a526-b76a4d741149 service nova] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Updating instance_info_cache with network_info: [{"id": "37e13a55-0707-43d4-ab51-064fe38c2377", "address": "fa:16:3e:92:2c:35", "network": {"id": "747446a8-4755-480b-a3b1-44648769bb00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1534750515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed80f7f96d14ae490e428db42e1f6f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e13a55-07", "ovs_interfaceid": "37e13a55-0707-43d4-ab51-064fe38c2377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:12:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-dc7c437d-ecbc-4eed-baf9-dfcea7d9b84a req-b0ebb984-40a7-4197-a526-b76a4d741149 service nova] Releasing lock "refresh_cache-d5d44771-7499-43ac-972a-22b9d9fd6840" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:12:01 user nova-compute[73078]: DEBUG nova.compute.manager [req-ebd0e6ea-e3da-4090-9470-8ffd4878309d req-2662322c-357b-46b4-a0c9-f5f77f38f64e service nova] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Received event network-vif-plugged-8df77a26-faab-47ca-a39b-3df6930cd1d5 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:12:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ebd0e6ea-e3da-4090-9470-8ffd4878309d req-2662322c-357b-46b4-a0c9-f5f77f38f64e service nova] Acquiring lock "1f88cb97-4f22-439e-99f2-d7cb8d5aff36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:12:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ebd0e6ea-e3da-4090-9470-8ffd4878309d req-2662322c-357b-46b4-a0c9-f5f77f38f64e service nova] Lock "1f88cb97-4f22-439e-99f2-d7cb8d5aff36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:12:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ebd0e6ea-e3da-4090-9470-8ffd4878309d req-2662322c-357b-46b4-a0c9-f5f77f38f64e service nova] Lock "1f88cb97-4f22-439e-99f2-d7cb8d5aff36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:12:01 user nova-compute[73078]: DEBUG nova.compute.manager [req-ebd0e6ea-e3da-4090-9470-8ffd4878309d req-2662322c-357b-46b4-a0c9-f5f77f38f64e service nova] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] No waiting events found dispatching network-vif-plugged-8df77a26-faab-47ca-a39b-3df6930cd1d5 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:12:01 user nova-compute[73078]: WARNING nova.compute.manager [req-ebd0e6ea-e3da-4090-9470-8ffd4878309d req-2662322c-357b-46b4-a0c9-f5f77f38f64e service nova] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Received unexpected event network-vif-plugged-8df77a26-faab-47ca-a39b-3df6930cd1d5 for instance with vm_state active and task_state None.
Aug 14 18:12:01 user nova-compute[73078]: DEBUG nova.compute.manager [req-ebd0e6ea-e3da-4090-9470-8ffd4878309d req-2662322c-357b-46b4-a0c9-f5f77f38f64e service nova] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Received event network-vif-plugged-8df77a26-faab-47ca-a39b-3df6930cd1d5 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:12:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ebd0e6ea-e3da-4090-9470-8ffd4878309d req-2662322c-357b-46b4-a0c9-f5f77f38f64e service nova] Acquiring lock "1f88cb97-4f22-439e-99f2-d7cb8d5aff36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:12:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ebd0e6ea-e3da-4090-9470-8ffd4878309d req-2662322c-357b-46b4-a0c9-f5f77f38f64e service nova] Lock "1f88cb97-4f22-439e-99f2-d7cb8d5aff36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:12:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ebd0e6ea-e3da-4090-9470-8ffd4878309d req-2662322c-357b-46b4-a0c9-f5f77f38f64e service nova] Lock "1f88cb97-4f22-439e-99f2-d7cb8d5aff36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:12:01 user nova-compute[73078]: DEBUG nova.compute.manager [req-ebd0e6ea-e3da-4090-9470-8ffd4878309d req-2662322c-357b-46b4-a0c9-f5f77f38f64e service nova] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] No waiting events found dispatching network-vif-plugged-8df77a26-faab-47ca-a39b-3df6930cd1d5 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:12:01 user nova-compute[73078]: WARNING nova.compute.manager [req-ebd0e6ea-e3da-4090-9470-8ffd4878309d req-2662322c-357b-46b4-a0c9-f5f77f38f64e service nova] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Received unexpected event network-vif-plugged-8df77a26-faab-47ca-a39b-3df6930cd1d5 for instance with vm_state active and task_state None.
Aug 14 18:12:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:01 user nova-compute[73078]: DEBUG nova.compute.manager [req-5a5bba8b-4051-40aa-9645-4415d6da7ea9 req-aa7b0e85-9bb8-4fae-8b7c-74c15bf7e084 service nova] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Received event network-vif-plugged-37e13a55-0707-43d4-ab51-064fe38c2377 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:12:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5a5bba8b-4051-40aa-9645-4415d6da7ea9 req-aa7b0e85-9bb8-4fae-8b7c-74c15bf7e084 service nova] Acquiring lock "d5d44771-7499-43ac-972a-22b9d9fd6840-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:12:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5a5bba8b-4051-40aa-9645-4415d6da7ea9 req-aa7b0e85-9bb8-4fae-8b7c-74c15bf7e084 service nova] Lock "d5d44771-7499-43ac-972a-22b9d9fd6840-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:12:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5a5bba8b-4051-40aa-9645-4415d6da7ea9 req-aa7b0e85-9bb8-4fae-8b7c-74c15bf7e084 service nova] Lock "d5d44771-7499-43ac-972a-22b9d9fd6840-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:12:01 user nova-compute[73078]: DEBUG nova.compute.manager [req-5a5bba8b-4051-40aa-9645-4415d6da7ea9 req-aa7b0e85-9bb8-4fae-8b7c-74c15bf7e084 service nova] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] No waiting events found dispatching network-vif-plugged-37e13a55-0707-43d4-ab51-064fe38c2377 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:12:01 user nova-compute[73078]: WARNING nova.compute.manager [req-5a5bba8b-4051-40aa-9645-4415d6da7ea9 req-aa7b0e85-9bb8-4fae-8b7c-74c15bf7e084 service nova] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Received unexpected event network-vif-plugged-37e13a55-0707-43d4-ab51-064fe38c2377 for instance with vm_state building and task_state spawning.
Aug 14 18:12:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:03 user nova-compute[73078]: DEBUG nova.compute.manager [req-430e8b31-ece8-4fcd-82da-a47a21212d9a req-bfcc1417-57ba-49ff-9248-4a7b4f684906 service nova] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Received event network-vif-plugged-03e9ece7-7612-4a4f-86ab-d85b0c97d723 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:12:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-430e8b31-ece8-4fcd-82da-a47a21212d9a req-bfcc1417-57ba-49ff-9248-4a7b4f684906 service nova] Acquiring lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:12:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-430e8b31-ece8-4fcd-82da-a47a21212d9a req-bfcc1417-57ba-49ff-9248-4a7b4f684906 service nova] Lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:12:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-430e8b31-ece8-4fcd-82da-a47a21212d9a req-bfcc1417-57ba-49ff-9248-4a7b4f684906 service nova] Lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:12:03 user nova-compute[73078]: DEBUG nova.compute.manager [req-430e8b31-ece8-4fcd-82da-a47a21212d9a req-bfcc1417-57ba-49ff-9248-4a7b4f684906 service nova] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] No waiting events found dispatching network-vif-plugged-03e9ece7-7612-4a4f-86ab-d85b0c97d723 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:12:03 user nova-compute[73078]: WARNING nova.compute.manager [req-430e8b31-ece8-4fcd-82da-a47a21212d9a req-bfcc1417-57ba-49ff-9248-4a7b4f684906 service nova] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Received unexpected event network-vif-plugged-03e9ece7-7612-4a4f-86ab-d85b0c97d723 for instance with vm_state active and task_state None.
Aug 14 18:12:03 user nova-compute[73078]: DEBUG nova.compute.manager [req-430e8b31-ece8-4fcd-82da-a47a21212d9a req-bfcc1417-57ba-49ff-9248-4a7b4f684906 service nova] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Received event network-vif-plugged-03e9ece7-7612-4a4f-86ab-d85b0c97d723 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:12:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-430e8b31-ece8-4fcd-82da-a47a21212d9a req-bfcc1417-57ba-49ff-9248-4a7b4f684906 service nova] Acquiring lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:12:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-430e8b31-ece8-4fcd-82da-a47a21212d9a req-bfcc1417-57ba-49ff-9248-4a7b4f684906 service nova] Lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:12:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-430e8b31-ece8-4fcd-82da-a47a21212d9a req-bfcc1417-57ba-49ff-9248-4a7b4f684906 service nova] Lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:12:03 user nova-compute[73078]: DEBUG nova.compute.manager [req-430e8b31-ece8-4fcd-82da-a47a21212d9a req-bfcc1417-57ba-49ff-9248-4a7b4f684906 service nova] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] No waiting events found dispatching network-vif-plugged-03e9ece7-7612-4a4f-86ab-d85b0c97d723 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:12:03 user nova-compute[73078]: WARNING nova.compute.manager [req-430e8b31-ece8-4fcd-82da-a47a21212d9a req-bfcc1417-57ba-49ff-9248-4a7b4f684906 service nova] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Received unexpected event network-vif-plugged-03e9ece7-7612-4a4f-86ab-d85b0c97d723 for instance with vm_state active and task_state None.
Aug 14 18:12:03 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036723.578592, d5d44771-7499-43ac-972a-22b9d9fd6840 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:12:03 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] VM Resumed (Lifecycle Event)
Aug 14 18:12:03 user nova-compute[73078]: DEBUG nova.compute.manager [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:12:03 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:12:03 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Instance spawned successfully.
Aug 14 18:12:03 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:12:03 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:12:03 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:12:03 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:12:03 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:12:03 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:12:03 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:12:03 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:12:03 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:12:03 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:12:03 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036723.5812685, d5d44771-7499-43ac-972a-22b9d9fd6840 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:12:03 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] VM Started (Lifecycle Event)
Aug 14 18:12:03 user nova-compute[73078]: DEBUG nova.compute.manager [req-0c1abd22-4306-4576-abda-838ea95f9e1f req-1d2cdc02-f3c9-46d0-8412-7a1bde9f7267 service nova] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Received event network-vif-plugged-37e13a55-0707-43d4-ab51-064fe38c2377 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:12:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0c1abd22-4306-4576-abda-838ea95f9e1f req-1d2cdc02-f3c9-46d0-8412-7a1bde9f7267 service nova] Acquiring lock "d5d44771-7499-43ac-972a-22b9d9fd6840-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:12:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0c1abd22-4306-4576-abda-838ea95f9e1f req-1d2cdc02-f3c9-46d0-8412-7a1bde9f7267 service nova] Lock "d5d44771-7499-43ac-972a-22b9d9fd6840-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.013s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:12:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0c1abd22-4306-4576-abda-838ea95f9e1f req-1d2cdc02-f3c9-46d0-8412-7a1bde9f7267 service nova] Lock "d5d44771-7499-43ac-972a-22b9d9fd6840-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:12:03 user nova-compute[73078]: DEBUG nova.compute.manager [req-0c1abd22-4306-4576-abda-838ea95f9e1f req-1d2cdc02-f3c9-46d0-8412-7a1bde9f7267 service nova] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] No waiting events found dispatching network-vif-plugged-37e13a55-0707-43d4-ab51-064fe38c2377 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:12:03 user nova-compute[73078]: WARNING nova.compute.manager [req-0c1abd22-4306-4576-abda-838ea95f9e1f req-1d2cdc02-f3c9-46d0-8412-7a1bde9f7267 service nova] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Received unexpected event network-vif-plugged-37e13a55-0707-43d4-ab51-064fe38c2377 for instance with vm_state building and task_state spawning.
Aug 14 18:12:03 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:12:03 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:12:03 user nova-compute[73078]: INFO nova.compute.manager [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Took 5.85 seconds to spawn the instance on the hypervisor.
Aug 14 18:12:03 user nova-compute[73078]: DEBUG nova.compute.manager [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:12:03 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:12:03 user nova-compute[73078]: INFO nova.compute.manager [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Took 6.68 seconds to build instance.
Aug 14 18:12:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-81fcc1a7-2aef-4ebc-aed6-b3fb0c9719cf tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lock "d5d44771-7499-43ac-972a-22b9d9fd6840" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.774s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:12:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:07 user nova-compute[73078]: DEBUG nova.compute.manager [req-a3e0c226-2241-40d5-9ec0-b27268a5ec94 req-e6b3a7f2-f87d-405b-8021-9d8a5aa90910 service nova] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Received event network-vif-plugged-733825c5-0713-4980-9e5d-4a1120fb1598 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:12:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a3e0c226-2241-40d5-9ec0-b27268a5ec94 req-e6b3a7f2-f87d-405b-8021-9d8a5aa90910 service nova] Acquiring lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:12:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a3e0c226-2241-40d5-9ec0-b27268a5ec94 req-e6b3a7f2-f87d-405b-8021-9d8a5aa90910 service nova] Lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:12:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a3e0c226-2241-40d5-9ec0-b27268a5ec94 req-e6b3a7f2-f87d-405b-8021-9d8a5aa90910 service nova] Lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:12:07 user nova-compute[73078]: DEBUG nova.compute.manager [req-a3e0c226-2241-40d5-9ec0-b27268a5ec94 req-e6b3a7f2-f87d-405b-8021-9d8a5aa90910 service nova] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] No waiting events found dispatching network-vif-plugged-733825c5-0713-4980-9e5d-4a1120fb1598 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:12:07 user nova-compute[73078]: WARNING nova.compute.manager [req-a3e0c226-2241-40d5-9ec0-b27268a5ec94 req-e6b3a7f2-f87d-405b-8021-9d8a5aa90910 service nova] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Received unexpected event network-vif-plugged-733825c5-0713-4980-9e5d-4a1120fb1598 for instance with vm_state active and task_state None.
Aug 14 18:12:09 user nova-compute[73078]: DEBUG nova.compute.manager [req-605245ed-7ecb-46ac-8848-bbd7f3bbd408 req-f7d1894a-c6e9-4be8-979d-188338d09ead service nova] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Received event network-vif-plugged-733825c5-0713-4980-9e5d-4a1120fb1598 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:12:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-605245ed-7ecb-46ac-8848-bbd7f3bbd408 req-f7d1894a-c6e9-4be8-979d-188338d09ead service nova] Acquiring lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:12:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-605245ed-7ecb-46ac-8848-bbd7f3bbd408 req-f7d1894a-c6e9-4be8-979d-188338d09ead service nova] Lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:12:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-605245ed-7ecb-46ac-8848-bbd7f3bbd408 req-f7d1894a-c6e9-4be8-979d-188338d09ead service nova] Lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:12:09 user nova-compute[73078]: DEBUG nova.compute.manager [req-605245ed-7ecb-46ac-8848-bbd7f3bbd408 req-f7d1894a-c6e9-4be8-979d-188338d09ead service nova] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] No waiting events found dispatching network-vif-plugged-733825c5-0713-4980-9e5d-4a1120fb1598 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:12:09 user nova-compute[73078]: WARNING nova.compute.manager [req-605245ed-7ecb-46ac-8848-bbd7f3bbd408 req-f7d1894a-c6e9-4be8-979d-188338d09ead service nova] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Received unexpected event network-vif-plugged-733825c5-0713-4980-9e5d-4a1120fb1598 for instance with vm_state active and task_state None.
Aug 14 18:12:09 user nova-compute[73078]: DEBUG nova.compute.manager [req-605245ed-7ecb-46ac-8848-bbd7f3bbd408 req-f7d1894a-c6e9-4be8-979d-188338d09ead service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Received event network-vif-plugged-b1c66b74-5403-4bfb-9826-7d95c1e92356 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:12:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-605245ed-7ecb-46ac-8848-bbd7f3bbd408 req-f7d1894a-c6e9-4be8-979d-188338d09ead service nova] Acquiring lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:12:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-605245ed-7ecb-46ac-8848-bbd7f3bbd408 req-f7d1894a-c6e9-4be8-979d-188338d09ead service nova] Lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:12:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-605245ed-7ecb-46ac-8848-bbd7f3bbd408 req-f7d1894a-c6e9-4be8-979d-188338d09ead service nova] Lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:12:09 user nova-compute[73078]: DEBUG nova.compute.manager [req-605245ed-7ecb-46ac-8848-bbd7f3bbd408 req-f7d1894a-c6e9-4be8-979d-188338d09ead service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] No waiting events found dispatching network-vif-plugged-b1c66b74-5403-4bfb-9826-7d95c1e92356 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:12:09 user nova-compute[73078]: WARNING nova.compute.manager [req-605245ed-7ecb-46ac-8848-bbd7f3bbd408 req-f7d1894a-c6e9-4be8-979d-188338d09ead service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Received unexpected event network-vif-plugged-b1c66b74-5403-4bfb-9826-7d95c1e92356 for instance with vm_state active and task_state None.
Aug 14 18:12:09 user nova-compute[73078]: DEBUG nova.compute.manager [req-605245ed-7ecb-46ac-8848-bbd7f3bbd408 req-f7d1894a-c6e9-4be8-979d-188338d09ead service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Received event network-vif-plugged-b1c66b74-5403-4bfb-9826-7d95c1e92356 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:12:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-605245ed-7ecb-46ac-8848-bbd7f3bbd408 req-f7d1894a-c6e9-4be8-979d-188338d09ead service nova] Acquiring lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:12:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-605245ed-7ecb-46ac-8848-bbd7f3bbd408 req-f7d1894a-c6e9-4be8-979d-188338d09ead service nova] Lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:12:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-605245ed-7ecb-46ac-8848-bbd7f3bbd408 req-f7d1894a-c6e9-4be8-979d-188338d09ead service nova] Lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:12:09 user nova-compute[73078]: DEBUG nova.compute.manager [req-605245ed-7ecb-46ac-8848-bbd7f3bbd408 req-f7d1894a-c6e9-4be8-979d-188338d09ead service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] No waiting events found dispatching network-vif-plugged-b1c66b74-5403-4bfb-9826-7d95c1e92356 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:12:09 user nova-compute[73078]: WARNING nova.compute.manager [req-605245ed-7ecb-46ac-8848-bbd7f3bbd408 req-f7d1894a-c6e9-4be8-979d-188338d09ead service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Received unexpected event network-vif-plugged-b1c66b74-5403-4bfb-9826-7d95c1e92356 for instance with vm_state active and task_state None.
Aug 14 18:12:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Acquiring lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:12:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:12:19 user nova-compute[73078]: DEBUG nova.compute.manager [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:12:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:12:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:12:19 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:12:19 user nova-compute[73078]: INFO nova.compute.claims [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Claim successful on node user
Aug 14 18:12:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:12:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:12:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:12:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:12:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:19 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:12:19 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:12:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:12:20 user nova-compute[73078]: DEBUG nova.compute.manager [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:12:20 user nova-compute[73078]: DEBUG nova.compute.manager [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:12:20 user nova-compute[73078]: DEBUG nova.network.neutron [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:12:20 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:12:20 user nova-compute[73078]: DEBUG nova.compute.manager [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:12:20 user nova-compute[73078]: INFO nova.virt.block_device [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Booting with volume 63b60218-2eb0-4ccb-9d46-def6b4b3ce6f at /dev/vda
Aug 14 18:12:20 user nova-compute[73078]: DEBUG nova.policy [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e155f911c3444d3baffb0eb5ee75b773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7328e29579b44e5894abeb47e1fe16a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:12:20 user nova-compute[73078]: DEBUG os_brick.utils [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:12:20 user nova-compute[73078]: INFO oslo.privsep.daemon [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpg1i8t5we/privsep.sock']
Aug 14 18:12:20 user sudo[84725]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpg1i8t5we/privsep.sock
Aug 14 18:12:20 user sudo[84725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 14 18:12:20 user nova-compute[73078]: DEBUG nova.network.neutron [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Successfully created port: be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:12:21 user nova-compute[73078]: DEBUG nova.network.neutron [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Successfully created port: f725089c-89c9-447a-88e7-a427ad17f344 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:12:21 user nova-compute[73078]: DEBUG nova.network.neutron [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Successfully created port: 0da08486-8ca6-4ab9-8328-7073e9a8b0f3 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:12:22 user sudo[84725]: pam_unix(sudo:session): session closed for user root
Aug 14 18:12:22 user nova-compute[73078]: INFO oslo.privsep.daemon [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Spawned new privsep daemon via rootwrap
Aug 14 18:12:22 user nova-compute[73078]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 14 18:12:22 user nova-compute[73078]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 14 18:12:22 user nova-compute[73078]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 14 18:12:22 user nova-compute[73078]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84732
Aug 14 18:12:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb8618c-4053-43d6-ba88-267ee4fee463]: (2,) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6b65d7-d031-498e-a8ba-657fa201b7da]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:22 user nova-compute[73078]: WARNING os_brick.initiator.connectors.nvmeof [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 14 18:12:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.031s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f12c74-827d-4281-9786-58f486c66cc3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c6bd20-8386-477b-a49f-6e8d38713438]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a1b348-ab00-443a-84b0-d24332448788]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:12:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:12:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:12:22 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:12:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb2e246-d236-421d-9cdc-fa51d501c6c8]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:12:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:12:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:12:22 user nova-compute[73078]: DEBUG os_brick.utils [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] <== get_connector_properties: return (2203ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:12:22 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Updating existing volume attachment record: 3356a1fa-73eb-45eb-818f-b9cc00d70ad8 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:12:22 user nova-compute[73078]: DEBUG nova.network.neutron [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Successfully created port: febea954-f895-4078-acd2-c9f87479a76b {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:12:23 user nova-compute[73078]: DEBUG nova.network.neutron [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Successfully created port: 350b119d-c27a-4783-9d95-04bc9e75e8f6 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:12:23 user nova-compute[73078]: DEBUG nova.network.neutron [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Successfully updated port: be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:12:23 user nova-compute[73078]: DEBUG nova.compute.manager [req-5f02d314-578b-432d-9cb5-ac7168a5fa7a req-466a89fb-4e76-4b45-9384-0cab29fb47d9 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-changed-be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:12:23 user nova-compute[73078]: DEBUG nova.compute.manager [req-5f02d314-578b-432d-9cb5-ac7168a5fa7a req-466a89fb-4e76-4b45-9384-0cab29fb47d9 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Refreshing instance network info cache due to event network-changed-be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:12:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5f02d314-578b-432d-9cb5-ac7168a5fa7a req-466a89fb-4e76-4b45-9384-0cab29fb47d9 service nova] Acquiring lock "refresh_cache-3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:12:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5f02d314-578b-432d-9cb5-ac7168a5fa7a req-466a89fb-4e76-4b45-9384-0cab29fb47d9 service nova] Acquired lock "refresh_cache-3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:12:23 user nova-compute[73078]: DEBUG nova.network.neutron [req-5f02d314-578b-432d-9cb5-ac7168a5fa7a req-466a89fb-4e76-4b45-9384-0cab29fb47d9 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Refreshing network info cache for port be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:12:24 user nova-compute[73078]: DEBUG nova.network.neutron [req-5f02d314-578b-432d-9cb5-ac7168a5fa7a req-466a89fb-4e76-4b45-9384-0cab29fb47d9 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:12:24 user nova-compute[73078]: DEBUG nova.network.neutron [req-5f02d314-578b-432d-9cb5-ac7168a5fa7a req-466a89fb-4e76-4b45-9384-0cab29fb47d9 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:12:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5f02d314-578b-432d-9cb5-ac7168a5fa7a req-466a89fb-4e76-4b45-9384-0cab29fb47d9 service nova] Releasing lock "refresh_cache-3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:12:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:25 user nova-compute[73078]: DEBUG nova.network.neutron [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Successfully updated port: b845300e-603e-4702-a3cc-cecf5bfcf026 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:12:25 user nova-compute[73078]: DEBUG nova.network.neutron [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Successfully updated port: d1547f0c-cfbd-481c-9657-a3ed79040d1e {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:12:26 user nova-compute[73078]: DEBUG nova.compute.manager [req-2f43608d-e1a1-4d2d-8d46-925cbc72fb55 req-d78735f4-d4bd-4482-b9f9-1bbd32f48bab service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-changed-b845300e-603e-4702-a3cc-cecf5bfcf026 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:12:26 user nova-compute[73078]: DEBUG nova.compute.manager [req-2f43608d-e1a1-4d2d-8d46-925cbc72fb55 req-d78735f4-d4bd-4482-b9f9-1bbd32f48bab service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Refreshing instance network info cache due to event network-changed-b845300e-603e-4702-a3cc-cecf5bfcf026. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:12:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-2f43608d-e1a1-4d2d-8d46-925cbc72fb55 req-d78735f4-d4bd-4482-b9f9-1bbd32f48bab service nova] Acquiring lock "refresh_cache-3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:12:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-2f43608d-e1a1-4d2d-8d46-925cbc72fb55 req-d78735f4-d4bd-4482-b9f9-1bbd32f48bab service nova] Acquired lock "refresh_cache-3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:12:26 user nova-compute[73078]: DEBUG nova.network.neutron [req-2f43608d-e1a1-4d2d-8d46-925cbc72fb55 req-d78735f4-d4bd-4482-b9f9-1bbd32f48bab service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Refreshing network info cache for port b845300e-603e-4702-a3cc-cecf5bfcf026 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:12:26 user nova-compute[73078]: DEBUG nova.network.neutron [req-2f43608d-e1a1-4d2d-8d46-925cbc72fb55 req-d78735f4-d4bd-4482-b9f9-1bbd32f48bab service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:12:26 user nova-compute[73078]: DEBUG nova.network.neutron [req-2f43608d-e1a1-4d2d-8d46-925cbc72fb55 req-d78735f4-d4bd-4482-b9f9-1bbd32f48bab service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:12:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-2f43608d-e1a1-4d2d-8d46-925cbc72fb55 req-d78735f4-d4bd-4482-b9f9-1bbd32f48bab service nova] Releasing lock "refresh_cache-3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:12:26 user nova-compute[73078]: DEBUG nova.compute.manager [req-2f43608d-e1a1-4d2d-8d46-925cbc72fb55 req-d78735f4-d4bd-4482-b9f9-1bbd32f48bab service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-changed-d1547f0c-cfbd-481c-9657-a3ed79040d1e {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:12:26 user nova-compute[73078]: DEBUG nova.compute.manager [req-2f43608d-e1a1-4d2d-8d46-925cbc72fb55 req-d78735f4-d4bd-4482-b9f9-1bbd32f48bab service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Refreshing instance network info cache due to event network-changed-d1547f0c-cfbd-481c-9657-a3ed79040d1e. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:12:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-2f43608d-e1a1-4d2d-8d46-925cbc72fb55 req-d78735f4-d4bd-4482-b9f9-1bbd32f48bab service nova] Acquiring lock "refresh_cache-3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:12:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-2f43608d-e1a1-4d2d-8d46-925cbc72fb55 req-d78735f4-d4bd-4482-b9f9-1bbd32f48bab service nova] Acquired lock "refresh_cache-3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:12:26 user nova-compute[73078]: DEBUG nova.network.neutron [req-2f43608d-e1a1-4d2d-8d46-925cbc72fb55 req-d78735f4-d4bd-4482-b9f9-1bbd32f48bab service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Refreshing network info cache for port d1547f0c-cfbd-481c-9657-a3ed79040d1e {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:12:26 user nova-compute[73078]: DEBUG nova.network.neutron [req-2f43608d-e1a1-4d2d-8d46-925cbc72fb55 req-d78735f4-d4bd-4482-b9f9-1bbd32f48bab service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:12:26 user nova-compute[73078]: DEBUG nova.network.neutron [req-2f43608d-e1a1-4d2d-8d46-925cbc72fb55 req-d78735f4-d4bd-4482-b9f9-1bbd32f48bab service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:12:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-2f43608d-e1a1-4d2d-8d46-925cbc72fb55 req-d78735f4-d4bd-4482-b9f9-1bbd32f48bab service nova] Releasing lock "refresh_cache-3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:12:27 user nova-compute[73078]: DEBUG nova.network.neutron [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Successfully updated port: f725089c-89c9-447a-88e7-a427ad17f344 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:12:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:27 user nova-compute[73078]: DEBUG nova.network.neutron [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Successfully updated port: 0da08486-8ca6-4ab9-8328-7073e9a8b0f3 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:12:28 user nova-compute[73078]: DEBUG nova.compute.manager [req-4502c27f-7130-49ba-b640-f9843a8e2049 req-ac226ba5-0b0a-4547-81a8-f363c769d1be service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-changed-f725089c-89c9-447a-88e7-a427ad17f344 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:12:28 user nova-compute[73078]: DEBUG nova.compute.manager [req-4502c27f-7130-49ba-b640-f9843a8e2049 req-ac226ba5-0b0a-4547-81a8-f363c769d1be service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Refreshing instance network info cache due to event network-changed-f725089c-89c9-447a-88e7-a427ad17f344. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:12:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4502c27f-7130-49ba-b640-f9843a8e2049 req-ac226ba5-0b0a-4547-81a8-f363c769d1be service nova] Acquiring lock "refresh_cache-3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:12:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4502c27f-7130-49ba-b640-f9843a8e2049 req-ac226ba5-0b0a-4547-81a8-f363c769d1be service nova] Acquired lock "refresh_cache-3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:12:28 user nova-compute[73078]: DEBUG nova.network.neutron [req-4502c27f-7130-49ba-b640-f9843a8e2049 req-ac226ba5-0b0a-4547-81a8-f363c769d1be service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Refreshing network info cache for port f725089c-89c9-447a-88e7-a427ad17f344 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:12:28 user nova-compute[73078]: DEBUG nova.network.neutron [req-4502c27f-7130-49ba-b640-f9843a8e2049 req-ac226ba5-0b0a-4547-81a8-f363c769d1be service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:12:28 user nova-compute[73078]: DEBUG nova.network.neutron [req-4502c27f-7130-49ba-b640-f9843a8e2049 req-ac226ba5-0b0a-4547-81a8-f363c769d1be service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:12:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4502c27f-7130-49ba-b640-f9843a8e2049 req-ac226ba5-0b0a-4547-81a8-f363c769d1be service nova] Releasing lock "refresh_cache-3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:12:28 user nova-compute[73078]: DEBUG nova.compute.manager [req-4502c27f-7130-49ba-b640-f9843a8e2049 req-ac226ba5-0b0a-4547-81a8-f363c769d1be service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-changed-0da08486-8ca6-4ab9-8328-7073e9a8b0f3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:12:28 user nova-compute[73078]: DEBUG nova.compute.manager [req-4502c27f-7130-49ba-b640-f9843a8e2049 req-ac226ba5-0b0a-4547-81a8-f363c769d1be service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Refreshing instance network info cache due to event network-changed-0da08486-8ca6-4ab9-8328-7073e9a8b0f3. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:12:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4502c27f-7130-49ba-b640-f9843a8e2049 req-ac226ba5-0b0a-4547-81a8-f363c769d1be service nova] Acquiring lock "refresh_cache-3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:12:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4502c27f-7130-49ba-b640-f9843a8e2049 req-ac226ba5-0b0a-4547-81a8-f363c769d1be service nova] Acquired lock "refresh_cache-3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:12:28 user nova-compute[73078]: DEBUG nova.network.neutron [req-4502c27f-7130-49ba-b640-f9843a8e2049 req-ac226ba5-0b0a-4547-81a8-f363c769d1be service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Refreshing network info cache for port 0da08486-8ca6-4ab9-8328-7073e9a8b0f3 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:12:28 user nova-compute[73078]: DEBUG nova.network.neutron [req-4502c27f-7130-49ba-b640-f9843a8e2049 req-ac226ba5-0b0a-4547-81a8-f363c769d1be service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:12:29 user nova-compute[73078]: DEBUG nova.network.neutron [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Successfully updated port: febea954-f895-4078-acd2-c9f87479a76b {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:12:29 user nova-compute[73078]: DEBUG nova.network.neutron [req-4502c27f-7130-49ba-b640-f9843a8e2049 req-ac226ba5-0b0a-4547-81a8-f363c769d1be service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:12:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4502c27f-7130-49ba-b640-f9843a8e2049 req-ac226ba5-0b0a-4547-81a8-f363c769d1be service nova] Releasing lock "refresh_cache-3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:12:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:30 user nova-compute[73078]: DEBUG nova.network.neutron [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Successfully updated port: 350b119d-c27a-4783-9d95-04bc9e75e8f6 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:12:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Acquiring lock "refresh_cache-3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:12:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Acquired lock "refresh_cache-3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:12:30 user nova-compute[73078]: DEBUG nova.network.neutron [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:12:30 user nova-compute[73078]: DEBUG nova.compute.manager [req-a896a958-4f01-40f2-ae67-85b5f4ae16b1 req-7c6b09e5-a462-4eb3-bc2a-f0a16377ebe5 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-changed-febea954-f895-4078-acd2-c9f87479a76b {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:12:30 user nova-compute[73078]: DEBUG nova.compute.manager [req-a896a958-4f01-40f2-ae67-85b5f4ae16b1 req-7c6b09e5-a462-4eb3-bc2a-f0a16377ebe5 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Refreshing instance network info cache due to event network-changed-febea954-f895-4078-acd2-c9f87479a76b. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:12:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a896a958-4f01-40f2-ae67-85b5f4ae16b1 req-7c6b09e5-a462-4eb3-bc2a-f0a16377ebe5 service nova] Acquiring lock "refresh_cache-3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:12:30 user nova-compute[73078]: DEBUG nova.network.neutron [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:12:31 user nova-compute[73078]: INFO nova.virt.block_device [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Booting with volume 5761720f-50f3-4f26-8579-ab4b261dac6d at /dev/vdb
Aug 14 18:12:31 user nova-compute[73078]: DEBUG os_brick.utils [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:12:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[388e4e47-7431-4bfe-bd61-3144c5a76234]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3064611a-11d6-4877-bdd9-890cf3061e14]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3393d4c-bf64-4753-9f4e-f7366cc9db0b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6056f05e-3927-4c35-8e03-8b64c49c8fcd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:12:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:12:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:12:31 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:12:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de44e7c-d9a8-4acb-bb69-bbead51c29b5]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:12:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:12:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:12:31 user nova-compute[73078]: DEBUG os_brick.utils [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:12:31 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Updating existing volume attachment record: 34053b3f-20f4-48b3-b94a-fc4872052fe9 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:12:32 user nova-compute[73078]: DEBUG nova.network.neutron [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Updating instance_info_cache with network_info: [{"id": "be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0", "address": "fa:16:3e:fd:5d:15", "network": {"id": "b3d5a7bd-ce61-46db-9a30-3da3cc663f58", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-779880358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe9ed0fb-59", "ovs_interfaceid": "be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b845300e-603e-4702-a3cc-cecf5bfcf026", "address": "fa:16:3e:b5:e0:ae", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb845300e-60", "ovs_interfaceid": "b845300e-603e-4702-a3cc-cecf5bfcf026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1547f0c-cfbd-481c-9657-a3ed79040d1e", "address": "fa:16:3e:70:aa:9c", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1547f0c-cf", "ovs_interfaceid": "d1547f0c-cfbd-481c-9657-a3ed79040d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f725089c-89c9-447a-88e7-a427ad17f344", "address": "fa:16:3e:63:ea:ff", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf725089c-89", "ovs_interfaceid": "f725089c-89c9-447a-88e7-a427ad17f344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0da08486-8ca6-4ab9-8328-7073e9a8b0f3", "address": "fa:16:3e:b4:77:23", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da08486-8c", "ovs_interfaceid": "0da08486-8ca6-4ab9-8328-7073e9a8b0f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "febea954-f895-4078-acd2-c9f87479a76b", "address": "fa:16:3e:ee:00:df", "network": {"id": "966cb532-886b-4eef-8b6b-1cdcb9bbe9c1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1607312863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebea954-f8", "ovs_interfaceid": "febea954-f895-4078-acd2-c9f87479a76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "350b119d-c27a-4783-9d95-04bc9e75e8f6", "address": "fa:16:3e:61:d4:d6", "network": {"id": "966cb532-886b-4eef-8b6b-1cdcb9bbe9c1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1607312863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350b119d-c2", "ovs_interfaceid": "350b119d-c27a-4783-9d95-04bc9e75e8f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:12:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Releasing lock "refresh_cache-3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:12:32 user nova-compute[73078]: DEBUG nova.compute.manager [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Instance network_info: |[{"id": "be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0", "address": "fa:16:3e:fd:5d:15", "network": {"id": "b3d5a7bd-ce61-46db-9a30-3da3cc663f58", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-779880358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe9ed0fb-59", "ovs_interfaceid": "be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b845300e-603e-4702-a3cc-cecf5bfcf026", "address": "fa:16:3e:b5:e0:ae", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb845300e-60", "ovs_interfaceid": "b845300e-603e-4702-a3cc-cecf5bfcf026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1547f0c-cfbd-481c-9657-a3ed79040d1e", "address": "fa:16:3e:70:aa:9c", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1547f0c-cf", "ovs_interfaceid": "d1547f0c-cfbd-481c-9657-a3ed79040d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f725089c-89c9-447a-88e7-a427ad17f344", "address": "fa:16:3e:63:ea:ff", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf725089c-89", "ovs_interfaceid": "f725089c-89c9-447a-88e7-a427ad17f344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0da08486-8ca6-4ab9-8328-7073e9a8b0f3", "address": "fa:16:3e:b4:77:23", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da08486-8c", "ovs_interfaceid": "0da08486-8ca6-4ab9-8328-7073e9a8b0f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "febea954-f895-4078-acd2-c9f87479a76b", "address": "fa:16:3e:ee:00:df", "network": {"id": "966cb532-886b-4eef-8b6b-1cdcb9bbe9c1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1607312863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebea954-f8", "ovs_interfaceid": "febea954-f895-4078-acd2-c9f87479a76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "350b119d-c27a-4783-9d95-04bc9e75e8f6", "address": "fa:16:3e:61:d4:d6", "network": {"id": "966cb532-886b-4eef-8b6b-1cdcb9bbe9c1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1607312863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350b119d-c2", "ovs_interfaceid": "350b119d-c27a-4783-9d95-04bc9e75e8f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:12:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a896a958-4f01-40f2-ae67-85b5f4ae16b1 req-7c6b09e5-a462-4eb3-bc2a-f0a16377ebe5 service nova] Acquired lock "refresh_cache-3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:12:32 user nova-compute[73078]: DEBUG nova.network.neutron [req-a896a958-4f01-40f2-ae67-85b5f4ae16b1 req-7c6b09e5-a462-4eb3-bc2a-f0a16377ebe5 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Refreshing network info cache for port febea954-f895-4078-acd2-c9f87479a76b {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:12:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:32 user nova-compute[73078]: DEBUG nova.network.neutron [req-a896a958-4f01-40f2-ae67-85b5f4ae16b1 req-7c6b09e5-a462-4eb3-bc2a-f0a16377ebe5 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Updated VIF entry in instance network info cache for port febea954-f895-4078-acd2-c9f87479a76b. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:12:32 user nova-compute[73078]: DEBUG nova.network.neutron [req-a896a958-4f01-40f2-ae67-85b5f4ae16b1 req-7c6b09e5-a462-4eb3-bc2a-f0a16377ebe5 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Updating instance_info_cache with network_info: [{"id": "be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0", "address": "fa:16:3e:fd:5d:15", "network": {"id": "b3d5a7bd-ce61-46db-9a30-3da3cc663f58", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-779880358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe9ed0fb-59", "ovs_interfaceid": "be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b845300e-603e-4702-a3cc-cecf5bfcf026", "address": "fa:16:3e:b5:e0:ae", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb845300e-60", "ovs_interfaceid": "b845300e-603e-4702-a3cc-cecf5bfcf026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1547f0c-cfbd-481c-9657-a3ed79040d1e", "address": "fa:16:3e:70:aa:9c", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1547f0c-cf", "ovs_interfaceid": "d1547f0c-cfbd-481c-9657-a3ed79040d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f725089c-89c9-447a-88e7-a427ad17f344", "address": "fa:16:3e:63:ea:ff", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf725089c-89", "ovs_interfaceid": "f725089c-89c9-447a-88e7-a427ad17f344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0da08486-8ca6-4ab9-8328-7073e9a8b0f3", "address": "fa:16:3e:b4:77:23", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da08486-8c", "ovs_interfaceid": "0da08486-8ca6-4ab9-8328-7073e9a8b0f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "febea954-f895-4078-acd2-c9f87479a76b", "address": "fa:16:3e:ee:00:df", "network": {"id": "966cb532-886b-4eef-8b6b-1cdcb9bbe9c1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1607312863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebea954-f8", "ovs_interfaceid": "febea954-f895-4078-acd2-c9f87479a76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "350b119d-c27a-4783-9d95-04bc9e75e8f6", "address": "fa:16:3e:61:d4:d6", "network": {"id": "966cb532-886b-4eef-8b6b-1cdcb9bbe9c1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1607312863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350b119d-c2", "ovs_interfaceid": "350b119d-c27a-4783-9d95-04bc9e75e8f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:12:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a896a958-4f01-40f2-ae67-85b5f4ae16b1 req-7c6b09e5-a462-4eb3-bc2a-f0a16377ebe5 service nova] Releasing lock "refresh_cache-3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:12:32 user nova-compute[73078]: DEBUG nova.compute.manager [req-a896a958-4f01-40f2-ae67-85b5f4ae16b1 req-7c6b09e5-a462-4eb3-bc2a-f0a16377ebe5 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-changed-350b119d-c27a-4783-9d95-04bc9e75e8f6 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:12:32 user nova-compute[73078]: DEBUG nova.compute.manager [req-a896a958-4f01-40f2-ae67-85b5f4ae16b1 req-7c6b09e5-a462-4eb3-bc2a-f0a16377ebe5 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Refreshing instance network info cache due to event network-changed-350b119d-c27a-4783-9d95-04bc9e75e8f6. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:12:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a896a958-4f01-40f2-ae67-85b5f4ae16b1 req-7c6b09e5-a462-4eb3-bc2a-f0a16377ebe5 service nova] Acquiring lock "refresh_cache-3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:12:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a896a958-4f01-40f2-ae67-85b5f4ae16b1 req-7c6b09e5-a462-4eb3-bc2a-f0a16377ebe5 service nova] Acquired lock "refresh_cache-3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:12:32 user nova-compute[73078]: DEBUG nova.network.neutron [req-a896a958-4f01-40f2-ae67-85b5f4ae16b1 req-7c6b09e5-a462-4eb3-bc2a-f0a16377ebe5 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Refreshing network info cache for port 350b119d-c27a-4783-9d95-04bc9e75e8f6 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:12:33 user nova-compute[73078]: DEBUG nova.network.neutron [req-a896a958-4f01-40f2-ae67-85b5f4ae16b1 req-7c6b09e5-a462-4eb3-bc2a-f0a16377ebe5 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Updated VIF entry in instance network info cache for port 350b119d-c27a-4783-9d95-04bc9e75e8f6. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:12:33 user nova-compute[73078]: DEBUG nova.network.neutron [req-a896a958-4f01-40f2-ae67-85b5f4ae16b1 req-7c6b09e5-a462-4eb3-bc2a-f0a16377ebe5 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Updating instance_info_cache with network_info: [{"id": "be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0", "address": "fa:16:3e:fd:5d:15", "network": {"id": "b3d5a7bd-ce61-46db-9a30-3da3cc663f58", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-779880358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe9ed0fb-59", "ovs_interfaceid": "be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b845300e-603e-4702-a3cc-cecf5bfcf026", "address": "fa:16:3e:b5:e0:ae", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb845300e-60", "ovs_interfaceid": "b845300e-603e-4702-a3cc-cecf5bfcf026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1547f0c-cfbd-481c-9657-a3ed79040d1e", "address": "fa:16:3e:70:aa:9c", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1547f0c-cf", "ovs_interfaceid": "d1547f0c-cfbd-481c-9657-a3ed79040d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f725089c-89c9-447a-88e7-a427ad17f344", "address": "fa:16:3e:63:ea:ff", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf725089c-89", "ovs_interfaceid": "f725089c-89c9-447a-88e7-a427ad17f344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0da08486-8ca6-4ab9-8328-7073e9a8b0f3", "address": "fa:16:3e:b4:77:23", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da08486-8c", "ovs_interfaceid": "0da08486-8ca6-4ab9-8328-7073e9a8b0f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "febea954-f895-4078-acd2-c9f87479a76b", "address": "fa:16:3e:ee:00:df", "network": {"id": "966cb532-886b-4eef-8b6b-1cdcb9bbe9c1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1607312863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebea954-f8", "ovs_interfaceid": "febea954-f895-4078-acd2-c9f87479a76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "350b119d-c27a-4783-9d95-04bc9e75e8f6", "address": "fa:16:3e:61:d4:d6", "network": {"id": "966cb532-886b-4eef-8b6b-1cdcb9bbe9c1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1607312863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350b119d-c2", "ovs_interfaceid": "350b119d-c27a-4783-9d95-04bc9e75e8f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:12:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a896a958-4f01-40f2-ae67-85b5f4ae16b1 req-7c6b09e5-a462-4eb3-bc2a-f0a16377ebe5 service nova] Releasing lock "refresh_cache-3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:12:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:39 user nova-compute[73078]: INFO nova.virt.block_device [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Booting with volume 2e6f49ae-37c7-45ef-a014-0769abee5246 at /dev/vdc
Aug 14 18:12:39 user nova-compute[73078]: DEBUG os_brick.utils [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:12:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3dec6fd-8f25-44c4-a338-65297e685d63]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb0128c-3306-484c-a022-b281752ab9c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5f0876-bce5-439a-ba67-0b0a41cdee69]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a191e88-5430-4ec2-92a1-4f15d50b9034]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:12:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:12:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:12:39 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:12:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c82650-a0e2-4b93-acd6-5788f19df848]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:12:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:12:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:12:39 user nova-compute[73078]: DEBUG os_brick.utils [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:12:39 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Updating existing volume attachment record: df3bd456-6751-4954-ac2a-29ad45abe825 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:12:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Acquiring lock "c29d7f9d-793f-4511-9203-06b653e52f72" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:12:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Lock "c29d7f9d-793f-4511-9203-06b653e52f72" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:12:41 user nova-compute[73078]: DEBUG nova.objects.instance [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Lazy-loading 'flavor' on Instance uuid c29d7f9d-793f-4511-9203-06b653e52f72 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:12:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Lock "c29d7f9d-793f-4511-9203-06b653e52f72" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:12:41 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:12:41 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:12:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Acquiring lock "c29d7f9d-793f-4511-9203-06b653e52f72" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:12:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Lock "c29d7f9d-793f-4511-9203-06b653e52f72" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:12:41 user nova-compute[73078]: INFO nova.compute.manager [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Attaching volume 16da3a46-e07a-42db-9b3d-1516073a81e9 to /dev/vdb
Aug 14 18:12:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-de80e188-9385-4613-8a6c-aa72b624ad55" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:12:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-de80e188-9385-4613-8a6c-aa72b624ad55" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:12:41 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:12:41 user nova-compute[73078]: DEBUG os_brick.utils [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:12:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:41 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f25ed21-5321-4d2c-8c20-6ee929db2d20]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:41 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9492bc34-90ef-4605-a307-20d996a5a450]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:41 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9626ea19-40fd-4216-9785-f28e95d48dec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:41 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8531233-c510-4f12-893e-4ef5caf352a3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:12:41 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:12:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:12:41 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:12:41 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f835c2-427c-4b40-b22f-617cb18f4d9c]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:41 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:12:41 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:12:41 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:12:41 user nova-compute[73078]: DEBUG os_brick.utils [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:12:41 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Updating existing volume attachment record: e5b9c7f3-e6ed-434f-8b3f-cf11ba0ed337 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:12:41 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Updating instance_info_cache with network_info: [{"id": "2afe973c-46fa-4336-996f-b5dcd374c96e", "address": "fa:16:3e:5d:60:2f", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe973c-46", "ovs_interfaceid": "2afe973c-46fa-4336-996f-b5dcd374c96e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:12:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-de80e188-9385-4613-8a6c-aa72b624ad55" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:12:41 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:12:42 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:12:42 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:12:42 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:12:43 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:12:43 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:12:43 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:12:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:12:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:12:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:12:43 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:12:43 user nova-compute[73078]: INFO nova.compute.manager [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Rescuing
Aug 14 18:12:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "refresh_cache-3c840309-9884-4c8a-a6ee-1acd44f32c4c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:12:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquired lock "refresh_cache-3c840309-9884-4c8a-a6ee-1acd44f32c4c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:12:43 user nova-compute[73078]: DEBUG nova.network.neutron [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:12:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:44 user nova-compute[73078]: DEBUG nova.compute.manager [req-e9e9bb3f-87cd-434c-bfd7-ee51e5911c94 req-bfe099bd-d9bb-4ba5-9149-c928ad767da8 service nova] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Received event network-changed-8df77a26-faab-47ca-a39b-3df6930cd1d5 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:12:44 user nova-compute[73078]: DEBUG nova.compute.manager [req-e9e9bb3f-87cd-434c-bfd7-ee51e5911c94 req-bfe099bd-d9bb-4ba5-9149-c928ad767da8 service nova] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Refreshing instance network info cache due to event network-changed-8df77a26-faab-47ca-a39b-3df6930cd1d5. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:12:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e9e9bb3f-87cd-434c-bfd7-ee51e5911c94 req-bfe099bd-d9bb-4ba5-9149-c928ad767da8 service nova] Acquiring lock "refresh_cache-1f88cb97-4f22-439e-99f2-d7cb8d5aff36" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:12:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e9e9bb3f-87cd-434c-bfd7-ee51e5911c94 req-bfe099bd-d9bb-4ba5-9149-c928ad767da8 service nova] Acquired lock "refresh_cache-1f88cb97-4f22-439e-99f2-d7cb8d5aff36" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:12:44 user nova-compute[73078]: DEBUG nova.network.neutron [req-e9e9bb3f-87cd-434c-bfd7-ee51e5911c94 req-bfe099bd-d9bb-4ba5-9149-c928ad767da8 service nova] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Refreshing network info cache for port 8df77a26-faab-47ca-a39b-3df6930cd1d5 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:12:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c29d7f9d-793f-4511-9203-06b653e52f72/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c29d7f9d-793f-4511-9203-06b653e52f72/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c29d7f9d-793f-4511-9203-06b653e52f72/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c29d7f9d-793f-4511-9203-06b653e52f72/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:44 user nova-compute[73078]: DEBUG nova.network.neutron [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Updating instance_info_cache with network_info: [{"id": "03e9ece7-7612-4a4f-86ab-d85b0c97d723", "address": "fa:16:3e:70:6a:64", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e9ece7-76", "ovs_interfaceid": "03e9ece7-7612-4a4f-86ab-d85b0c97d723", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:12:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Releasing lock "refresh_cache-3c840309-9884-4c8a-a6ee-1acd44f32c4c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:12:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b97b330e-7a72-4d3c-8810-98a4f3a27ce7/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b97b330e-7a72-4d3c-8810-98a4f3a27ce7/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b97b330e-7a72-4d3c-8810-98a4f3a27ce7/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b97b330e-7a72-4d3c-8810-98a4f3a27ce7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG nova.network.neutron [req-e9e9bb3f-87cd-434c-bfd7-ee51e5911c94 req-bfe099bd-d9bb-4ba5-9149-c928ad767da8 service nova] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Updated VIF entry in instance network info cache for port 8df77a26-faab-47ca-a39b-3df6930cd1d5. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG nova.network.neutron [req-e9e9bb3f-87cd-434c-bfd7-ee51e5911c94 req-bfe099bd-d9bb-4ba5-9149-c928ad767da8 service nova] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Updating instance_info_cache with network_info: [{"id": "8df77a26-faab-47ca-a39b-3df6930cd1d5", "address": "fa:16:3e:2d:25:52", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df77a26-fa", "ovs_interfaceid": "8df77a26-faab-47ca-a39b-3df6930cd1d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG nova.compute.manager [req-0deb17eb-bfc4-418f-b9c9-602d572f0061 req-2feeceac-458f-4b26-ae8a-67eae513403e service nova] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Received event network-vif-unplugged-03e9ece7-7612-4a4f-86ab-d85b0c97d723 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0deb17eb-bfc4-418f-b9c9-602d572f0061 req-2feeceac-458f-4b26-ae8a-67eae513403e service nova] Acquiring lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0deb17eb-bfc4-418f-b9c9-602d572f0061 req-2feeceac-458f-4b26-ae8a-67eae513403e service nova] Lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0deb17eb-bfc4-418f-b9c9-602d572f0061 req-2feeceac-458f-4b26-ae8a-67eae513403e service nova] Lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG nova.compute.manager [req-0deb17eb-bfc4-418f-b9c9-602d572f0061 req-2feeceac-458f-4b26-ae8a-67eae513403e service nova] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] No waiting events found dispatching network-vif-unplugged-03e9ece7-7612-4a4f-86ab-d85b0c97d723 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:12:45 user nova-compute[73078]: WARNING nova.compute.manager [req-0deb17eb-bfc4-418f-b9c9-602d572f0061 req-2feeceac-458f-4b26-ae8a-67eae513403e service nova] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Received unexpected event network-vif-unplugged-03e9ece7-7612-4a4f-86ab-d85b0c97d723 for instance with vm_state active and task_state rescuing.
Aug 14 18:12:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e9e9bb3f-87cd-434c-bfd7-ee51e5911c94 req-bfe099bd-d9bb-4ba5-9149-c928ad767da8 service nova] Releasing lock "refresh_cache-1f88cb97-4f22-439e-99f2-d7cb8d5aff36" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:12:45 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Instance destroyed successfully.
Aug 14 18:12:45 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Attempting rescue
Aug 14 18:12:45 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73078) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Instance directory exists: not creating {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 18:12:45 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Creating image(s)
Aug 14 18:12:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "/opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "/opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "/opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG nova.objects.instance [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3c840309-9884-4c8a-a6ee-1acd44f32c4c {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.178s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue" returned: 0 in 0.182s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.367s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG nova.objects.instance [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lazy-loading 'migration_context' on Instance uuid 3c840309-9884-4c8a-a6ee-1acd44f32c4c {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Start _get_guest_xml network_info=[{"id": "03e9ece7-7612-4a4f-86ab-d85b0c97d723", "address": "fa:16:3e:70:6a:64", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "vif_mac": "fa:16:3e:70:6a:64"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e9ece7-76", "ovs_interfaceid": "03e9ece7-7612-4a4f-86ab-d85b0c97d723", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG nova.objects.instance [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lazy-loading 'resources' on Instance uuid 3c840309-9884-4c8a-a6ee-1acd44f32c4c {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG nova.objects.instance [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lazy-loading 'numa_topology' on Instance uuid 3c840309-9884-4c8a-a6ee-1acd44f32c4c {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:12:45 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:12:45 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:12:45 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:12:45 user nova-compute[73078]: DEBUG nova.objects.instance [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3c840309-9884-4c8a-a6ee-1acd44f32c4c {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:12:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:10:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1378236224',display_name='tempest-ServerRescueNegativeTestJSON-server-1378236224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1378236224',id=4,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:11:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ec53c6018ee44b09ee31ba712a789aa',ramdisk_id='',reservation_id='r-7hiu473d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-38557121',owner_user_name='tempest-ServerRescueNegativeTestJSON-38557121-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:11:18Z,user_data=None,user_id='d25ecea70e9e481e8a1957a94d79edfc',uuid=3c840309-9884-4c8a-a6ee-1acd44f32c4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03e9ece7-7612-4a4f-86ab-d85b0c97d723", "address": "fa:16:3e:70:6a:64", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "vif_mac": "fa:16:3e:70:6a:64"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e9ece7-76", "ovs_interfaceid": "03e9ece7-7612-4a4f-86ab-d85b0c97d723", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:12:46 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Converting VIF {"id": "03e9ece7-7612-4a4f-86ab-d85b0c97d723", "address": "fa:16:3e:70:6a:64", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "vif_mac": "fa:16:3e:70:6a:64"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e9ece7-76", "ovs_interfaceid": "03e9ece7-7612-4a4f-86ab-d85b0c97d723", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:12:46 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:6a:64,bridge_name='br-int',has_traffic_filtering=True,id=03e9ece7-7612-4a4f-86ab-d85b0c97d723,network=Network(33518dc6-7963-4995-b4c7-86d60b44a22f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03e9ece7-76') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:12:46 user nova-compute[73078]: DEBUG nova.objects.instance [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c840309-9884-4c8a-a6ee-1acd44f32c4c {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:12:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:12:46 user nova-compute[73078]:   <uuid>3c840309-9884-4c8a-a6ee-1acd44f32c4c</uuid>
Aug 14 18:12:46 user nova-compute[73078]:   <name>instance-00000004</name>
Aug 14 18:12:46 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:12:46 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:12:46 user nova-compute[73078]:   <metadata>
Aug 14 18:12:46 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:12:46 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:12:46 user nova-compute[73078]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1378236224</nova:name>
Aug 14 18:12:46 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:12:45</nova:creationTime>
Aug 14 18:12:46 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:12:46 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:12:46 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:12:46 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:12:46 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:12:46 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:12:46 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:12:46 user nova-compute[73078]:       <nova:owner>
Aug 14 18:12:46 user nova-compute[73078]:         <nova:user uuid="d25ecea70e9e481e8a1957a94d79edfc">tempest-ServerRescueNegativeTestJSON-38557121-project-member</nova:user>
Aug 14 18:12:46 user nova-compute[73078]:         <nova:project uuid="4ec53c6018ee44b09ee31ba712a789aa">tempest-ServerRescueNegativeTestJSON-38557121</nova:project>
Aug 14 18:12:46 user nova-compute[73078]:       </nova:owner>
Aug 14 18:12:46 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:12:46 user nova-compute[73078]:       <nova:ports>
Aug 14 18:12:46 user nova-compute[73078]:         <nova:port uuid="03e9ece7-7612-4a4f-86ab-d85b0c97d723">
Aug 14 18:12:46 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 18:12:46 user nova-compute[73078]:         </nova:port>
Aug 14 18:12:46 user nova-compute[73078]:       </nova:ports>
Aug 14 18:12:46 user nova-compute[73078]:     </nova:instance>
Aug 14 18:12:46 user nova-compute[73078]:   </metadata>
Aug 14 18:12:46 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:12:46 user nova-compute[73078]:     <system>
Aug 14 18:12:46 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:12:46 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:12:46 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:12:46 user nova-compute[73078]:       <entry name="serial">3c840309-9884-4c8a-a6ee-1acd44f32c4c</entry>
Aug 14 18:12:46 user nova-compute[73078]:       <entry name="uuid">3c840309-9884-4c8a-a6ee-1acd44f32c4c</entry>
Aug 14 18:12:46 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:12:46 user nova-compute[73078]:     </system>
Aug 14 18:12:46 user nova-compute[73078]:   </sysinfo>
Aug 14 18:12:46 user nova-compute[73078]:   <os>
Aug 14 18:12:46 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:12:46 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:12:46 user nova-compute[73078]:   </os>
Aug 14 18:12:46 user nova-compute[73078]:   <features>
Aug 14 18:12:46 user nova-compute[73078]:     <acpi/>
Aug 14 18:12:46 user nova-compute[73078]:     <apic/>
Aug 14 18:12:46 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:12:46 user nova-compute[73078]:   </features>
Aug 14 18:12:46 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:12:46 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:12:46 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:12:46 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:12:46 user nova-compute[73078]:   </clock>
Aug 14 18:12:46 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:12:46 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:12:46 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:12:46 user nova-compute[73078]:   </cpu>
Aug 14 18:12:46 user nova-compute[73078]:   <devices>
Aug 14 18:12:46 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:12:46 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:12:46 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue"/>
Aug 14 18:12:46 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:12:46 user nova-compute[73078]:     </disk>
Aug 14 18:12:46 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:12:46 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:12:46 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk"/>
Aug 14 18:12:46 user nova-compute[73078]:       <target dev="vdb" bus="virtio"/>
Aug 14 18:12:46 user nova-compute[73078]:     </disk>
Aug 14 18:12:46 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:12:46 user nova-compute[73078]:       <mac address="fa:16:3e:70:6a:64"/>
Aug 14 18:12:46 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:12:46 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:12:46 user nova-compute[73078]:       <target dev="tap03e9ece7-76"/>
Aug 14 18:12:46 user nova-compute[73078]:     </interface>
Aug 14 18:12:46 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:12:46 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/console.log" append="off"/>
Aug 14 18:12:46 user nova-compute[73078]:     </serial>
Aug 14 18:12:46 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:12:46 user nova-compute[73078]:     <video>
Aug 14 18:12:46 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:12:46 user nova-compute[73078]:     </video>
Aug 14 18:12:46 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:12:46 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:12:46 user nova-compute[73078]:     </rng>
Aug 14 18:12:46 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:12:46 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:12:46 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:12:46 user nova-compute[73078]:     </memballoon>
Aug 14 18:12:46 user nova-compute[73078]:   </devices>
Aug 14 18:12:46 user nova-compute[73078]: </domain>
Aug 14 18:12:46 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:12:46 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Instance destroyed successfully.
Aug 14 18:12:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:12:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:12:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] No VIF found with MAC fa:16:3e:70:6a:64, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:12:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:47 user nova-compute[73078]: DEBUG nova.compute.manager [req-0d1d767d-dd97-4cc4-9a29-1dac55634aa9 req-852fb21d-af5a-4357-9ebb-bde12bf286ae service nova] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Received event network-vif-plugged-03e9ece7-7612-4a4f-86ab-d85b0c97d723 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:12:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0d1d767d-dd97-4cc4-9a29-1dac55634aa9 req-852fb21d-af5a-4357-9ebb-bde12bf286ae service nova] Acquiring lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:12:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0d1d767d-dd97-4cc4-9a29-1dac55634aa9 req-852fb21d-af5a-4357-9ebb-bde12bf286ae service nova] Lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:12:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0d1d767d-dd97-4cc4-9a29-1dac55634aa9 req-852fb21d-af5a-4357-9ebb-bde12bf286ae service nova] Lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:12:47 user nova-compute[73078]: DEBUG nova.compute.manager [req-0d1d767d-dd97-4cc4-9a29-1dac55634aa9 req-852fb21d-af5a-4357-9ebb-bde12bf286ae service nova] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] No waiting events found dispatching network-vif-plugged-03e9ece7-7612-4a4f-86ab-d85b0c97d723 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:12:47 user nova-compute[73078]: WARNING nova.compute.manager [req-0d1d767d-dd97-4cc4-9a29-1dac55634aa9 req-852fb21d-af5a-4357-9ebb-bde12bf286ae service nova] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Received unexpected event network-vif-plugged-03e9ece7-7612-4a4f-86ab-d85b0c97d723 for instance with vm_state active and task_state rescuing.
Aug 14 18:12:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d44771-7499-43ac-972a-22b9d9fd6840/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d44771-7499-43ac-972a-22b9d9fd6840/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d44771-7499-43ac-972a-22b9d9fd6840/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d44771-7499-43ac-972a-22b9d9fd6840/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8ad453e-67b1-4af2-b85b-a5e100c11446/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8ad453e-67b1-4af2-b85b-a5e100c11446/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8ad453e-67b1-4af2-b85b-a5e100c11446/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG nova.compute.manager [req-5e24559e-1dc5-4304-a734-67a913d9b97f req-4af36e29-d97a-47f2-94d9-cca1bc171a47 service nova] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Received event network-vif-plugged-03e9ece7-7612-4a4f-86ab-d85b0c97d723 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5e24559e-1dc5-4304-a734-67a913d9b97f req-4af36e29-d97a-47f2-94d9-cca1bc171a47 service nova] Acquiring lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5e24559e-1dc5-4304-a734-67a913d9b97f req-4af36e29-d97a-47f2-94d9-cca1bc171a47 service nova] Lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5e24559e-1dc5-4304-a734-67a913d9b97f req-4af36e29-d97a-47f2-94d9-cca1bc171a47 service nova] Lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG nova.compute.manager [req-5e24559e-1dc5-4304-a734-67a913d9b97f req-4af36e29-d97a-47f2-94d9-cca1bc171a47 service nova] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] No waiting events found dispatching network-vif-plugged-03e9ece7-7612-4a4f-86ab-d85b0c97d723 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:12:49 user nova-compute[73078]: WARNING nova.compute.manager [req-5e24559e-1dc5-4304-a734-67a913d9b97f req-4af36e29-d97a-47f2-94d9-cca1bc171a47 service nova] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Received unexpected event network-vif-plugged-03e9ece7-7612-4a4f-86ab-d85b0c97d723 for instance with vm_state active and task_state rescuing.
Aug 14 18:12:49 user nova-compute[73078]: DEBUG nova.compute.manager [req-5e24559e-1dc5-4304-a734-67a913d9b97f req-4af36e29-d97a-47f2-94d9-cca1bc171a47 service nova] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Received event network-vif-plugged-03e9ece7-7612-4a4f-86ab-d85b0c97d723 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5e24559e-1dc5-4304-a734-67a913d9b97f req-4af36e29-d97a-47f2-94d9-cca1bc171a47 service nova] Acquiring lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5e24559e-1dc5-4304-a734-67a913d9b97f req-4af36e29-d97a-47f2-94d9-cca1bc171a47 service nova] Lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5e24559e-1dc5-4304-a734-67a913d9b97f req-4af36e29-d97a-47f2-94d9-cca1bc171a47 service nova] Lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG nova.compute.manager [req-5e24559e-1dc5-4304-a734-67a913d9b97f req-4af36e29-d97a-47f2-94d9-cca1bc171a47 service nova] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] No waiting events found dispatching network-vif-plugged-03e9ece7-7612-4a4f-86ab-d85b0c97d723 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:12:49 user nova-compute[73078]: WARNING nova.compute.manager [req-5e24559e-1dc5-4304-a734-67a913d9b97f req-4af36e29-d97a-47f2-94d9-cca1bc171a47 service nova] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Received unexpected event network-vif-plugged-03e9ece7-7612-4a4f-86ab-d85b0c97d723 for instance with vm_state active and task_state rescuing.
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8ad453e-67b1-4af2-b85b-a5e100c11446/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG nova.compute.manager [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:12:49 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Creating image(s)
Aug 14 18:12:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Did not create local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Ensure instance console log exists: /opt/stack/data/nova/instances/3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Start _get_guest_xml network_info=[{"id": "be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0", "address": "fa:16:3e:fd:5d:15", "network": {"id": "b3d5a7bd-ce61-46db-9a30-3da3cc663f58", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-779880358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe9ed0fb-59", "ovs_interfaceid": "be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b845300e-603e-4702-a3cc-cecf5bfcf026", "address": "fa:16:3e:b5:e0:ae", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb845300e-60", "ovs_interfaceid": "b845300e-603e-4702-a3cc-cecf5bfcf026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1547f0c-cfbd-481c-9657-a3ed79040d1e", "address": "fa:16:3e:70:aa:9c", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1547f0c-cf", "ovs_interfaceid": "d1547f0c-cfbd-481c-9657-a3ed79040d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f725089c-89c9-447a-88e7-a427ad17f344", "address": "fa:16:3e:63:ea:ff", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf725089c-89", "ovs_interfaceid": "f725089c-89c9-447a-88e7-a427ad17f344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0da08486-8ca6-4ab9-8328-7073e9a8b0f3", "address": "fa:16:3e:b4:77:23", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da08486-8c", "ovs_interfaceid": "0da08486-8ca6-4ab9-8328-7073e9a8b0f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "febea954-f895-4078-acd2-c9f87479a76b", "address": "fa:16:3e:ee:00:df", "network": {"id": "966cb532-886b-4eef-8b6b-1cdcb9bbe9c1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1607312863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebea954-f8", "ovs_interfaceid": "febea954-f895-4078-acd2-c9f87479a76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "350b119d-c27a-4783-9d95-04bc9e75e8f6", "address": "fa:16:3e:61:d4:d6", "network": {"id": "966cb532-886b-4eef-8b6b-1cdcb9bbe9c1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1607312863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350b119d-c2", "ovs_interfaceid": "350b119d-c27a-4783-9d95-04bc9e75e8f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '3356a1fa-73eb-45eb-818f-b9cc00d70ad8', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pOBaPDVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223', 'attached_at': '', 'detached_at': '', 'volume_id': '63b60218-2eb0-4ccb-9d46-def6b4b3ce6f', 'serial': '63b60218-2eb0-4ccb-9d46-def6b4b3ce6f'}, 'volume_type': None}, {'mount_device': '/dev/vdb', 'attachment_id': '34053b3f-20f4-48b3-b94a-fc4872052fe9', 'boot_index': 1, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UsmfVtjk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223', 'attached_at': '', 'detached_at': '', 'volume_id': '5761720f-50f3-4f26-8579-ab4b261dac6d', 'serial': '5761720f-50f3-4f26-8579-ab4b261dac6d'}, 'volume_type': None}, {'mount_device': '/dev/vdc', 'attachment_id': 'df3bd456-6751-4954-ac2a-29ad45abe825', 'boot_index': 2, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VzRknyKA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223', 'attached_at': '', 'detached_at': '', 'volume_id': '2e6f49ae-37c7-45ef-a014-0769abee5246', 'serial': '2e6f49ae-37c7-45ef-a014-0769abee5246'}, 'volume_type': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:12:49 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:12:49 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:12:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG os_brick.initiator.connector [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Factory for ISCSI on None {{(pid=73078) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pOBaPDVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:12:49 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:12:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:12:49 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:12:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:12:49 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9972546b-d941-47d8-b166-5ee5f31934ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:12:49 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b733f340-9dae-4fa0-a1d7-d18b850b08a5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f] added
Aug 14 18:12:49 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1eba7e0-7133-474b-9a58-5b3f48c3c587]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Removed pending event for 3c840309-9884-4c8a-a6ee-1acd44f32c4c due to event {{(pid=73078) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036769.7179563, 3c840309-9884-4c8a-a6ee-1acd44f32c4c => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:12:49 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] VM Resumed (Lifecycle Event)
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a3a5d8-43dd-4fa5-97b8-8b92e4fab2ba]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG nova.compute.manager [None req-b592e203-af27-4abd-9c6c-0f2d4bed00df tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pOBaPDVt {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pOBaPDVt" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf10399-d3f6-42ff-b559-e5d7973ef296]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pOBaPDVt'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:49 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 18:12:49 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036769.7199972, 3c840309-9884-4c8a-a6ee-1acd44f32c4c => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:12:49 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] VM Started (Lifecycle Event)
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[274b30c9-7a51-464a-9cd4-5db96e2d4e65]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[786a0ad1-fff3-422f-b0f5-2f037f1c7b05]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 18:12:49 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 18:12:49 user nova-compute[73078]:  {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:12:49 user nova-compute[73078]: WARNING os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 18:12:49 user nova-compute[73078]: 
Aug 14 18:12:49 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d777439-669d-4734-9a1a-df704b38763f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f, portal: 172.16.0.220,3260]
Aug 14 18:12:49 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f, portal: 172.16.0.220,3260] successful.
Aug 14 18:12:49 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:12:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa7d675-9ade-42c7-86ad-06fa2159050c]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG nova.compute.manager [req-cbc4df5d-e9aa-40a0-a0d2-a67026295b79 req-3ec8f8d9-577e-418d-b4fe-dae062359823 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Received event network-changed-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG nova.compute.manager [req-cbc4df5d-e9aa-40a0-a0d2-a67026295b79 req-3ec8f8d9-577e-418d-b4fe-dae062359823 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Refreshing instance network info cache due to event network-changed-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-cbc4df5d-e9aa-40a0-a0d2-a67026295b79 req-3ec8f8d9-577e-418d-b4fe-dae062359823 service nova] Acquiring lock "refresh_cache-24c00db3-2457-443d-b5ab-7e6ecaa57515" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-cbc4df5d-e9aa-40a0-a0d2-a67026295b79 req-3ec8f8d9-577e-418d-b4fe-dae062359823 service nova] Acquired lock "refresh_cache-24c00db3-2457-443d-b5ab-7e6ecaa57515" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG nova.network.neutron [req-cbc4df5d-e9aa-40a0-a0d2-a67026295b79 req-3ec8f8d9-577e-418d-b4fe-dae062359823 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Refreshing network info cache for port 99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:12:50 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 18:12:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:50 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:12:50 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:12:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=6396MB free_disk=25.458232879638672GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bf15c9-8c0a-44c6-9069-9655fce04ef8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:12:50 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:12:50 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.850s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.029s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77c6c7c-fe9c-4fa8-a115-fb948ef02606]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pOBaPDVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance c29d7f9d-793f-4511-9203-06b653e52f72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance de80e188-9385-4613-8a6c-aa72b624ad55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 1f88cb97-4f22-439e-99f2-d7cb8d5aff36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 3c840309-9884-4c8a-a6ee-1acd44f32c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 24c00db3-2457-443d-b5ab-7e6ecaa57515 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 8d257202-d8ab-4161-9b67-045cf1e36772 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance b97b330e-7a72-4d3c-8810-98a4f3a27ce7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance ad1d1145-1a70-4a9c-b563-6bda437dc0cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance e8ad453e-67b1-4af2-b85b-a5e100c11446 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance d5d44771-7499-43ac-972a-22b9d9fd6840 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:12:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KRvMGiZt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:12:50 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:12:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.666s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG nova.network.neutron [req-cbc4df5d-e9aa-40a0-a0d2-a67026295b79 req-3ec8f8d9-577e-418d-b4fe-dae062359823 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Updated VIF entry in instance network info cache for port 99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG nova.network.neutron [req-cbc4df5d-e9aa-40a0-a0d2-a67026295b79 req-3ec8f8d9-577e-418d-b4fe-dae062359823 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Updating instance_info_cache with network_info: [{"id": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "address": "fa:16:3e:ce:cd:93", "network": {"id": "1ec1577a-2943-44e6-9fd6-9d8308fcf09f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-135315381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09794ca2aebc4f50a4ab26cecefb4d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d8f3d6-2e", "ovs_interfaceid": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-cbc4df5d-e9aa-40a0-a0d2-a67026295b79 req-3ec8f8d9-577e-418d-b4fe-dae062359823 service nova] Releasing lock "refresh_cache-24c00db3-2457-443d-b5ab-7e6ecaa57515" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.892s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] <== connect_volume: return (1894ms) {'type': 'block', 'scsi_wwn': '26664663835346537', 'path': '/dev/sdb'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664663835346537', 'path': '/dev/sdb'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.596s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:12:51 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:12:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:12:51 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:12:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cc9872-a500-4e7e-97a6-07263a3fa11d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:12:51 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UsmfVtjk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:12:51 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:12:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12b16b5-7e3e-4e80-8e4e-d38d9a12f068]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9] added
Aug 14 18:12:51 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5343d3-00e6-4a77-8e38-98d3207ac8f4]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c9b291-3d27-4a13-a736-b17c8ac555fd]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KRvMGiZt {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KRvMGiZt" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87aa005-99fc-4f63-9af2-020a5c935305]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KRvMGiZt'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca0e7dd-9a51-4369-a048-5f625aea34db]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8e62c0-5bb7-45a0-91a6-d36115eec2ff]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:12:51 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:12:51 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0abaa0b-7aa5-4933-8094-9d64a6a1f698]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9, portal: 172.16.0.220,3260]
Aug 14 18:12:51 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9, portal: 172.16.0.220,3260] successful.
Aug 14 18:12:51 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6055b1df-ed14-4089-a045-ac114e020f5d]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbff06f-5f62-4d41-b04b-d40b44612990]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:12:51 user nova-compute[73078]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 (non-flash)
Aug 14 18:12:51 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:12:51 user nova-compute[73078]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 (non-flash)
Aug 14 18:12:51 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[82efb648-0dda-48f9-8794-d7cb7700a90d]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:51 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG nova.compute.manager [req-66894d88-a30f-45d0-b8b0-16d2861443d2 req-971ac44e-4a50-4d4c-b1df-bf2ddfdcb8c7 service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Received event network-changed-10688f4a-5919-4a48-9767-92e304a494be {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG nova.compute.manager [req-66894d88-a30f-45d0-b8b0-16d2861443d2 req-971ac44e-4a50-4d4c-b1df-bf2ddfdcb8c7 service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Refreshing instance network info cache due to event network-changed-10688f4a-5919-4a48-9767-92e304a494be. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-66894d88-a30f-45d0-b8b0-16d2861443d2 req-971ac44e-4a50-4d4c-b1df-bf2ddfdcb8c7 service nova] Acquiring lock "refresh_cache-8d257202-d8ab-4161-9b67-045cf1e36772" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-66894d88-a30f-45d0-b8b0-16d2861443d2 req-971ac44e-4a50-4d4c-b1df-bf2ddfdcb8c7 service nova] Acquired lock "refresh_cache-8d257202-d8ab-4161-9b67-045cf1e36772" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG nova.network.neutron [req-66894d88-a30f-45d0-b8b0-16d2861443d2 req-971ac44e-4a50-4d4c-b1df-bf2ddfdcb8c7 service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Refreshing network info cache for port 10688f4a-5919-4a48-9767-92e304a494be {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KRvMGiZt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] <== connect_volume: return (1888ms) {'type': 'block', 'scsi_wwn': '26336623462353832', 'path': '/dev/sdc'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336623462353832', 'path': '/dev/sdc'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.260s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:12:52 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:12:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:12:52 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:12:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG nova.objects.instance [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Lazy-loading 'flavor' on Instance uuid c29d7f9d-793f-4511-9203-06b653e52f72 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[84162032-19a7-4919-8cd5-6214c29c2064]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:12:52 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 18:12:52 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:12:52 user nova-compute[73078]:   <source dev="/dev/sdc"/>
Aug 14 18:12:52 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:12:52 user nova-compute[73078]:   <serial>16da3a46-e07a-42db-9b3d-1516073a81e9</serial>
Aug 14 18:12:52 user nova-compute[73078]: </disk>
Aug 14 18:12:52 user nova-compute[73078]:  {{(pid=73078) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fda610-5358-4e9d-af7b-542c428366ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d] added
Aug 14 18:12:52 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d1158b-f375-42b0-9345-63ec2e4c484d]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0232454-4c97-4b74-8c34-53893ab5fc45]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UsmfVtjk {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UsmfVtjk" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[431b5048-77e0-453e-aa6a-add1af941231]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UsmfVtjk'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b6e4e6-9981-4ebb-9a13-ac3ddfcf3481]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[366fe635-d888-4fa5-bf12-c59961134a91]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:12:52 user nova-compute[73078]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 (non-flash)
Aug 14 18:12:52 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:12:52 user nova-compute[73078]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 (non-flash)
Aug 14 18:12:52 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:12:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:53 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cdc7a9-de7b-4265-887d-7a57eca50615]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d, portal: 172.16.0.220,3260]
Aug 14 18:12:53 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d, portal: 172.16.0.220,3260] successful.
Aug 14 18:12:53 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:12:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:53 user nova-compute[73078]: DEBUG nova.network.neutron [req-66894d88-a30f-45d0-b8b0-16d2861443d2 req-971ac44e-4a50-4d4c-b1df-bf2ddfdcb8c7 service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Updated VIF entry in instance network info cache for port 10688f4a-5919-4a48-9767-92e304a494be. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:12:53 user nova-compute[73078]: DEBUG nova.network.neutron [req-66894d88-a30f-45d0-b8b0-16d2861443d2 req-971ac44e-4a50-4d4c-b1df-bf2ddfdcb8c7 service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Updating instance_info_cache with network_info: [{"id": "10688f4a-5919-4a48-9767-92e304a494be", "address": "fa:16:3e:a4:3b:fc", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10688f4a-59", "ovs_interfaceid": "10688f4a-5919-4a48-9767-92e304a494be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:12:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:53 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[48069250-dfa9-4a32-adff-28408227c0d2]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:12:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-66894d88-a30f-45d0-b8b0-16d2861443d2 req-971ac44e-4a50-4d4c-b1df-bf2ddfdcb8c7 service nova] Releasing lock "refresh_cache-8d257202-d8ab-4161-9b67-045cf1e36772" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:12:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:53 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe19c59-4516-4990-9780-3461c637bc3c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:12:53 user nova-compute[73078]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 (non-flash)
Aug 14 18:12:53 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:12:53 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:12:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:12:53 user nova-compute[73078]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 (non-flash)
Aug 14 18:12:53 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:12:53 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:12:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:12:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:12:53 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:12:53 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:12:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:53 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[faeef7a6-8ee1-4f8c-b7b1-7272600b181b]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:53 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:12:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UsmfVtjk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:12:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:12:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:12:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] No VIF found with MAC fa:16:3e:a4:11:94, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:12:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b94bfaa6-cac2-4f8c-a21f-763a4c82d831 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Lock "c29d7f9d-793f-4511-9203-06b653e52f72" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.367s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] <== connect_volume: return (2603ms) {'type': 'block', 'scsi_wwn': '23266633035306464', 'path': '/dev/sdd'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266633035306464', 'path': '/dev/sdd'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VzRknyKA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:12:54 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:12:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:12:54 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:12:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:12:54 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[323c7da3-7219-4b8b-9381-cb34f13da4da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:12:54 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e678c2be-02e6-4f17-9749-4dcb4213d641]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246] added
Aug 14 18:12:54 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0143173-4d75-4522-ad83-9bf72dc5d03d]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c8067e-d004-404a-97c0-858a10d0d30c]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VzRknyKA {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VzRknyKA" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[248c5b72-7d88-45d7-943e-105e99288dbd]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VzRknyKA'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[46872f05-dc18-4bbd-aa2f-0d6a7896ff3b]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8fe156-b076-40c2-b060-6f2e350bf182]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:12:54 user nova-compute[73078]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 (non-flash)
Aug 14 18:12:54 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:12:54 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:12:54 user nova-compute[73078]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 (non-flash)
Aug 14 18:12:54 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:12:54 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Acquiring lock "c29d7f9d-793f-4511-9203-06b653e52f72" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Lock "c29d7f9d-793f-4511-9203-06b653e52f72" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Acquiring lock "c29d7f9d-793f-4511-9203-06b653e52f72-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Lock "c29d7f9d-793f-4511-9203-06b653e52f72-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Lock "c29d7f9d-793f-4511-9203-06b653e52f72-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:12:54 user nova-compute[73078]: INFO nova.compute.manager [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Terminating instance
Aug 14 18:12:54 user nova-compute[73078]: DEBUG nova.compute.manager [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[71110cec-9f47-455e-beb0-83016c54514e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246, portal: 172.16.0.220,3260]
Aug 14 18:12:54 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246, portal: 172.16.0.220,3260] successful.
Aug 14 18:12:54 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[29928349-8cc8-42bf-af80-621450e527d8]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c30d1eb-e543-46c5-9a41-6c1c14675686]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:12:54 user nova-compute[73078]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 (non-flash)
Aug 14 18:12:54 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:12:54 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:12:54 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:12:54 user nova-compute[73078]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 (non-flash)
Aug 14 18:12:54 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:12:54 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:12:54 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53ba3f9-966d-40ae-810c-b496b52a0b90]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VzRknyKA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG nova.compute.manager [req-3fdb5498-a5d2-4022-8bb6-052cc4fc45a5 req-0d859de0-2c0b-4be2-b694-d649f63fe8d9 service nova] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Received event network-vif-unplugged-89874ba3-0758-4c32-b1ec-6d0dd813fb71 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3fdb5498-a5d2-4022-8bb6-052cc4fc45a5 req-0d859de0-2c0b-4be2-b694-d649f63fe8d9 service nova] Acquiring lock "c29d7f9d-793f-4511-9203-06b653e52f72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3fdb5498-a5d2-4022-8bb6-052cc4fc45a5 req-0d859de0-2c0b-4be2-b694-d649f63fe8d9 service nova] Lock "c29d7f9d-793f-4511-9203-06b653e52f72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3fdb5498-a5d2-4022-8bb6-052cc4fc45a5 req-0d859de0-2c0b-4be2-b694-d649f63fe8d9 service nova] Lock "c29d7f9d-793f-4511-9203-06b653e52f72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG nova.compute.manager [req-3fdb5498-a5d2-4022-8bb6-052cc4fc45a5 req-0d859de0-2c0b-4be2-b694-d649f63fe8d9 service nova] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] No waiting events found dispatching network-vif-unplugged-89874ba3-0758-4c32-b1ec-6d0dd813fb71 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:12:54 user nova-compute[73078]: DEBUG nova.compute.manager [req-3fdb5498-a5d2-4022-8bb6-052cc4fc45a5 req-0d859de0-2c0b-4be2-b694-d649f63fe8d9 service nova] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Received event network-vif-unplugged-89874ba3-0758-4c32-b1ec-6d0dd813fb71 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:55 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Instance destroyed successfully.
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.objects.instance [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Lazy-loading 'resources' on Instance uuid c29d7f9d-793f-4511-9203-06b653e52f72 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-281327118',display_name='tempest-DeleteServersTestJSON-server-281327118',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-281327118',id=1,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:11:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8dc5cc86317d4c90bf119b8bc5ec9c1b',ramdisk_id='',reservation_id='r-2mp6oh69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1205702529',owner_user_name='tempest-DeleteServersTestJSON-1205702529-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:11:13Z,user_data=None,user_id='8c08ad4734894a03a61c8f724e428dd4',uuid=c29d7f9d-793f-4511-9203-06b653e52f72,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89874ba3-0758-4c32-b1ec-6d0dd813fb71", "address": "fa:16:3e:a4:11:94", "network": {"id": "a97d8218-d78c-43aa-80b9-58e1cda130cf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-617867352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dc5cc86317d4c90bf119b8bc5ec9c1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89874ba3-07", "ovs_interfaceid": "89874ba3-0758-4c32-b1ec-6d0dd813fb71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Converting VIF {"id": "89874ba3-0758-4c32-b1ec-6d0dd813fb71", "address": "fa:16:3e:a4:11:94", "network": {"id": "a97d8218-d78c-43aa-80b9-58e1cda130cf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-617867352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dc5cc86317d4c90bf119b8bc5ec9c1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89874ba3-07", "ovs_interfaceid": "89874ba3-0758-4c32-b1ec-6d0dd813fb71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:11:94,bridge_name='br-int',has_traffic_filtering=True,id=89874ba3-0758-4c32-b1ec-6d0dd813fb71,network=Network(a97d8218-d78c-43aa-80b9-58e1cda130cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89874ba3-07') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG os_vif [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:11:94,bridge_name='br-int',has_traffic_filtering=True,id=89874ba3-0758-4c32-b1ec-6d0dd813fb71,network=Network(a97d8218-d78c-43aa-80b9-58e1cda130cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89874ba3-07') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89874ba3-07, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:55 user nova-compute[73078]: INFO os_vif [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:11:94,bridge_name='br-int',has_traffic_filtering=True,id=89874ba3-0758-4c32-b1ec-6d0dd813fb71,network=Network(a97d8218-d78c-43aa-80b9-58e1cda130cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89874ba3-07')
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KRvMGiZt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:12:55 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:12:55 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23038306664323032', 'path': '/dev/sde'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038306664323032', 'path': '/dev/sde'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.319s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:12:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942929011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942929011',id=13,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPEMynvkgK3D8wUwcv/n8OYQ1W8btAxcTUdDr+O//arZSNxfL73QYspdeKO7g4qkivuuHPX4nFtVqh3WBm6PhGbEDkt7rdYIfZn6k/tjOLMzedYNO0yL6edD9VtQvhxkA==',key_name='tempest-keypair-155161134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7328e29579b44e5894abeb47e1fe16a8',ramdisk_id='',reservation_id='r-3lybo561',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2139073796',owner_user_name='tempest-TaggedBootDevicesTest-2139073796-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:12:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e155f911c3444d3baffb0eb5ee75b773',uuid=3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0", "address": "fa:16:3e:fd:5d:15", "network": {"id": "b3d5a7bd-ce61-46db-9a30-3da3cc663f58", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-779880358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe9ed0fb-59", "ovs_interfaceid": "be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converting VIF {"id": "be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0", "address": "fa:16:3e:fd:5d:15", "network": {"id": "b3d5a7bd-ce61-46db-9a30-3da3cc663f58", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-779880358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe9ed0fb-59", "ovs_interfaceid": "be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:5d:15,bridge_name='br-int',has_traffic_filtering=True,id=be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0,network=Network(b3d5a7bd-ce61-46db-9a30-3da3cc663f58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe9ed0fb-59') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:12:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942929011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942929011',id=13,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPEMynvkgK3D8wUwcv/n8OYQ1W8btAxcTUdDr+O//arZSNxfL73QYspdeKO7g4qkivuuHPX4nFtVqh3WBm6PhGbEDkt7rdYIfZn6k/tjOLMzedYNO0yL6edD9VtQvhxkA==',key_name='tempest-keypair-155161134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7328e29579b44e5894abeb47e1fe16a8',ramdisk_id='',reservation_id='r-3lybo561',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2139073796',owner_user_name='tempest-TaggedBootDevicesTest-2139073796-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:12:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e155f911c3444d3baffb0eb5ee75b773',uuid=3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b845300e-603e-4702-a3cc-cecf5bfcf026", "address": "fa:16:3e:b5:e0:ae", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb845300e-60", "ovs_interfaceid": "b845300e-603e-4702-a3cc-cecf5bfcf026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converting VIF {"id": "b845300e-603e-4702-a3cc-cecf5bfcf026", "address": "fa:16:3e:b5:e0:ae", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb845300e-60", "ovs_interfaceid": "b845300e-603e-4702-a3cc-cecf5bfcf026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:e0:ae,bridge_name='br-int',has_traffic_filtering=True,id=b845300e-603e-4702-a3cc-cecf5bfcf026,network=Network(ca37b602-6d7b-4286-a4e2-fbdc544aecf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb845300e-60') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:12:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942929011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942929011',id=13,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPEMynvkgK3D8wUwcv/n8OYQ1W8btAxcTUdDr+O//arZSNxfL73QYspdeKO7g4qkivuuHPX4nFtVqh3WBm6PhGbEDkt7rdYIfZn6k/tjOLMzedYNO0yL6edD9VtQvhxkA==',key_name='tempest-keypair-155161134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7328e29579b44e5894abeb47e1fe16a8',ramdisk_id='',reservation_id='r-3lybo561',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2139073796',owner_user_name='tempest-TaggedBootDevicesTest-2139073796-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:12:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e155f911c3444d3baffb0eb5ee75b773',uuid=3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1547f0c-cfbd-481c-9657-a3ed79040d1e", "address": "fa:16:3e:70:aa:9c", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1547f0c-cf", "ovs_interfaceid": "d1547f0c-cfbd-481c-9657-a3ed79040d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converting VIF {"id": "d1547f0c-cfbd-481c-9657-a3ed79040d1e", "address": "fa:16:3e:70:aa:9c", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1547f0c-cf", "ovs_interfaceid": "d1547f0c-cfbd-481c-9657-a3ed79040d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:aa:9c,bridge_name='br-int',has_traffic_filtering=True,id=d1547f0c-cfbd-481c-9657-a3ed79040d1e,network=Network(ca37b602-6d7b-4286-a4e2-fbdc544aecf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd1547f0c-cf') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:12:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942929011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942929011',id=13,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPEMynvkgK3D8wUwcv/n8OYQ1W8btAxcTUdDr+O//arZSNxfL73QYspdeKO7g4qkivuuHPX4nFtVqh3WBm6PhGbEDkt7rdYIfZn6k/tjOLMzedYNO0yL6edD9VtQvhxkA==',key_name='tempest-keypair-155161134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7328e29579b44e5894abeb47e1fe16a8',ramdisk_id='',reservation_id='r-3lybo561',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2139073796',owner_user_name='tempest-TaggedBootDevicesTest-2139073796-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:12:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e155f911c3444d3baffb0eb5ee75b773',uuid=3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f725089c-89c9-447a-88e7-a427ad17f344", "address": "fa:16:3e:63:ea:ff", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf725089c-89", "ovs_interfaceid": "f725089c-89c9-447a-88e7-a427ad17f344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converting VIF {"id": "f725089c-89c9-447a-88e7-a427ad17f344", "address": "fa:16:3e:63:ea:ff", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf725089c-89", "ovs_interfaceid": "f725089c-89c9-447a-88e7-a427ad17f344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:ea:ff,bridge_name='br-int',has_traffic_filtering=True,id=f725089c-89c9-447a-88e7-a427ad17f344,network=Network(ca37b602-6d7b-4286-a4e2-fbdc544aecf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf725089c-89') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:12:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942929011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942929011',id=13,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPEMynvkgK3D8wUwcv/n8OYQ1W8btAxcTUdDr+O//arZSNxfL73QYspdeKO7g4qkivuuHPX4nFtVqh3WBm6PhGbEDkt7rdYIfZn6k/tjOLMzedYNO0yL6edD9VtQvhxkA==',key_name='tempest-keypair-155161134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7328e29579b44e5894abeb47e1fe16a8',ramdisk_id='',reservation_id='r-3lybo561',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2139073796',owner_user_name='tempest-TaggedBootDevicesTest-2139073796-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:12:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e155f911c3444d3baffb0eb5ee75b773',uuid=3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0da08486-8ca6-4ab9-8328-7073e9a8b0f3", "address": "fa:16:3e:b4:77:23", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da08486-8c", "ovs_interfaceid": "0da08486-8ca6-4ab9-8328-7073e9a8b0f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converting VIF {"id": "0da08486-8ca6-4ab9-8328-7073e9a8b0f3", "address": "fa:16:3e:b4:77:23", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da08486-8c", "ovs_interfaceid": "0da08486-8ca6-4ab9-8328-7073e9a8b0f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:77:23,bridge_name='br-int',has_traffic_filtering=True,id=0da08486-8ca6-4ab9-8328-7073e9a8b0f3,network=Network(ca37b602-6d7b-4286-a4e2-fbdc544aecf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0da08486-8c') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:12:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942929011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942929011',id=13,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPEMynvkgK3D8wUwcv/n8OYQ1W8btAxcTUdDr+O//arZSNxfL73QYspdeKO7g4qkivuuHPX4nFtVqh3WBm6PhGbEDkt7rdYIfZn6k/tjOLMzedYNO0yL6edD9VtQvhxkA==',key_name='tempest-keypair-155161134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7328e29579b44e5894abeb47e1fe16a8',ramdisk_id='',reservation_id='r-3lybo561',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2139073796',owner_user_name='tempest-TaggedBootDevicesTest-2139073796-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:12:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e155f911c3444d3baffb0eb5ee75b773',uuid=3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "febea954-f895-4078-acd2-c9f87479a76b", "address": "fa:16:3e:ee:00:df", "network": {"id": "966cb532-886b-4eef-8b6b-1cdcb9bbe9c1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1607312863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebea954-f8", "ovs_interfaceid": "febea954-f895-4078-acd2-c9f87479a76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converting VIF {"id": "febea954-f895-4078-acd2-c9f87479a76b", "address": "fa:16:3e:ee:00:df", "network": {"id": "966cb532-886b-4eef-8b6b-1cdcb9bbe9c1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1607312863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebea954-f8", "ovs_interfaceid": "febea954-f895-4078-acd2-c9f87479a76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:00:df,bridge_name='br-int',has_traffic_filtering=True,id=febea954-f895-4078-acd2-c9f87479a76b,network=Network(966cb532-886b-4eef-8b6b-1cdcb9bbe9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebea954-f8') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:12:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942929011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942929011',id=13,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPEMynvkgK3D8wUwcv/n8OYQ1W8btAxcTUdDr+O//arZSNxfL73QYspdeKO7g4qkivuuHPX4nFtVqh3WBm6PhGbEDkt7rdYIfZn6k/tjOLMzedYNO0yL6edD9VtQvhxkA==',key_name='tempest-keypair-155161134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7328e29579b44e5894abeb47e1fe16a8',ramdisk_id='',reservation_id='r-3lybo561',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2139073796',owner_user_name='tempest-TaggedBootDevicesTest-2139073796-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:12:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e155f911c3444d3baffb0eb5ee75b773',uuid=3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "350b119d-c27a-4783-9d95-04bc9e75e8f6", "address": "fa:16:3e:61:d4:d6", "network": {"id": "966cb532-886b-4eef-8b6b-1cdcb9bbe9c1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1607312863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350b119d-c2", "ovs_interfaceid": "350b119d-c27a-4783-9d95-04bc9e75e8f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converting VIF {"id": "350b119d-c27a-4783-9d95-04bc9e75e8f6", "address": "fa:16:3e:61:d4:d6", "network": {"id": "966cb532-886b-4eef-8b6b-1cdcb9bbe9c1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1607312863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350b119d-c2", "ovs_interfaceid": "350b119d-c27a-4783-9d95-04bc9e75e8f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:d4:d6,bridge_name='br-int',has_traffic_filtering=True,id=350b119d-c27a-4783-9d95-04bc9e75e8f6,network=Network(966cb532-886b-4eef-8b6b-1cdcb9bbe9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350b119d-c2') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.objects.instance [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ec5ff8-c97e-449f-9191-ef6931cd1161]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:12:55 user nova-compute[73078]:   <uuid>3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223</uuid>
Aug 14 18:12:55 user nova-compute[73078]:   <name>instance-0000000d</name>
Aug 14 18:12:55 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:12:55 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:12:55 user nova-compute[73078]:   <metadata>
Aug 14 18:12:55 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:12:55 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:12:55 user nova-compute[73078]:       <nova:name>tempest-device-tagging-server-1942929011</nova:name>
Aug 14 18:12:55 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:12:49</nova:creationTime>
Aug 14 18:12:55 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:12:55 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:12:55 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:12:55 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:12:55 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:12:55 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:12:55 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:12:55 user nova-compute[73078]:       <nova:owner>
Aug 14 18:12:55 user nova-compute[73078]:         <nova:user uuid="e155f911c3444d3baffb0eb5ee75b773">tempest-TaggedBootDevicesTest-2139073796-project-member</nova:user>
Aug 14 18:12:55 user nova-compute[73078]:         <nova:project uuid="7328e29579b44e5894abeb47e1fe16a8">tempest-TaggedBootDevicesTest-2139073796</nova:project>
Aug 14 18:12:55 user nova-compute[73078]:       </nova:owner>
Aug 14 18:12:55 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:12:55 user nova-compute[73078]:       <nova:ports>
Aug 14 18:12:55 user nova-compute[73078]:         <nova:port uuid="be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0">
Aug 14 18:12:55 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 18:12:55 user nova-compute[73078]:         </nova:port>
Aug 14 18:12:55 user nova-compute[73078]:         <nova:port uuid="b845300e-603e-4702-a3cc-cecf5bfcf026">
Aug 14 18:12:55 user nova-compute[73078]:           <nova:ip type="fixed" address="10.1.1.233" ipVersion="4"/>
Aug 14 18:12:55 user nova-compute[73078]:         </nova:port>
Aug 14 18:12:55 user nova-compute[73078]:         <nova:port uuid="d1547f0c-cfbd-481c-9657-a3ed79040d1e">
Aug 14 18:12:55 user nova-compute[73078]:           <nova:ip type="fixed" address="10.1.1.201" ipVersion="4"/>
Aug 14 18:12:55 user nova-compute[73078]:         </nova:port>
Aug 14 18:12:55 user nova-compute[73078]:         <nova:port uuid="f725089c-89c9-447a-88e7-a427ad17f344">
Aug 14 18:12:55 user nova-compute[73078]:           <nova:ip type="fixed" address="10.1.1.40" ipVersion="4"/>
Aug 14 18:12:55 user nova-compute[73078]:         </nova:port>
Aug 14 18:12:55 user nova-compute[73078]:         <nova:port uuid="0da08486-8ca6-4ab9-8328-7073e9a8b0f3">
Aug 14 18:12:55 user nova-compute[73078]:           <nova:ip type="fixed" address="10.1.1.244" ipVersion="4"/>
Aug 14 18:12:55 user nova-compute[73078]:         </nova:port>
Aug 14 18:12:55 user nova-compute[73078]:         <nova:port uuid="febea954-f895-4078-acd2-c9f87479a76b">
Aug 14 18:12:55 user nova-compute[73078]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 14 18:12:55 user nova-compute[73078]:         </nova:port>
Aug 14 18:12:55 user nova-compute[73078]:         <nova:port uuid="350b119d-c27a-4783-9d95-04bc9e75e8f6">
Aug 14 18:12:55 user nova-compute[73078]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 14 18:12:55 user nova-compute[73078]:         </nova:port>
Aug 14 18:12:55 user nova-compute[73078]:       </nova:ports>
Aug 14 18:12:55 user nova-compute[73078]:     </nova:instance>
Aug 14 18:12:55 user nova-compute[73078]:   </metadata>
Aug 14 18:12:55 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:12:55 user nova-compute[73078]:     <system>
Aug 14 18:12:55 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:12:55 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:12:55 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:12:55 user nova-compute[73078]:       <entry name="serial">3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223</entry>
Aug 14 18:12:55 user nova-compute[73078]:       <entry name="uuid">3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223</entry>
Aug 14 18:12:55 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:12:55 user nova-compute[73078]:     </system>
Aug 14 18:12:55 user nova-compute[73078]:   </sysinfo>
Aug 14 18:12:55 user nova-compute[73078]:   <os>
Aug 14 18:12:55 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:12:55 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:12:55 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:12:55 user nova-compute[73078]:   </os>
Aug 14 18:12:55 user nova-compute[73078]:   <features>
Aug 14 18:12:55 user nova-compute[73078]:     <acpi/>
Aug 14 18:12:55 user nova-compute[73078]:     <apic/>
Aug 14 18:12:55 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:12:55 user nova-compute[73078]:   </features>
Aug 14 18:12:55 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:12:55 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:12:55 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:12:55 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:12:55 user nova-compute[73078]:   </clock>
Aug 14 18:12:55 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:12:55 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:12:55 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:12:55 user nova-compute[73078]:   </cpu>
Aug 14 18:12:55 user nova-compute[73078]:   <devices>
Aug 14 18:12:55 user nova-compute[73078]:     <disk type="file" device="cdrom">
Aug 14 18:12:55 user nova-compute[73078]:       <driver name="qemu" type="raw" cache="none"/>
Aug 14 18:12:55 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223/disk.config"/>
Aug 14 18:12:55 user nova-compute[73078]:       <target dev="hda" bus="ide"/>
Aug 14 18:12:55 user nova-compute[73078]:     </disk>
Aug 14 18:12:55 user nova-compute[73078]:     <disk type="block" device="disk">
Aug 14 18:12:55 user nova-compute[73078]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:12:55 user nova-compute[73078]:       <source dev="/dev/sdb"/>
Aug 14 18:12:55 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:12:55 user nova-compute[73078]:       <serial>63b60218-2eb0-4ccb-9d46-def6b4b3ce6f</serial>
Aug 14 18:12:55 user nova-compute[73078]:     </disk>
Aug 14 18:12:55 user nova-compute[73078]:     <disk type="block" device="disk">
Aug 14 18:12:55 user nova-compute[73078]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:12:55 user nova-compute[73078]:       <source dev="/dev/sdd"/>
Aug 14 18:12:55 user nova-compute[73078]:       <target dev="vdb" bus="virtio"/>
Aug 14 18:12:55 user nova-compute[73078]:       <serial>5761720f-50f3-4f26-8579-ab4b261dac6d</serial>
Aug 14 18:12:55 user nova-compute[73078]:     </disk>
Aug 14 18:12:55 user nova-compute[73078]:     <disk type="block" device="disk">
Aug 14 18:12:55 user nova-compute[73078]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:12:55 user nova-compute[73078]:       <source dev="/dev/sde"/>
Aug 14 18:12:55 user nova-compute[73078]:       <target dev="vdc" bus="virtio"/>
Aug 14 18:12:55 user nova-compute[73078]:       <serial>2e6f49ae-37c7-45ef-a014-0769abee5246</serial>
Aug 14 18:12:55 user nova-compute[73078]:     </disk>
Aug 14 18:12:55 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:12:55 user nova-compute[73078]:       <mac address="fa:16:3e:fd:5d:15"/>
Aug 14 18:12:55 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:12:55 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:12:55 user nova-compute[73078]:       <target dev="tapbe9ed0fb-59"/>
Aug 14 18:12:55 user nova-compute[73078]:     </interface>
Aug 14 18:12:55 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:12:55 user nova-compute[73078]:       <mac address="fa:16:3e:b5:e0:ae"/>
Aug 14 18:12:55 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:12:55 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:12:55 user nova-compute[73078]:       <target dev="tapb845300e-60"/>
Aug 14 18:12:55 user nova-compute[73078]:     </interface>
Aug 14 18:12:55 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:12:55 user nova-compute[73078]:       <mac address="fa:16:3e:70:aa:9c"/>
Aug 14 18:12:55 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:12:55 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:12:55 user nova-compute[73078]:       <target dev="tapd1547f0c-cf"/>
Aug 14 18:12:55 user nova-compute[73078]:     </interface>
Aug 14 18:12:55 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:12:55 user nova-compute[73078]:       <mac address="fa:16:3e:63:ea:ff"/>
Aug 14 18:12:55 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:12:55 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:12:55 user nova-compute[73078]:       <target dev="tapf725089c-89"/>
Aug 14 18:12:55 user nova-compute[73078]:     </interface>
Aug 14 18:12:55 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:12:55 user nova-compute[73078]:       <mac address="fa:16:3e:b4:77:23"/>
Aug 14 18:12:55 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:12:55 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:12:55 user nova-compute[73078]:       <target dev="tap0da08486-8c"/>
Aug 14 18:12:55 user nova-compute[73078]:     </interface>
Aug 14 18:12:55 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:12:55 user nova-compute[73078]:       <mac address="fa:16:3e:ee:00:df"/>
Aug 14 18:12:55 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:12:55 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:12:55 user nova-compute[73078]:       <target dev="tapfebea954-f8"/>
Aug 14 18:12:55 user nova-compute[73078]:     </interface>
Aug 14 18:12:55 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:12:55 user nova-compute[73078]:       <mac address="fa:16:3e:61:d4:d6"/>
Aug 14 18:12:55 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:12:55 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:12:55 user nova-compute[73078]:       <target dev="tap350b119d-c2"/>
Aug 14 18:12:55 user nova-compute[73078]:     </interface>
Aug 14 18:12:55 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:12:55 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223/console.log" append="off"/>
Aug 14 18:12:55 user nova-compute[73078]:     </serial>
Aug 14 18:12:55 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:12:55 user nova-compute[73078]:     <video>
Aug 14 18:12:55 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:12:55 user nova-compute[73078]:     </video>
Aug 14 18:12:55 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:12:55 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:12:55 user nova-compute[73078]:     </rng>
Aug 14 18:12:55 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:12:55 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:12:55 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:12:55 user nova-compute[73078]:     </memballoon>
Aug 14 18:12:55 user nova-compute[73078]:   </devices>
Aug 14 18:12:55 user nova-compute[73078]: </domain>
Aug 14 18:12:55 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:12:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942929011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942929011',id=13,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPEMynvkgK3D8wUwcv/n8OYQ1W8btAxcTUdDr+O//arZSNxfL73QYspdeKO7g4qkivuuHPX4nFtVqh3WBm6PhGbEDkt7rdYIfZn6k/tjOLMzedYNO0yL6edD9VtQvhxkA==',key_name='tempest-keypair-155161134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7328e29579b44e5894abeb47e1fe16a8',ramdisk_id='',reservation_id='r-3lybo561',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2139073796',owner_user_name='tempest-TaggedBootDevicesTest-2139073796-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:12:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e155f911c3444d3baffb0eb5ee75b773',uuid=3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0", "address": "fa:16:3e:fd:5d:15", "network": {"id": "b3d5a7bd-ce61-46db-9a30-3da3cc663f58", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-779880358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe9ed0fb-59", "ovs_interfaceid": "be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converting VIF {"id": "be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0", "address": "fa:16:3e:fd:5d:15", "network": {"id": "b3d5a7bd-ce61-46db-9a30-3da3cc663f58", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-779880358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe9ed0fb-59", "ovs_interfaceid": "be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:5d:15,bridge_name='br-int',has_traffic_filtering=True,id=be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0,network=Network(b3d5a7bd-ce61-46db-9a30-3da3cc663f58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe9ed0fb-59') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG os_vif [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:5d:15,bridge_name='br-int',has_traffic_filtering=True,id=be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0,network=Network(b3d5a7bd-ce61-46db-9a30-3da3cc663f58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe9ed0fb-59') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe9ed0fb-59, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbe9ed0fb-59, col_values=(('external_ids', {'iface-id': 'be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:5d:15', 'vm-uuid': '3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0836b561-aef3-4b61-add3-c1a32b0d8926]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:12:55 user nova-compute[73078]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 (non-flash)
Aug 14 18:12:55 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:12:55 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:12:55 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:12:55 user nova-compute[73078]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 (non-flash)
Aug 14 18:12:55 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:12:55 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:12:55 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe97867c790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9'): ({'sdc'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Removing single pathed devices sdc {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:55 user nova-compute[73078]: INFO os_vif [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:5d:15,bridge_name='br-int',has_traffic_filtering=True,id=be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0,network=Network(b3d5a7bd-ce61-46db-9a30-3da3cc663f58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe9ed0fb-59')
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:12:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942929011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942929011',id=13,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPEMynvkgK3D8wUwcv/n8OYQ1W8btAxcTUdDr+O//arZSNxfL73QYspdeKO7g4qkivuuHPX4nFtVqh3WBm6PhGbEDkt7rdYIfZn6k/tjOLMzedYNO0yL6edD9VtQvhxkA==',key_name='tempest-keypair-155161134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7328e29579b44e5894abeb47e1fe16a8',ramdisk_id='',reservation_id='r-3lybo561',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2139073796',owner_user_name='tempest-TaggedBootDevicesTest-2139073796-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:12:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e155f911c3444d3baffb0eb5ee75b773',uuid=3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b845300e-603e-4702-a3cc-cecf5bfcf026", "address": "fa:16:3e:b5:e0:ae", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb845300e-60", "ovs_interfaceid": "b845300e-603e-4702-a3cc-cecf5bfcf026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converting VIF {"id": "b845300e-603e-4702-a3cc-cecf5bfcf026", "address": "fa:16:3e:b5:e0:ae", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb845300e-60", "ovs_interfaceid": "b845300e-603e-4702-a3cc-cecf5bfcf026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:e0:ae,bridge_name='br-int',has_traffic_filtering=True,id=b845300e-603e-4702-a3cc-cecf5bfcf026,network=Network(ca37b602-6d7b-4286-a4e2-fbdc544aecf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb845300e-60') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG os_vif [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:e0:ae,bridge_name='br-int',has_traffic_filtering=True,id=b845300e-603e-4702-a3cc-cecf5bfcf026,network=Network(ca37b602-6d7b-4286-a4e2-fbdc544aecf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb845300e-60') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb845300e-60, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb845300e-60, col_values=(('external_ids', {'iface-id': 'b845300e-603e-4702-a3cc-cecf5bfcf026', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:e0:ae', 'vm-uuid': '3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04d0a3d-b971-40bb-8aa6-775cb0976804]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:55 user nova-compute[73078]: INFO os_vif [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:e0:ae,bridge_name='br-int',has_traffic_filtering=True,id=b845300e-603e-4702-a3cc-cecf5bfcf026,network=Network(ca37b602-6d7b-4286-a4e2-fbdc544aecf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb845300e-60')
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:12:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942929011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942929011',id=13,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPEMynvkgK3D8wUwcv/n8OYQ1W8btAxcTUdDr+O//arZSNxfL73QYspdeKO7g4qkivuuHPX4nFtVqh3WBm6PhGbEDkt7rdYIfZn6k/tjOLMzedYNO0yL6edD9VtQvhxkA==',key_name='tempest-keypair-155161134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7328e29579b44e5894abeb47e1fe16a8',ramdisk_id='',reservation_id='r-3lybo561',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2139073796',owner_user_name='tempest-TaggedBootDevicesTest-2139073796-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:12:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e155f911c3444d3baffb0eb5ee75b773',uuid=3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1547f0c-cfbd-481c-9657-a3ed79040d1e", "address": "fa:16:3e:70:aa:9c", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1547f0c-cf", "ovs_interfaceid": "d1547f0c-cfbd-481c-9657-a3ed79040d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converting VIF {"id": "d1547f0c-cfbd-481c-9657-a3ed79040d1e", "address": "fa:16:3e:70:aa:9c", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1547f0c-cf", "ovs_interfaceid": "d1547f0c-cfbd-481c-9657-a3ed79040d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:aa:9c,bridge_name='br-int',has_traffic_filtering=True,id=d1547f0c-cfbd-481c-9657-a3ed79040d1e,network=Network(ca37b602-6d7b-4286-a4e2-fbdc544aecf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd1547f0c-cf') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG os_vif [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:aa:9c,bridge_name='br-int',has_traffic_filtering=True,id=d1547f0c-cfbd-481c-9657-a3ed79040d1e,network=Network(ca37b602-6d7b-4286-a4e2-fbdc544aecf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd1547f0c-cf') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80f17a8-87a1-4d9e-b875-f6fe0ba3a433]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Flushing IO for device /dev/sdc {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1547f0c-cf, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd1547f0c-cf, col_values=(('external_ids', {'iface-id': 'd1547f0c-cfbd-481c-9657-a3ed79040d1e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:aa:9c', 'vm-uuid': '3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3e72eb-75cb-4bfe-9477-2b04459b9f30]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:55 user nova-compute[73078]: INFO os_vif [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:aa:9c,bridge_name='br-int',has_traffic_filtering=True,id=d1547f0c-cfbd-481c-9657-a3ed79040d1e,network=Network(ca37b602-6d7b-4286-a4e2-fbdc544aecf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd1547f0c-cf')
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:12:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942929011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942929011',id=13,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPEMynvkgK3D8wUwcv/n8OYQ1W8btAxcTUdDr+O//arZSNxfL73QYspdeKO7g4qkivuuHPX4nFtVqh3WBm6PhGbEDkt7rdYIfZn6k/tjOLMzedYNO0yL6edD9VtQvhxkA==',key_name='tempest-keypair-155161134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7328e29579b44e5894abeb47e1fe16a8',ramdisk_id='',reservation_id='r-3lybo561',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2139073796',owner_user_name='tempest-TaggedBootDevicesTest-2139073796-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:12:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e155f911c3444d3baffb0eb5ee75b773',uuid=3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f725089c-89c9-447a-88e7-a427ad17f344", "address": "fa:16:3e:63:ea:ff", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf725089c-89", "ovs_interfaceid": "f725089c-89c9-447a-88e7-a427ad17f344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converting VIF {"id": "f725089c-89c9-447a-88e7-a427ad17f344", "address": "fa:16:3e:63:ea:ff", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf725089c-89", "ovs_interfaceid": "f725089c-89c9-447a-88e7-a427ad17f344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:ea:ff,bridge_name='br-int',has_traffic_filtering=True,id=f725089c-89c9-447a-88e7-a427ad17f344,network=Network(ca37b602-6d7b-4286-a4e2-fbdc544aecf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf725089c-89') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG os_vif [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:ea:ff,bridge_name='br-int',has_traffic_filtering=True,id=f725089c-89c9-447a-88e7-a427ad17f344,network=Network(ca37b602-6d7b-4286-a4e2-fbdc544aecf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf725089c-89') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf725089c-89, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf725089c-89, col_values=(('external_ids', {'iface-id': 'f725089c-89c9-447a-88e7-a427ad17f344', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:ea:ff', 'vm-uuid': '3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7660fd-2cd7-4b05-be5b-43042ab9bff6]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] SCSI volumes sdc have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[156a11b1-6772-4c7d-81e2-12837ea3ddd6]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:55 user nova-compute[73078]: INFO os_vif [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:ea:ff,bridge_name='br-int',has_traffic_filtering=True,id=f725089c-89c9-447a-88e7-a427ad17f344,network=Network(ca37b602-6d7b-4286-a4e2-fbdc544aecf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf725089c-89')
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:12:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942929011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942929011',id=13,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPEMynvkgK3D8wUwcv/n8OYQ1W8btAxcTUdDr+O//arZSNxfL73QYspdeKO7g4qkivuuHPX4nFtVqh3WBm6PhGbEDkt7rdYIfZn6k/tjOLMzedYNO0yL6edD9VtQvhxkA==',key_name='tempest-keypair-155161134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7328e29579b44e5894abeb47e1fe16a8',ramdisk_id='',reservation_id='r-3lybo561',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2139073796',owner_user_name='tempest-TaggedBootDevicesTest-2139073796-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:12:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e155f911c3444d3baffb0eb5ee75b773',uuid=3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0da08486-8ca6-4ab9-8328-7073e9a8b0f3", "address": "fa:16:3e:b4:77:23", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da08486-8c", "ovs_interfaceid": "0da08486-8ca6-4ab9-8328-7073e9a8b0f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converting VIF {"id": "0da08486-8ca6-4ab9-8328-7073e9a8b0f3", "address": "fa:16:3e:b4:77:23", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da08486-8c", "ovs_interfaceid": "0da08486-8ca6-4ab9-8328-7073e9a8b0f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:77:23,bridge_name='br-int',has_traffic_filtering=True,id=0da08486-8ca6-4ab9-8328-7073e9a8b0f3,network=Network(ca37b602-6d7b-4286-a4e2-fbdc544aecf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0da08486-8c') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG os_vif [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:77:23,bridge_name='br-int',has_traffic_filtering=True,id=0da08486-8ca6-4ab9-8328-7073e9a8b0f3,network=Network(ca37b602-6d7b-4286-a4e2-fbdc544aecf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0da08486-8c') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0da08486-8c, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0da08486-8c, col_values=(('external_ids', {'iface-id': '0da08486-8ca6-4ab9-8328-7073e9a8b0f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:77:23', 'vm-uuid': '3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[688603a6-b69d-4aa0-9c8b-b69ae1fa324a]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9, portal: 172.16.0.220,3260]
Aug 14 18:12:55 user nova-compute[73078]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9, portal: 172.16.0.220,3260] successful.
Aug 14 18:12:55 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:55 user nova-compute[73078]: INFO os_vif [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:77:23,bridge_name='br-int',has_traffic_filtering=True,id=0da08486-8ca6-4ab9-8328-7073e9a8b0f3,network=Network(ca37b602-6d7b-4286-a4e2-fbdc544aecf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0da08486-8c')
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:12:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942929011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942929011',id=13,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPEMynvkgK3D8wUwcv/n8OYQ1W8btAxcTUdDr+O//arZSNxfL73QYspdeKO7g4qkivuuHPX4nFtVqh3WBm6PhGbEDkt7rdYIfZn6k/tjOLMzedYNO0yL6edD9VtQvhxkA==',key_name='tempest-keypair-155161134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7328e29579b44e5894abeb47e1fe16a8',ramdisk_id='',reservation_id='r-3lybo561',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2139073796',owner_user_name='tempest-TaggedBootDevicesTest-2139073796-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:12:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e155f911c3444d3baffb0eb5ee75b773',uuid=3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "febea954-f895-4078-acd2-c9f87479a76b", "address": "fa:16:3e:ee:00:df", "network": {"id": "966cb532-886b-4eef-8b6b-1cdcb9bbe9c1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1607312863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebea954-f8", "ovs_interfaceid": "febea954-f895-4078-acd2-c9f87479a76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converting VIF {"id": "febea954-f895-4078-acd2-c9f87479a76b", "address": "fa:16:3e:ee:00:df", "network": {"id": "966cb532-886b-4eef-8b6b-1cdcb9bbe9c1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1607312863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebea954-f8", "ovs_interfaceid": "febea954-f895-4078-acd2-c9f87479a76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:00:df,bridge_name='br-int',has_traffic_filtering=True,id=febea954-f895-4078-acd2-c9f87479a76b,network=Network(966cb532-886b-4eef-8b6b-1cdcb9bbe9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebea954-f8') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG os_vif [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:00:df,bridge_name='br-int',has_traffic_filtering=True,id=febea954-f895-4078-acd2-c9f87479a76b,network=Network(966cb532-886b-4eef-8b6b-1cdcb9bbe9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebea954-f8') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfebea954-f8, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfebea954-f8, col_values=(('external_ids', {'iface-id': 'febea954-f895-4078-acd2-c9f87479a76b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:00:df', 'vm-uuid': '3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16da3a46-e07a-42db-9b3d-1516073a81e9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b467e0c8-db1c-469c-80cf-2432021ed2a5]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] <== disconnect_volume: return (637ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:12:55 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Deleting instance files /opt/stack/data/nova/instances/c29d7f9d-793f-4511-9203-06b653e52f72_del
Aug 14 18:12:55 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Deletion of /opt/stack/data/nova/instances/c29d7f9d-793f-4511-9203-06b653e52f72_del complete
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:55 user nova-compute[73078]: INFO os_vif [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:00:df,bridge_name='br-int',has_traffic_filtering=True,id=febea954-f895-4078-acd2-c9f87479a76b,network=Network(966cb532-886b-4eef-8b6b-1cdcb9bbe9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebea954-f8')
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:12:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942929011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942929011',id=13,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPEMynvkgK3D8wUwcv/n8OYQ1W8btAxcTUdDr+O//arZSNxfL73QYspdeKO7g4qkivuuHPX4nFtVqh3WBm6PhGbEDkt7rdYIfZn6k/tjOLMzedYNO0yL6edD9VtQvhxkA==',key_name='tempest-keypair-155161134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7328e29579b44e5894abeb47e1fe16a8',ramdisk_id='',reservation_id='r-3lybo561',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2139073796',owner_user_name='tempest-TaggedBootDevicesTest-2139073796-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:12:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e155f911c3444d3baffb0eb5ee75b773',uuid=3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "350b119d-c27a-4783-9d95-04bc9e75e8f6", "address": "fa:16:3e:61:d4:d6", "network": {"id": "966cb532-886b-4eef-8b6b-1cdcb9bbe9c1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1607312863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350b119d-c2", "ovs_interfaceid": "350b119d-c27a-4783-9d95-04bc9e75e8f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converting VIF {"id": "350b119d-c27a-4783-9d95-04bc9e75e8f6", "address": "fa:16:3e:61:d4:d6", "network": {"id": "966cb532-886b-4eef-8b6b-1cdcb9bbe9c1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1607312863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350b119d-c2", "ovs_interfaceid": "350b119d-c27a-4783-9d95-04bc9e75e8f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:d4:d6,bridge_name='br-int',has_traffic_filtering=True,id=350b119d-c27a-4783-9d95-04bc9e75e8f6,network=Network(966cb532-886b-4eef-8b6b-1cdcb9bbe9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350b119d-c2') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG os_vif [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:d4:d6,bridge_name='br-int',has_traffic_filtering=True,id=350b119d-c27a-4783-9d95-04bc9e75e8f6,network=Network(966cb532-886b-4eef-8b6b-1cdcb9bbe9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350b119d-c2') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap350b119d-c2, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap350b119d-c2, col_values=(('external_ids', {'iface-id': '350b119d-c27a-4783-9d95-04bc9e75e8f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:d4:d6', 'vm-uuid': '3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Checking UEFI support for host arch (x86_64) {{(pid=73078) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 14 18:12:55 user nova-compute[73078]: INFO nova.virt.libvirt.host [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] UEFI support detected
Aug 14 18:12:55 user nova-compute[73078]: INFO nova.compute.manager [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Took 1.54 seconds to destroy the instance on the hypervisor.
Aug 14 18:12:55 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:12:55 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:12:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:56 user nova-compute[73078]: INFO os_vif [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:d4:d6,bridge_name='br-int',has_traffic_filtering=True,id=350b119d-c27a-4783-9d95-04bc9e75e8f6,network=Network(966cb532-886b-4eef-8b6b-1cdcb9bbe9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350b119d-c2')
Aug 14 18:12:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2053d86d-eade-4ba5-a878-1a870c4b8f9f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "8d257202-d8ab-4161-9b67-045cf1e36772" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:12:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2053d86d-eade-4ba5-a878-1a870c4b8f9f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "8d257202-d8ab-4161-9b67-045cf1e36772" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:12:56 user nova-compute[73078]: INFO nova.compute.manager [None req-2053d86d-eade-4ba5-a878-1a870c4b8f9f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Shelving
Aug 14 18:12:56 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] No BDM found with device name hda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:12:56 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:12:56 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] No VIF found with MAC fa:16:3e:fd:5d:15, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:12:56 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] No VIF found with MAC fa:16:3e:b4:77:23, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:12:56 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Using config drive
Aug 14 18:12:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:56 user nova-compute[73078]: DEBUG nova.compute.manager [req-26a6cc01-c896-4296-8752-c903615b31f6 req-7caffd21-b30d-4a7c-9ef8-b5599f58a126 service nova] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Received event network-vif-plugged-89874ba3-0758-4c32-b1ec-6d0dd813fb71 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:12:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-26a6cc01-c896-4296-8752-c903615b31f6 req-7caffd21-b30d-4a7c-9ef8-b5599f58a126 service nova] Acquiring lock "c29d7f9d-793f-4511-9203-06b653e52f72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:12:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-26a6cc01-c896-4296-8752-c903615b31f6 req-7caffd21-b30d-4a7c-9ef8-b5599f58a126 service nova] Lock "c29d7f9d-793f-4511-9203-06b653e52f72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:12:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-26a6cc01-c896-4296-8752-c903615b31f6 req-7caffd21-b30d-4a7c-9ef8-b5599f58a126 service nova] Lock "c29d7f9d-793f-4511-9203-06b653e52f72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:12:56 user nova-compute[73078]: DEBUG nova.compute.manager [req-26a6cc01-c896-4296-8752-c903615b31f6 req-7caffd21-b30d-4a7c-9ef8-b5599f58a126 service nova] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] No waiting events found dispatching network-vif-plugged-89874ba3-0758-4c32-b1ec-6d0dd813fb71 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:12:56 user nova-compute[73078]: WARNING nova.compute.manager [req-26a6cc01-c896-4296-8752-c903615b31f6 req-7caffd21-b30d-4a7c-9ef8-b5599f58a126 service nova] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Received unexpected event network-vif-plugged-89874ba3-0758-4c32-b1ec-6d0dd813fb71 for instance with vm_state active and task_state deleting.
Aug 14 18:12:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:56 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Creating config drive at /opt/stack/data/nova/instances/3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223/disk.config
Aug 14 18:12:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppmoft483 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:56 user nova-compute[73078]: DEBUG nova.compute.manager [req-1ba6a1c9-f9e0-4bd9-87a6-c0fd852c36e8 req-7a58e040-3032-4949-9f12-72a602cddd33 service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Received event network-vif-unplugged-10688f4a-5919-4a48-9767-92e304a494be {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:12:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1ba6a1c9-f9e0-4bd9-87a6-c0fd852c36e8 req-7a58e040-3032-4949-9f12-72a602cddd33 service nova] Acquiring lock "8d257202-d8ab-4161-9b67-045cf1e36772-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:12:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1ba6a1c9-f9e0-4bd9-87a6-c0fd852c36e8 req-7a58e040-3032-4949-9f12-72a602cddd33 service nova] Lock "8d257202-d8ab-4161-9b67-045cf1e36772-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:12:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1ba6a1c9-f9e0-4bd9-87a6-c0fd852c36e8 req-7a58e040-3032-4949-9f12-72a602cddd33 service nova] Lock "8d257202-d8ab-4161-9b67-045cf1e36772-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:12:56 user nova-compute[73078]: DEBUG nova.compute.manager [req-1ba6a1c9-f9e0-4bd9-87a6-c0fd852c36e8 req-7a58e040-3032-4949-9f12-72a602cddd33 service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] No waiting events found dispatching network-vif-unplugged-10688f4a-5919-4a48-9767-92e304a494be {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:12:56 user nova-compute[73078]: WARNING nova.compute.manager [req-1ba6a1c9-f9e0-4bd9-87a6-c0fd852c36e8 req-7a58e040-3032-4949-9f12-72a602cddd33 service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Received unexpected event network-vif-unplugged-10688f4a-5919-4a48-9767-92e304a494be for instance with vm_state active and task_state shelving.
Aug 14 18:12:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppmoft483" returned: 0 in 0.067s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:57 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:57 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Instance destroyed successfully.
Aug 14 18:12:57 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:12:57 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Took 1.50 seconds to deallocate network for instance.
Aug 14 18:12:57 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-2053d86d-eade-4ba5-a878-1a870c4b8f9f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Beginning cold snapshot process
Aug 14 18:12:57 user nova-compute[73078]: DEBUG nova.privsep.utils [None req-2053d86d-eade-4ba5-a878-1a870c4b8f9f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73078) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 18:12:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-2053d86d-eade-4ba5-a878-1a870c4b8f9f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/disk /opt/stack/data/nova/instances/snapshots/tmpxk5oyn84/091d1d2b4b0c45e3b2a1d74fda603350 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:12:58 user nova-compute[73078]: INFO nova.compute.manager [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Took 0.85 seconds to detach 1 volumes for instance.
Aug 14 18:12:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:12:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:12:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-2053d86d-eade-4ba5-a878-1a870c4b8f9f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/disk /opt/stack/data/nova/instances/snapshots/tmpxk5oyn84/091d1d2b4b0c45e3b2a1d74fda603350" returned: 0 in 1.124s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:12:58 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-2053d86d-eade-4ba5-a878-1a870c4b8f9f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Snapshot extracted, beginning image upload
Aug 14 18:12:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:58 user nova-compute[73078]: DEBUG nova.compute.manager [req-5e1409d1-076d-4a62-99fa-9c9104e98f69 req-d6ea7e88-6f16-443b-9093-e59b3af5469e service nova] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Received event network-vif-deleted-89874ba3-0758-4c32-b1ec-6d0dd813fb71 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:12:58 user nova-compute[73078]: DEBUG nova.compute.manager [req-c2baac4d-567c-49f1-a9c5-53d37e771eb4 req-b082608f-fea7-450e-aeed-4b7286b59f65 service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Received event network-vif-plugged-10688f4a-5919-4a48-9767-92e304a494be {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:12:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-c2baac4d-567c-49f1-a9c5-53d37e771eb4 req-b082608f-fea7-450e-aeed-4b7286b59f65 service nova] Acquiring lock "8d257202-d8ab-4161-9b67-045cf1e36772-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:12:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-c2baac4d-567c-49f1-a9c5-53d37e771eb4 req-b082608f-fea7-450e-aeed-4b7286b59f65 service nova] Lock "8d257202-d8ab-4161-9b67-045cf1e36772-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:12:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-c2baac4d-567c-49f1-a9c5-53d37e771eb4 req-b082608f-fea7-450e-aeed-4b7286b59f65 service nova] Lock "8d257202-d8ab-4161-9b67-045cf1e36772-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:12:58 user nova-compute[73078]: DEBUG nova.compute.manager [req-c2baac4d-567c-49f1-a9c5-53d37e771eb4 req-b082608f-fea7-450e-aeed-4b7286b59f65 service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] No waiting events found dispatching network-vif-plugged-10688f4a-5919-4a48-9767-92e304a494be {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:12:58 user nova-compute[73078]: WARNING nova.compute.manager [req-c2baac4d-567c-49f1-a9c5-53d37e771eb4 req-b082608f-fea7-450e-aeed-4b7286b59f65 service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Received unexpected event network-vif-plugged-10688f4a-5919-4a48-9767-92e304a494be for instance with vm_state active and task_state shelving_image_uploading.
Aug 14 18:12:58 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:12:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:58 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:12:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.589s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:12:59 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Deleted allocations for instance c29d7f9d-793f-4511-9203-06b653e52f72
Aug 14 18:12:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4a9fec26-c5ed-4195-8ced-fc3d3d2876c8 tempest-DeleteServersTestJSON-1205702529 tempest-DeleteServersTestJSON-1205702529-project-member] Lock "c29d7f9d-793f-4511-9203-06b653e52f72" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.916s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:12:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:12:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG nova.compute.manager [req-5c89f668-1295-4e7d-a672-55daa6d20fb8 req-1b63b6e7-f7e5-41a4-8691-22fdbf67f602 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-plugged-febea954-f895-4078-acd2-c9f87479a76b {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5c89f668-1295-4e7d-a672-55daa6d20fb8 req-1b63b6e7-f7e5-41a4-8691-22fdbf67f602 service nova] Acquiring lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5c89f668-1295-4e7d-a672-55daa6d20fb8 req-1b63b6e7-f7e5-41a4-8691-22fdbf67f602 service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5c89f668-1295-4e7d-a672-55daa6d20fb8 req-1b63b6e7-f7e5-41a4-8691-22fdbf67f602 service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG nova.compute.manager [req-5c89f668-1295-4e7d-a672-55daa6d20fb8 req-1b63b6e7-f7e5-41a4-8691-22fdbf67f602 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] No waiting events found dispatching network-vif-plugged-febea954-f895-4078-acd2-c9f87479a76b {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:13:00 user nova-compute[73078]: WARNING nova.compute.manager [req-5c89f668-1295-4e7d-a672-55daa6d20fb8 req-1b63b6e7-f7e5-41a4-8691-22fdbf67f602 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received unexpected event network-vif-plugged-febea954-f895-4078-acd2-c9f87479a76b for instance with vm_state building and task_state spawning.
Aug 14 18:13:00 user nova-compute[73078]: DEBUG nova.compute.manager [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-plugged-be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] Acquiring lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG nova.compute.manager [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] No waiting events found dispatching network-vif-plugged-be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:13:00 user nova-compute[73078]: WARNING nova.compute.manager [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received unexpected event network-vif-plugged-be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0 for instance with vm_state building and task_state spawning.
Aug 14 18:13:00 user nova-compute[73078]: DEBUG nova.compute.manager [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-plugged-be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] Acquiring lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG nova.compute.manager [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] No waiting events found dispatching network-vif-plugged-be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:13:00 user nova-compute[73078]: WARNING nova.compute.manager [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received unexpected event network-vif-plugged-be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0 for instance with vm_state building and task_state spawning.
Aug 14 18:13:00 user nova-compute[73078]: DEBUG nova.compute.manager [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-plugged-b845300e-603e-4702-a3cc-cecf5bfcf026 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] Acquiring lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG nova.compute.manager [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] No waiting events found dispatching network-vif-plugged-b845300e-603e-4702-a3cc-cecf5bfcf026 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:13:00 user nova-compute[73078]: WARNING nova.compute.manager [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received unexpected event network-vif-plugged-b845300e-603e-4702-a3cc-cecf5bfcf026 for instance with vm_state building and task_state spawning.
Aug 14 18:13:00 user nova-compute[73078]: DEBUG nova.compute.manager [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-plugged-b845300e-603e-4702-a3cc-cecf5bfcf026 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] Acquiring lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG nova.compute.manager [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] No waiting events found dispatching network-vif-plugged-b845300e-603e-4702-a3cc-cecf5bfcf026 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:13:00 user nova-compute[73078]: WARNING nova.compute.manager [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received unexpected event network-vif-plugged-b845300e-603e-4702-a3cc-cecf5bfcf026 for instance with vm_state building and task_state spawning.
Aug 14 18:13:00 user nova-compute[73078]: DEBUG nova.compute.manager [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-plugged-f725089c-89c9-447a-88e7-a427ad17f344 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] Acquiring lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG nova.compute.manager [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] No waiting events found dispatching network-vif-plugged-f725089c-89c9-447a-88e7-a427ad17f344 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:13:00 user nova-compute[73078]: WARNING nova.compute.manager [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received unexpected event network-vif-plugged-f725089c-89c9-447a-88e7-a427ad17f344 for instance with vm_state building and task_state spawning.
Aug 14 18:13:00 user nova-compute[73078]: DEBUG nova.compute.manager [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-plugged-f725089c-89c9-447a-88e7-a427ad17f344 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] Acquiring lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG nova.compute.manager [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] No waiting events found dispatching network-vif-plugged-f725089c-89c9-447a-88e7-a427ad17f344 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:13:00 user nova-compute[73078]: WARNING nova.compute.manager [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received unexpected event network-vif-plugged-f725089c-89c9-447a-88e7-a427ad17f344 for instance with vm_state building and task_state spawning.
Aug 14 18:13:00 user nova-compute[73078]: DEBUG nova.compute.manager [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-plugged-0da08486-8ca6-4ab9-8328-7073e9a8b0f3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] Acquiring lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG nova.compute.manager [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] No waiting events found dispatching network-vif-plugged-0da08486-8ca6-4ab9-8328-7073e9a8b0f3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:13:00 user nova-compute[73078]: WARNING nova.compute.manager [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received unexpected event network-vif-plugged-0da08486-8ca6-4ab9-8328-7073e9a8b0f3 for instance with vm_state building and task_state spawning.
Aug 14 18:13:00 user nova-compute[73078]: DEBUG nova.compute.manager [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-plugged-0da08486-8ca6-4ab9-8328-7073e9a8b0f3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] Acquiring lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG nova.compute.manager [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] No waiting events found dispatching network-vif-plugged-0da08486-8ca6-4ab9-8328-7073e9a8b0f3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:13:00 user nova-compute[73078]: WARNING nova.compute.manager [req-31d10971-1360-4e86-b167-f01d7938f771 req-b4e0b7ab-c10d-4092-9d39-4773e3b9fb5e service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received unexpected event network-vif-plugged-0da08486-8ca6-4ab9-8328-7073e9a8b0f3 for instance with vm_state building and task_state spawning.
Aug 14 18:13:00 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG nova.compute.manager [req-b4f212ed-ccf0-474a-82be-593eed7f5957 req-afa18166-c6bd-43f4-94d0-7b3dfdb481c5 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-plugged-d1547f0c-cfbd-481c-9657-a3ed79040d1e {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b4f212ed-ccf0-474a-82be-593eed7f5957 req-afa18166-c6bd-43f4-94d0-7b3dfdb481c5 service nova] Acquiring lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b4f212ed-ccf0-474a-82be-593eed7f5957 req-afa18166-c6bd-43f4-94d0-7b3dfdb481c5 service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b4f212ed-ccf0-474a-82be-593eed7f5957 req-afa18166-c6bd-43f4-94d0-7b3dfdb481c5 service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG nova.compute.manager [req-b4f212ed-ccf0-474a-82be-593eed7f5957 req-afa18166-c6bd-43f4-94d0-7b3dfdb481c5 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] No waiting events found dispatching network-vif-plugged-d1547f0c-cfbd-481c-9657-a3ed79040d1e {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:13:00 user nova-compute[73078]: WARNING nova.compute.manager [req-b4f212ed-ccf0-474a-82be-593eed7f5957 req-afa18166-c6bd-43f4-94d0-7b3dfdb481c5 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received unexpected event network-vif-plugged-d1547f0c-cfbd-481c-9657-a3ed79040d1e for instance with vm_state building and task_state spawning.
Aug 14 18:13:00 user nova-compute[73078]: DEBUG nova.compute.manager [req-b4f212ed-ccf0-474a-82be-593eed7f5957 req-afa18166-c6bd-43f4-94d0-7b3dfdb481c5 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-plugged-d1547f0c-cfbd-481c-9657-a3ed79040d1e {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b4f212ed-ccf0-474a-82be-593eed7f5957 req-afa18166-c6bd-43f4-94d0-7b3dfdb481c5 service nova] Acquiring lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b4f212ed-ccf0-474a-82be-593eed7f5957 req-afa18166-c6bd-43f4-94d0-7b3dfdb481c5 service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b4f212ed-ccf0-474a-82be-593eed7f5957 req-afa18166-c6bd-43f4-94d0-7b3dfdb481c5 service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:00 user nova-compute[73078]: DEBUG nova.compute.manager [req-b4f212ed-ccf0-474a-82be-593eed7f5957 req-afa18166-c6bd-43f4-94d0-7b3dfdb481c5 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] No waiting events found dispatching network-vif-plugged-d1547f0c-cfbd-481c-9657-a3ed79040d1e {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:13:00 user nova-compute[73078]: WARNING nova.compute.manager [req-b4f212ed-ccf0-474a-82be-593eed7f5957 req-afa18166-c6bd-43f4-94d0-7b3dfdb481c5 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received unexpected event network-vif-plugged-d1547f0c-cfbd-481c-9657-a3ed79040d1e for instance with vm_state building and task_state spawning.
Aug 14 18:13:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:01 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-2053d86d-eade-4ba5-a878-1a870c4b8f9f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Snapshot image upload complete
Aug 14 18:13:01 user nova-compute[73078]: DEBUG nova.compute.manager [None req-2053d86d-eade-4ba5-a878-1a870c4b8f9f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:13:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:01 user nova-compute[73078]: INFO nova.compute.manager [None req-2053d86d-eade-4ba5-a878-1a870c4b8f9f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Shelve offloading
Aug 14 18:13:02 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Instance destroyed successfully.
Aug 14 18:13:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-2053d86d-eade-4ba5-a878-1a870c4b8f9f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:13:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2053d86d-eade-4ba5-a878-1a870c4b8f9f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "refresh_cache-8d257202-d8ab-4161-9b67-045cf1e36772" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:13:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2053d86d-eade-4ba5-a878-1a870c4b8f9f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquired lock "refresh_cache-8d257202-d8ab-4161-9b67-045cf1e36772" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:13:02 user nova-compute[73078]: DEBUG nova.network.neutron [None req-2053d86d-eade-4ba5-a878-1a870c4b8f9f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:13:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:02 user nova-compute[73078]: DEBUG nova.network.neutron [None req-2053d86d-eade-4ba5-a878-1a870c4b8f9f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Updating instance_info_cache with network_info: [{"id": "10688f4a-5919-4a48-9767-92e304a494be", "address": "fa:16:3e:a4:3b:fc", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10688f4a-59", "ovs_interfaceid": "10688f4a-5919-4a48-9767-92e304a494be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:13:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2053d86d-eade-4ba5-a878-1a870c4b8f9f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Releasing lock "refresh_cache-8d257202-d8ab-4161-9b67-045cf1e36772" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:13:02 user nova-compute[73078]: DEBUG nova.compute.manager [req-3354d86a-3700-4d57-9f0b-74d91dfca956 req-b526720f-0194-4bb9-89f2-0d49d54aaf40 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-plugged-febea954-f895-4078-acd2-c9f87479a76b {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:13:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3354d86a-3700-4d57-9f0b-74d91dfca956 req-b526720f-0194-4bb9-89f2-0d49d54aaf40 service nova] Acquiring lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3354d86a-3700-4d57-9f0b-74d91dfca956 req-b526720f-0194-4bb9-89f2-0d49d54aaf40 service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3354d86a-3700-4d57-9f0b-74d91dfca956 req-b526720f-0194-4bb9-89f2-0d49d54aaf40 service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:02 user nova-compute[73078]: DEBUG nova.compute.manager [req-3354d86a-3700-4d57-9f0b-74d91dfca956 req-b526720f-0194-4bb9-89f2-0d49d54aaf40 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] No waiting events found dispatching network-vif-plugged-febea954-f895-4078-acd2-c9f87479a76b {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:13:02 user nova-compute[73078]: WARNING nova.compute.manager [req-3354d86a-3700-4d57-9f0b-74d91dfca956 req-b526720f-0194-4bb9-89f2-0d49d54aaf40 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received unexpected event network-vif-plugged-febea954-f895-4078-acd2-c9f87479a76b for instance with vm_state building and task_state spawning.
Aug 14 18:13:02 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036782.7527995, 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:13:02 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] VM Resumed (Lifecycle Event)
Aug 14 18:13:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:13:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:13:02 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Instance spawned successfully.
Aug 14 18:13:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:13:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:13:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:13:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:13:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:13:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:13:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:13:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:13:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:13:02 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:13:02 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036782.7569268, 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:13:02 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] VM Started (Lifecycle Event)
Aug 14 18:13:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:13:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:13:02 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:13:02 user nova-compute[73078]: INFO nova.compute.manager [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Took 13.38 seconds to spawn the instance on the hypervisor.
Aug 14 18:13:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:13:02 user nova-compute[73078]: DEBUG nova.compute.manager [req-1734b9d9-d50e-4770-9c2c-b413b9c594ca req-989b467f-5d59-434c-b693-067567520e03 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-plugged-350b119d-c27a-4783-9d95-04bc9e75e8f6 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:13:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1734b9d9-d50e-4770-9c2c-b413b9c594ca req-989b467f-5d59-434c-b693-067567520e03 service nova] Acquiring lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1734b9d9-d50e-4770-9c2c-b413b9c594ca req-989b467f-5d59-434c-b693-067567520e03 service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1734b9d9-d50e-4770-9c2c-b413b9c594ca req-989b467f-5d59-434c-b693-067567520e03 service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:02 user nova-compute[73078]: DEBUG nova.compute.manager [req-1734b9d9-d50e-4770-9c2c-b413b9c594ca req-989b467f-5d59-434c-b693-067567520e03 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] No waiting events found dispatching network-vif-plugged-350b119d-c27a-4783-9d95-04bc9e75e8f6 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:13:02 user nova-compute[73078]: WARNING nova.compute.manager [req-1734b9d9-d50e-4770-9c2c-b413b9c594ca req-989b467f-5d59-434c-b693-067567520e03 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received unexpected event network-vif-plugged-350b119d-c27a-4783-9d95-04bc9e75e8f6 for instance with vm_state building and task_state spawning.
Aug 14 18:13:02 user nova-compute[73078]: DEBUG nova.compute.manager [req-1734b9d9-d50e-4770-9c2c-b413b9c594ca req-989b467f-5d59-434c-b693-067567520e03 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-plugged-350b119d-c27a-4783-9d95-04bc9e75e8f6 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:13:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1734b9d9-d50e-4770-9c2c-b413b9c594ca req-989b467f-5d59-434c-b693-067567520e03 service nova] Acquiring lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1734b9d9-d50e-4770-9c2c-b413b9c594ca req-989b467f-5d59-434c-b693-067567520e03 service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1734b9d9-d50e-4770-9c2c-b413b9c594ca req-989b467f-5d59-434c-b693-067567520e03 service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:02 user nova-compute[73078]: DEBUG nova.compute.manager [req-1734b9d9-d50e-4770-9c2c-b413b9c594ca req-989b467f-5d59-434c-b693-067567520e03 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] No waiting events found dispatching network-vif-plugged-350b119d-c27a-4783-9d95-04bc9e75e8f6 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:13:02 user nova-compute[73078]: WARNING nova.compute.manager [req-1734b9d9-d50e-4770-9c2c-b413b9c594ca req-989b467f-5d59-434c-b693-067567520e03 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received unexpected event network-vif-plugged-350b119d-c27a-4783-9d95-04bc9e75e8f6 for instance with vm_state building and task_state spawning.
Aug 14 18:13:02 user nova-compute[73078]: INFO nova.compute.manager [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Took 43.43 seconds to build instance.
Aug 14 18:13:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f33de243-f4d9-423b-a722-46402f7eddb1 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 43.555s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:03 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Instance destroyed successfully.
Aug 14 18:13:03 user nova-compute[73078]: DEBUG nova.objects.instance [None req-2053d86d-eade-4ba5-a878-1a870c4b8f9f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lazy-loading 'resources' on Instance uuid 8d257202-d8ab-4161-9b67-045cf1e36772 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:13:03 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-2053d86d-eade-4ba5-a878-1a870c4b8f9f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:10:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-371462966',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-371462966',id=6,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAytc5c0yCOWi5RHK68JcsgGL6T5tQXRdaCO7qK9BUc6YvtuTuce/64y+OO5qRLfFUuylpXSvDyoEGmdGwwQQmepFt4h6dnqNjkgX3t+x5pkguE/gjsJr/ZWvvPydMGAmA==',key_name='tempest-keypair-1699997067',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:11:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5f00de2496804d6eb570f93307f3f088',ramdisk_id='',reservation_id='r-m6qase30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1593185714',owner_user_name='tempest-AttachVolumeShelveTestJSON-1593185714-project-member',shelved_at='2023-08-14T18:13:01.912652',shelved_host='user',shelved_image_id='91f020a1-ab3f-4e4e-a06f-8c52ac45f099'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:12:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b07aecccb704835b6b765325b1d18bf',uuid=8d257202-d8ab-4161-9b67-045cf1e36772,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "10688f4a-5919-4a48-9767-92e304a494be", "address": "fa:16:3e:a4:3b:fc", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10688f4a-59", "ovs_interfaceid": "10688f4a-5919-4a48-9767-92e304a494be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:13:03 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-2053d86d-eade-4ba5-a878-1a870c4b8f9f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Converting VIF {"id": "10688f4a-5919-4a48-9767-92e304a494be", "address": "fa:16:3e:a4:3b:fc", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10688f4a-59", "ovs_interfaceid": "10688f4a-5919-4a48-9767-92e304a494be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:13:03 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-2053d86d-eade-4ba5-a878-1a870c4b8f9f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:3b:fc,bridge_name='br-int',has_traffic_filtering=True,id=10688f4a-5919-4a48-9767-92e304a494be,network=Network(a3adc062-ecf8-4c88-84ab-69425b236920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10688f4a-59') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:13:03 user nova-compute[73078]: DEBUG os_vif [None req-2053d86d-eade-4ba5-a878-1a870c4b8f9f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:3b:fc,bridge_name='br-int',has_traffic_filtering=True,id=10688f4a-5919-4a48-9767-92e304a494be,network=Network(a3adc062-ecf8-4c88-84ab-69425b236920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10688f4a-59') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:13:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10688f4a-59, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:13:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:03 user nova-compute[73078]: INFO os_vif [None req-2053d86d-eade-4ba5-a878-1a870c4b8f9f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:3b:fc,bridge_name='br-int',has_traffic_filtering=True,id=10688f4a-5919-4a48-9767-92e304a494be,network=Network(a3adc062-ecf8-4c88-84ab-69425b236920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10688f4a-59')
Aug 14 18:13:03 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-2053d86d-eade-4ba5-a878-1a870c4b8f9f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Deleting instance files /opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772_del
Aug 14 18:13:03 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-2053d86d-eade-4ba5-a878-1a870c4b8f9f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Deletion of /opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772_del complete
Aug 14 18:13:03 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-2053d86d-eade-4ba5-a878-1a870c4b8f9f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Deleted allocations for instance 8d257202-d8ab-4161-9b67-045cf1e36772
Aug 14 18:13:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2053d86d-eade-4ba5-a878-1a870c4b8f9f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2053d86d-eade-4ba5-a878-1a870c4b8f9f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:03 user nova-compute[73078]: DEBUG nova.objects.instance [None req-2053d86d-eade-4ba5-a878-1a870c4b8f9f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lazy-loading 'numa_topology' on Instance uuid 8d257202-d8ab-4161-9b67-045cf1e36772 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:13:03 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-2053d86d-eade-4ba5-a878-1a870c4b8f9f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:13:03 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-2053d86d-eade-4ba5-a878-1a870c4b8f9f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:13:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2053d86d-eade-4ba5-a878-1a870c4b8f9f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.316s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2053d86d-eade-4ba5-a878-1a870c4b8f9f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "8d257202-d8ab-4161-9b67-045cf1e36772" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.417s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:08 user nova-compute[73078]: DEBUG nova.compute.manager [req-ba41298f-6681-4204-bfdb-6a601b399e25 req-d54c6771-ce2b-49bb-995b-74cad3b294c1 service nova] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Received event network-changed-733825c5-0713-4980-9e5d-4a1120fb1598 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:13:08 user nova-compute[73078]: DEBUG nova.compute.manager [req-ba41298f-6681-4204-bfdb-6a601b399e25 req-d54c6771-ce2b-49bb-995b-74cad3b294c1 service nova] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Refreshing instance network info cache due to event network-changed-733825c5-0713-4980-9e5d-4a1120fb1598. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:13:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ba41298f-6681-4204-bfdb-6a601b399e25 req-d54c6771-ce2b-49bb-995b-74cad3b294c1 service nova] Acquiring lock "refresh_cache-0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:13:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ba41298f-6681-4204-bfdb-6a601b399e25 req-d54c6771-ce2b-49bb-995b-74cad3b294c1 service nova] Acquired lock "refresh_cache-0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:13:08 user nova-compute[73078]: DEBUG nova.network.neutron [req-ba41298f-6681-4204-bfdb-6a601b399e25 req-d54c6771-ce2b-49bb-995b-74cad3b294c1 service nova] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Refreshing network info cache for port 733825c5-0713-4980-9e5d-4a1120fb1598 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:13:08 user nova-compute[73078]: DEBUG nova.network.neutron [req-ba41298f-6681-4204-bfdb-6a601b399e25 req-d54c6771-ce2b-49bb-995b-74cad3b294c1 service nova] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Updated VIF entry in instance network info cache for port 733825c5-0713-4980-9e5d-4a1120fb1598. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:13:08 user nova-compute[73078]: DEBUG nova.network.neutron [req-ba41298f-6681-4204-bfdb-6a601b399e25 req-d54c6771-ce2b-49bb-995b-74cad3b294c1 service nova] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Updating instance_info_cache with network_info: [{"id": "733825c5-0713-4980-9e5d-4a1120fb1598", "address": "fa:16:3e:e5:43:d0", "network": {"id": "3f423cdf-1eb1-4a1b-acf0-37ef2a8dfdca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1815766145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff3894cf6eba466da26bad6c3bd978f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap733825c5-07", "ovs_interfaceid": "733825c5-0713-4980-9e5d-4a1120fb1598", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:13:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ba41298f-6681-4204-bfdb-6a601b399e25 req-d54c6771-ce2b-49bb-995b-74cad3b294c1 service nova] Releasing lock "refresh_cache-0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:13:10 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692036775.1275802, c29d7f9d-793f-4511-9203-06b653e52f72 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:13:10 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] VM Stopped (Lifecycle Event)
Aug 14 18:13:10 user nova-compute[73078]: DEBUG nova.compute.manager [None req-7525dc8c-1a86-461f-8915-3f2707159b53 None None] [instance: c29d7f9d-793f-4511-9203-06b653e52f72] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:13:10 user nova-compute[73078]: DEBUG nova.compute.manager [req-76be4777-2b39-40d0-868a-307f86e0d061 req-f15c53ad-64ba-4542-8004-35e4ed5296ed service nova] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Received event network-changed-0e2c0a61-c9ce-49a5-891d-97803d8557e1 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:13:10 user nova-compute[73078]: DEBUG nova.compute.manager [req-76be4777-2b39-40d0-868a-307f86e0d061 req-f15c53ad-64ba-4542-8004-35e4ed5296ed service nova] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Refreshing instance network info cache due to event network-changed-0e2c0a61-c9ce-49a5-891d-97803d8557e1. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:13:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-76be4777-2b39-40d0-868a-307f86e0d061 req-f15c53ad-64ba-4542-8004-35e4ed5296ed service nova] Acquiring lock "refresh_cache-10f9d4a9-ee3f-45bd-95e4-edd4819dcf30" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:13:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-76be4777-2b39-40d0-868a-307f86e0d061 req-f15c53ad-64ba-4542-8004-35e4ed5296ed service nova] Acquired lock "refresh_cache-10f9d4a9-ee3f-45bd-95e4-edd4819dcf30" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:13:10 user nova-compute[73078]: DEBUG nova.network.neutron [req-76be4777-2b39-40d0-868a-307f86e0d061 req-f15c53ad-64ba-4542-8004-35e4ed5296ed service nova] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Refreshing network info cache for port 0e2c0a61-c9ce-49a5-891d-97803d8557e1 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:13:11 user nova-compute[73078]: DEBUG nova.network.neutron [req-76be4777-2b39-40d0-868a-307f86e0d061 req-f15c53ad-64ba-4542-8004-35e4ed5296ed service nova] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Updated VIF entry in instance network info cache for port 0e2c0a61-c9ce-49a5-891d-97803d8557e1. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:13:11 user nova-compute[73078]: DEBUG nova.network.neutron [req-76be4777-2b39-40d0-868a-307f86e0d061 req-f15c53ad-64ba-4542-8004-35e4ed5296ed service nova] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Updating instance_info_cache with network_info: [{"id": "0e2c0a61-c9ce-49a5-891d-97803d8557e1", "address": "fa:16:3e:63:16:7b", "network": {"id": "bcbb9361-92bf-48f3-9d61-e5cdb5d21980", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1013223391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d0d923a445747d8a812c1b7b4510398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e2c0a61-c9", "ovs_interfaceid": "0e2c0a61-c9ce-49a5-891d-97803d8557e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:13:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-76be4777-2b39-40d0-868a-307f86e0d061 req-f15c53ad-64ba-4542-8004-35e4ed5296ed service nova] Releasing lock "refresh_cache-10f9d4a9-ee3f-45bd-95e4-edd4819dcf30" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:13:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Acquiring lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:12 user nova-compute[73078]: DEBUG nova.objects.instance [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Lazy-loading 'flavor' on Instance uuid 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:13:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.144s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:12 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692036777.3227046, 8d257202-d8ab-4161-9b67-045cf1e36772 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:13:12 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] VM Stopped (Lifecycle Event)
Aug 14 18:13:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-b31b3f50-22f7-4590-9f19-d37f0a5baa6c None None] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:13:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Acquiring lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:12 user nova-compute[73078]: INFO nova.compute.manager [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Attaching volume 4313835b-9f25-4127-a89f-0b3898c77641 to /dev/sdc
Aug 14 18:13:12 user nova-compute[73078]: DEBUG os_brick.utils [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:13:12 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:12 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:12 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cb7744-e569-464c-a73c-2d79335f0b73]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:12 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:12 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:12 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4d76cc-4c9a-4b6d-83e3-1f5b51d8eba9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:12 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:12 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:12 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c10797-c700-4267-af62-9b58f9571882]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:12 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a2635e-d4f2-42f1-bb6b-9ba505c0aefd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:12 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:12 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:13:12 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:13:12 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:12 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:13:12 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:13:12 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd3bf6d-6050-45a1-b845-bfd80b337065]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:12 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:13:12 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:13:12 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:13:12 user nova-compute[73078]: DEBUG os_brick.utils [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:13:12 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Updating existing volume attachment record: f5e34f9d-d8d4-470c-848a-320e216c6551 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:13:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Acquiring lock "10f9d4a9-ee3f-45bd-95e4-edd4819dcf30" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "10f9d4a9-ee3f-45bd-95e4-edd4819dcf30" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:14 user nova-compute[73078]: DEBUG nova.objects.instance [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lazy-loading 'flavor' on Instance uuid 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:13:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "10f9d4a9-ee3f-45bd-95e4-edd4819dcf30" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Acquiring lock "10f9d4a9-ee3f-45bd-95e4-edd4819dcf30" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "10f9d4a9-ee3f-45bd-95e4-edd4819dcf30" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:14 user nova-compute[73078]: INFO nova.compute.manager [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Attaching volume 47395855-b833-46c1-9841-ed81c1bee632 to /dev/vdb
Aug 14 18:13:14 user nova-compute[73078]: DEBUG os_brick.utils [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:13:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:14 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d523aa52-6a00-497f-bae7-80314e658d36]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:14 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d497732-4bec-47f9-bf99-d0cbee63a330]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:14 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7ea40c-4326-460c-949b-ddc30d592016]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:14 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[54515ba1-cfa3-4c53-8b40-fdc77564a284]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:13:14 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:13:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:13:14 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:13:14 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3101bdd5-ee5d-48d1-9c54-f3ba36895ef8]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:14 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:13:14 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:13:14 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:13:14 user nova-compute[73078]: DEBUG os_brick.utils [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:13:14 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Updating existing volume attachment record: 0a5edc96-54e6-4fba-8544-83dde8c838aa {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:13:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:18 user nova-compute[73078]: DEBUG nova.compute.manager [req-4d57dea4-ef84-4fdd-bfed-2c870aba84e8 req-754d63c4-abe2-4300-85cc-30af9b564b7b service nova] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Received event network-changed-a8a4ff9c-da83-430a-aa65-d8eaf189416e {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:13:18 user nova-compute[73078]: DEBUG nova.compute.manager [req-4d57dea4-ef84-4fdd-bfed-2c870aba84e8 req-754d63c4-abe2-4300-85cc-30af9b564b7b service nova] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Refreshing instance network info cache due to event network-changed-a8a4ff9c-da83-430a-aa65-d8eaf189416e. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:13:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4d57dea4-ef84-4fdd-bfed-2c870aba84e8 req-754d63c4-abe2-4300-85cc-30af9b564b7b service nova] Acquiring lock "refresh_cache-b97b330e-7a72-4d3c-8810-98a4f3a27ce7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:13:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4d57dea4-ef84-4fdd-bfed-2c870aba84e8 req-754d63c4-abe2-4300-85cc-30af9b564b7b service nova] Acquired lock "refresh_cache-b97b330e-7a72-4d3c-8810-98a4f3a27ce7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:13:18 user nova-compute[73078]: DEBUG nova.network.neutron [req-4d57dea4-ef84-4fdd-bfed-2c870aba84e8 req-754d63c4-abe2-4300-85cc-30af9b564b7b service nova] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Refreshing network info cache for port a8a4ff9c-da83-430a-aa65-d8eaf189416e {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:13:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Acquiring lock "b97b330e-7a72-4d3c-8810-98a4f3a27ce7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Lock "b97b330e-7a72-4d3c-8810-98a4f3a27ce7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:18 user nova-compute[73078]: DEBUG nova.objects.instance [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Lazy-loading 'flavor' on Instance uuid b97b330e-7a72-4d3c-8810-98a4f3a27ce7 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:13:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Lock "b97b330e-7a72-4d3c-8810-98a4f3a27ce7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:18 user nova-compute[73078]: DEBUG nova.network.neutron [req-4d57dea4-ef84-4fdd-bfed-2c870aba84e8 req-754d63c4-abe2-4300-85cc-30af9b564b7b service nova] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Updated VIF entry in instance network info cache for port a8a4ff9c-da83-430a-aa65-d8eaf189416e. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:13:18 user nova-compute[73078]: DEBUG nova.network.neutron [req-4d57dea4-ef84-4fdd-bfed-2c870aba84e8 req-754d63c4-abe2-4300-85cc-30af9b564b7b service nova] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Updating instance_info_cache with network_info: [{"id": "a8a4ff9c-da83-430a-aa65-d8eaf189416e", "address": "fa:16:3e:5b:79:d0", "network": {"id": "2a3295c2-a3cc-40eb-858f-32f664e73d8f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1030215120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e318b0d535142f2989495f416995a1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a4ff9c-da", "ovs_interfaceid": "a8a4ff9c-da83-430a-aa65-d8eaf189416e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:13:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4d57dea4-ef84-4fdd-bfed-2c870aba84e8 req-754d63c4-abe2-4300-85cc-30af9b564b7b service nova] Releasing lock "refresh_cache-b97b330e-7a72-4d3c-8810-98a4f3a27ce7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:13:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Acquiring lock "b97b330e-7a72-4d3c-8810-98a4f3a27ce7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Lock "b97b330e-7a72-4d3c-8810-98a4f3a27ce7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:19 user nova-compute[73078]: INFO nova.compute.manager [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Attaching volume bec46c8b-3b81-4076-b0e0-539d3564ac31 to /dev/vdb
Aug 14 18:13:19 user nova-compute[73078]: DEBUG os_brick.utils [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:13:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:19 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bce283b-9947-4018-93e9-5cd50b077418]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:19 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98c6fde-65ff-4a63-87c7-40adb491dc4b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:19 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfc5421-8bf5-4b56-8a1b-5a52aa861256]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:19 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcdc0b7-328a-480f-9ea8-bc2bebac39fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:13:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:13:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:13:19 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:13:19 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b629684-977a-4ed9-a0d0-640084f3cbd5]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:13:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:13:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:13:19 user nova-compute[73078]: DEBUG os_brick.utils [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:13:19 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Updating existing volume attachment record: b7f58768-dd51-4cbe-838f-09267281ff65 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:13:20 user nova-compute[73078]: DEBUG nova.compute.manager [req-769fdee8-d8db-4087-bcf1-7eb6f7c1b399 req-4a02a507-97a7-4787-8d3b-683845797c17 service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Received event network-changed-b1c66b74-5403-4bfb-9826-7d95c1e92356 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:13:20 user nova-compute[73078]: DEBUG nova.compute.manager [req-769fdee8-d8db-4087-bcf1-7eb6f7c1b399 req-4a02a507-97a7-4787-8d3b-683845797c17 service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Refreshing instance network info cache due to event network-changed-b1c66b74-5403-4bfb-9826-7d95c1e92356. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:13:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-769fdee8-d8db-4087-bcf1-7eb6f7c1b399 req-4a02a507-97a7-4787-8d3b-683845797c17 service nova] Acquiring lock "refresh_cache-ad1d1145-1a70-4a9c-b563-6bda437dc0cc" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:13:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-769fdee8-d8db-4087-bcf1-7eb6f7c1b399 req-4a02a507-97a7-4787-8d3b-683845797c17 service nova] Acquired lock "refresh_cache-ad1d1145-1a70-4a9c-b563-6bda437dc0cc" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:13:20 user nova-compute[73078]: DEBUG nova.network.neutron [req-769fdee8-d8db-4087-bcf1-7eb6f7c1b399 req-4a02a507-97a7-4787-8d3b-683845797c17 service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Refreshing network info cache for port b1c66b74-5403-4bfb-9826-7d95c1e92356 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:13:20 user nova-compute[73078]: DEBUG nova.compute.manager [req-a4117d97-2d94-49e6-8886-bfc01cddd330 req-614152de-66b1-42c3-acc7-97d34d58c164 service nova] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Received event network-changed-90186594-310a-4bfa-8593-6a6f54bb2b9b {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:13:20 user nova-compute[73078]: DEBUG nova.compute.manager [req-a4117d97-2d94-49e6-8886-bfc01cddd330 req-614152de-66b1-42c3-acc7-97d34d58c164 service nova] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Refreshing instance network info cache due to event network-changed-90186594-310a-4bfa-8593-6a6f54bb2b9b. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:13:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a4117d97-2d94-49e6-8886-bfc01cddd330 req-614152de-66b1-42c3-acc7-97d34d58c164 service nova] Acquiring lock "refresh_cache-e8ad453e-67b1-4af2-b85b-a5e100c11446" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:13:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a4117d97-2d94-49e6-8886-bfc01cddd330 req-614152de-66b1-42c3-acc7-97d34d58c164 service nova] Acquired lock "refresh_cache-e8ad453e-67b1-4af2-b85b-a5e100c11446" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:13:20 user nova-compute[73078]: DEBUG nova.network.neutron [req-a4117d97-2d94-49e6-8886-bfc01cddd330 req-614152de-66b1-42c3-acc7-97d34d58c164 service nova] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Refreshing network info cache for port 90186594-310a-4bfa-8593-6a6f54bb2b9b {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:13:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-326c8d7a-2a9b-45f8-84a9-8a6e7e2599dc tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Acquiring lock "interface-ad1d1145-1a70-4a9c-b563-6bda437dc0cc-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-326c8d7a-2a9b-45f8-84a9-8a6e7e2599dc tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lock "interface-ad1d1145-1a70-4a9c-b563-6bda437dc0cc-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:21 user nova-compute[73078]: DEBUG nova.objects.instance [None req-326c8d7a-2a9b-45f8-84a9-8a6e7e2599dc tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lazy-loading 'flavor' on Instance uuid ad1d1145-1a70-4a9c-b563-6bda437dc0cc {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:13:21 user nova-compute[73078]: DEBUG nova.objects.instance [None req-326c8d7a-2a9b-45f8-84a9-8a6e7e2599dc tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lazy-loading 'pci_requests' on Instance uuid ad1d1145-1a70-4a9c-b563-6bda437dc0cc {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:13:21 user nova-compute[73078]: DEBUG nova.network.neutron [req-769fdee8-d8db-4087-bcf1-7eb6f7c1b399 req-4a02a507-97a7-4787-8d3b-683845797c17 service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Updated VIF entry in instance network info cache for port b1c66b74-5403-4bfb-9826-7d95c1e92356. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:13:21 user nova-compute[73078]: DEBUG nova.network.neutron [req-769fdee8-d8db-4087-bcf1-7eb6f7c1b399 req-4a02a507-97a7-4787-8d3b-683845797c17 service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Updating instance_info_cache with network_info: [{"id": "b1c66b74-5403-4bfb-9826-7d95c1e92356", "address": "fa:16:3e:56:c1:dd", "network": {"id": "371d3de4-ece5-41b8-8adc-277ac218f7ee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1480740037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a49a3016859146b4b30ae80e5fae6e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c66b74-54", "ovs_interfaceid": "b1c66b74-5403-4bfb-9826-7d95c1e92356", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:13:21 user nova-compute[73078]: DEBUG nova.network.neutron [None req-326c8d7a-2a9b-45f8-84a9-8a6e7e2599dc tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:13:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-769fdee8-d8db-4087-bcf1-7eb6f7c1b399 req-4a02a507-97a7-4787-8d3b-683845797c17 service nova] Releasing lock "refresh_cache-ad1d1145-1a70-4a9c-b563-6bda437dc0cc" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:13:21 user nova-compute[73078]: DEBUG nova.policy [None req-326c8d7a-2a9b-45f8-84a9-8a6e7e2599dc tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '218142bc464f4083b053a755d818afca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49a3016859146b4b30ae80e5fae6e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:13:21 user nova-compute[73078]: DEBUG nova.network.neutron [req-a4117d97-2d94-49e6-8886-bfc01cddd330 req-614152de-66b1-42c3-acc7-97d34d58c164 service nova] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Updated VIF entry in instance network info cache for port 90186594-310a-4bfa-8593-6a6f54bb2b9b. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:13:21 user nova-compute[73078]: DEBUG nova.network.neutron [req-a4117d97-2d94-49e6-8886-bfc01cddd330 req-614152de-66b1-42c3-acc7-97d34d58c164 service nova] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Updating instance_info_cache with network_info: [{"id": "90186594-310a-4bfa-8593-6a6f54bb2b9b", "address": "fa:16:3e:2d:b8:f6", "network": {"id": "da640f78-a5e9-4ca4-9daa-cbe9f39866a7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1049608594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3db9e1b022b443dda66d26e1bf57e984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90186594-31", "ovs_interfaceid": "90186594-310a-4bfa-8593-6a6f54bb2b9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:13:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a4117d97-2d94-49e6-8886-bfc01cddd330 req-614152de-66b1-42c3-acc7-97d34d58c164 service nova] Releasing lock "refresh_cache-e8ad453e-67b1-4af2-b85b-a5e100c11446" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RuXedqwA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:13:22 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:13:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:13:22 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:13:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:13:22 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef6fa09-6796-4e1f-aca6-9bb38cf1f887]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:13:22 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[301acf54-2e81-4dc2-906b-ae9160a67a2a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641] added
Aug 14 18:13:22 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fd95b0-f4ca-4adc-9643-ddc9de85a0d5]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f581a8b-4722-4fed-984d-c6e2b5eb111c]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RuXedqwA {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RuXedqwA" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e824bb-e6db-404e-9949-413bd83c2c3c]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RuXedqwA'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.039s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[74372a70-b037-4963-87ba-f9e651a23408]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[463f5931-27b2-461e-96da-c169c9e8e691]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:13:22 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:13:22 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:13:22 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:13:22 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:13:22 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:13:22 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Acquiring lock "e8ad453e-67b1-4af2-b85b-a5e100c11446" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Lock "e8ad453e-67b1-4af2-b85b-a5e100c11446" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG nova.objects.instance [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Lazy-loading 'flavor' on Instance uuid e8ad453e-67b1-4af2-b85b-a5e100c11446 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG nova.network.neutron [None req-326c8d7a-2a9b-45f8-84a9-8a6e7e2599dc tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Successfully created port: 4c971778-a364-4f56-a33e-4cdc2c28cecb {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c45ba26-cf5f-47b8-9dc5-9fa64ca47467]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641, portal: 172.16.0.220,3260]
Aug 14 18:13:22 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641, portal: 172.16.0.220,3260] successful.
Aug 14 18:13:22 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Lock "e8ad453e-67b1-4af2-b85b-a5e100c11446" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8ca7c4-a2a4-4750-93ca-89879d403010]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6e7baa-3c8a-4939-9a08-f4f2fe710545]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:13:22 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:13:22 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:13:22 user nova-compute[73078]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 (non-flash)
Aug 14 18:13:22 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:13:22 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:13:22 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:13:22 user nova-compute[73078]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 (non-flash)
Aug 14 18:13:22 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] HCTL ('34', '-', '-', 0) found on session 6 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6f5c7e-62b8-4436-8af4-68e58d1f8319]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Searching for a device in session 6 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RuXedqwA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Acquiring lock "e8ad453e-67b1-4af2-b85b-a5e100c11446" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Lock "e8ad453e-67b1-4af2-b85b-a5e100c11446" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:22 user nova-compute[73078]: INFO nova.compute.manager [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Attaching volume 1f1e39c8-a854-4ecb-bdf4-e974597b7db7 to /dev/vdb
Aug 14 18:13:22 user nova-compute[73078]: DEBUG os_brick.utils [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[418c6333-d2fc-463c-b403-02b2690cff66]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba62aa8-9df8-4d90-8690-1ac8e1804382]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bf7513-7b63-4fe4-97d5-5871d10363f7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1566b09a-e73b-44dc-bdb0-313af4b9de35]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:13:22 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:13:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[382c0e7a-534e-4af7-beec-4b0d700d58e6]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG os_brick.utils [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:13:22 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Updating existing volume attachment record: 34100c14-1cf1-4a56-88e5-ef0f28348739 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:13:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:23 user nova-compute[73078]: DEBUG nova.network.neutron [None req-326c8d7a-2a9b-45f8-84a9-8a6e7e2599dc tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Successfully updated port: 4c971778-a364-4f56-a33e-4cdc2c28cecb {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:13:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-326c8d7a-2a9b-45f8-84a9-8a6e7e2599dc tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Acquiring lock "refresh_cache-ad1d1145-1a70-4a9c-b563-6bda437dc0cc" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:13:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-326c8d7a-2a9b-45f8-84a9-8a6e7e2599dc tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Acquired lock "refresh_cache-ad1d1145-1a70-4a9c-b563-6bda437dc0cc" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:13:23 user nova-compute[73078]: DEBUG nova.network.neutron [None req-326c8d7a-2a9b-45f8-84a9-8a6e7e2599dc tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:13:23 user nova-compute[73078]: DEBUG nova.compute.manager [req-e75cb498-a7a1-4086-a2b4-76ebb2c53701 req-a2a5c6c2-cd5e-4eb5-a7fd-deefb4761c5e service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Received event network-changed-4c971778-a364-4f56-a33e-4cdc2c28cecb {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:13:23 user nova-compute[73078]: DEBUG nova.compute.manager [req-e75cb498-a7a1-4086-a2b4-76ebb2c53701 req-a2a5c6c2-cd5e-4eb5-a7fd-deefb4761c5e service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Refreshing instance network info cache due to event network-changed-4c971778-a364-4f56-a33e-4cdc2c28cecb. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:13:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e75cb498-a7a1-4086-a2b4-76ebb2c53701 req-a2a5c6c2-cd5e-4eb5-a7fd-deefb4761c5e service nova] Acquiring lock "refresh_cache-ad1d1145-1a70-4a9c-b563-6bda437dc0cc" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:13:23 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:13:23 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23965663835323066', 'path': '/dev/sdc'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:13:23 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965663835323066', 'path': '/dev/sdc'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:13:23 user nova-compute[73078]: DEBUG nova.objects.instance [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Lazy-loading 'flavor' on Instance uuid 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:13:23 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 18:13:23 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:13:23 user nova-compute[73078]:   <source dev="/dev/sdc"/>
Aug 14 18:13:23 user nova-compute[73078]:   <target dev="sdc" bus="scsi"/>
Aug 14 18:13:23 user nova-compute[73078]:   <serial>4313835b-9f25-4127-a89f-0b3898c77641</serial>
Aug 14 18:13:23 user nova-compute[73078]:   <address type="drive" controller="0" unit="2"/>
Aug 14 18:13:23 user nova-compute[73078]: </disk>
Aug 14 18:13:23 user nova-compute[73078]:  {{(pid=73078) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 18:13:23 user nova-compute[73078]: DEBUG nova.network.neutron [None req-326c8d7a-2a9b-45f8-84a9-8a6e7e2599dc tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Updating instance_info_cache with network_info: [{"id": "b1c66b74-5403-4bfb-9826-7d95c1e92356", "address": "fa:16:3e:56:c1:dd", "network": {"id": "371d3de4-ece5-41b8-8adc-277ac218f7ee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1480740037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a49a3016859146b4b30ae80e5fae6e31", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c66b74-54", "ovs_interfaceid": "b1c66b74-5403-4bfb-9826-7d95c1e92356", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c971778-a364-4f56-a33e-4cdc2c28cecb", "address": "fa:16:3e:9a:79:fc", "network": {"id": "2f1f148b-226f-47ff-9de6-be8487c133c4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-486282127", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a49a3016859146b4b30ae80e5fae6e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c971778-a3", "ovs_interfaceid": "4c971778-a364-4f56-a33e-4cdc2c28cecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:13:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-326c8d7a-2a9b-45f8-84a9-8a6e7e2599dc tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Releasing lock "refresh_cache-ad1d1145-1a70-4a9c-b563-6bda437dc0cc" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:13:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e75cb498-a7a1-4086-a2b4-76ebb2c53701 req-a2a5c6c2-cd5e-4eb5-a7fd-deefb4761c5e service nova] Acquired lock "refresh_cache-ad1d1145-1a70-4a9c-b563-6bda437dc0cc" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:13:23 user nova-compute[73078]: DEBUG nova.network.neutron [req-e75cb498-a7a1-4086-a2b4-76ebb2c53701 req-a2a5c6c2-cd5e-4eb5-a7fd-deefb4761c5e service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Refreshing network info cache for port 4c971778-a364-4f56-a33e-4cdc2c28cecb {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:13:23 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-326c8d7a-2a9b-45f8-84a9-8a6e7e2599dc tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:11:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-954582950',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-954582950',id=10,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoZf8Rqz7EiN0P+Qjv1ph9KYV+Un7MKTbl1dwK14KSEc1xx5BX1LfWxWzRq6aPqPl/92nhScUmx3GJQuV5xlN5gzpJdNxWJ8eHGLQ/HA+DwQ8SXejqjnnPB+yC1+OGwhQ==',key_name='tempest-keypair-1334960197',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:11:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a49a3016859146b4b30ae80e5fae6e31',ramdisk_id='',reservation_id='r-cn5ox3sk',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1236088660',owner_user_name='tempest-TaggedAttachmentsTest-1236088660-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:11:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='218142bc464f4083b053a755d818afca',uuid=ad1d1145-1a70-4a9c-b563-6bda437dc0cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c971778-a364-4f56-a33e-4cdc2c28cecb", "address": "fa:16:3e:9a:79:fc", "network": {"id": "2f1f148b-226f-47ff-9de6-be8487c133c4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-486282127", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a49a3016859146b4b30ae80e5fae6e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c971778-a3", "ovs_interfaceid": "4c971778-a364-4f56-a33e-4cdc2c28cecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:13:23 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-326c8d7a-2a9b-45f8-84a9-8a6e7e2599dc tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Converting VIF {"id": "4c971778-a364-4f56-a33e-4cdc2c28cecb", "address": "fa:16:3e:9a:79:fc", "network": {"id": "2f1f148b-226f-47ff-9de6-be8487c133c4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-486282127", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a49a3016859146b4b30ae80e5fae6e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c971778-a3", "ovs_interfaceid": "4c971778-a364-4f56-a33e-4cdc2c28cecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:13:23 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-326c8d7a-2a9b-45f8-84a9-8a6e7e2599dc tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:79:fc,bridge_name='br-int',has_traffic_filtering=True,id=4c971778-a364-4f56-a33e-4cdc2c28cecb,network=Network(2f1f148b-226f-47ff-9de6-be8487c133c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c971778-a3') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:13:23 user nova-compute[73078]: DEBUG os_vif [None req-326c8d7a-2a9b-45f8-84a9-8a6e7e2599dc tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:79:fc,bridge_name='br-int',has_traffic_filtering=True,id=4c971778-a364-4f56-a33e-4cdc2c28cecb,network=Network(2f1f148b-226f-47ff-9de6-be8487c133c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c971778-a3') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:13:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:13:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:13:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c971778-a3, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:13:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4c971778-a3, col_values=(('external_ids', {'iface-id': '4c971778-a364-4f56-a33e-4cdc2c28cecb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:79:fc', 'vm-uuid': 'ad1d1145-1a70-4a9c-b563-6bda437dc0cc'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:13:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:13:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:23 user nova-compute[73078]: INFO os_vif [None req-326c8d7a-2a9b-45f8-84a9-8a6e7e2599dc tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:79:fc,bridge_name='br-int',has_traffic_filtering=True,id=4c971778-a364-4f56-a33e-4cdc2c28cecb,network=Network(2f1f148b-226f-47ff-9de6-be8487c133c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c971778-a3')
Aug 14 18:13:23 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-326c8d7a-2a9b-45f8-84a9-8a6e7e2599dc tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:11:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-954582950',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-954582950',id=10,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoZf8Rqz7EiN0P+Qjv1ph9KYV+Un7MKTbl1dwK14KSEc1xx5BX1LfWxWzRq6aPqPl/92nhScUmx3GJQuV5xlN5gzpJdNxWJ8eHGLQ/HA+DwQ8SXejqjnnPB+yC1+OGwhQ==',key_name='tempest-keypair-1334960197',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:11:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a49a3016859146b4b30ae80e5fae6e31',ramdisk_id='',reservation_id='r-cn5ox3sk',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1236088660',owner_user_name='tempest-TaggedAttachmentsTest-1236088660-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:11:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='218142bc464f4083b053a755d818afca',uuid=ad1d1145-1a70-4a9c-b563-6bda437dc0cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c971778-a364-4f56-a33e-4cdc2c28cecb", "address": "fa:16:3e:9a:79:fc", "network": {"id": "2f1f148b-226f-47ff-9de6-be8487c133c4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-486282127", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a49a3016859146b4b30ae80e5fae6e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c971778-a3", "ovs_interfaceid": "4c971778-a364-4f56-a33e-4cdc2c28cecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:13:23 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-326c8d7a-2a9b-45f8-84a9-8a6e7e2599dc tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Converting VIF {"id": "4c971778-a364-4f56-a33e-4cdc2c28cecb", "address": "fa:16:3e:9a:79:fc", "network": {"id": "2f1f148b-226f-47ff-9de6-be8487c133c4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-486282127", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a49a3016859146b4b30ae80e5fae6e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c971778-a3", "ovs_interfaceid": "4c971778-a364-4f56-a33e-4cdc2c28cecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:13:23 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-326c8d7a-2a9b-45f8-84a9-8a6e7e2599dc tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:79:fc,bridge_name='br-int',has_traffic_filtering=True,id=4c971778-a364-4f56-a33e-4cdc2c28cecb,network=Network(2f1f148b-226f-47ff-9de6-be8487c133c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c971778-a3') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:13:23 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-326c8d7a-2a9b-45f8-84a9-8a6e7e2599dc tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] attach device xml: <interface type="ethernet">
Aug 14 18:13:23 user nova-compute[73078]:   <mac address="fa:16:3e:9a:79:fc"/>
Aug 14 18:13:23 user nova-compute[73078]:   <model type="virtio"/>
Aug 14 18:13:23 user nova-compute[73078]:   <mtu size="1442"/>
Aug 14 18:13:23 user nova-compute[73078]:   <target dev="tap4c971778-a3"/>
Aug 14 18:13:23 user nova-compute[73078]: </interface>
Aug 14 18:13:23 user nova-compute[73078]:  {{(pid=73078) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] No BDM found with device name sda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] No BDM found with device name sdc, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] No VIF found with MAC fa:16:3e:e5:43:d0, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-326c8d7a-2a9b-45f8-84a9-8a6e7e2599dc tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-326c8d7a-2a9b-45f8-84a9-8a6e7e2599dc tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] No BDM found with device name hda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-326c8d7a-2a9b-45f8-84a9-8a6e7e2599dc tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] No VIF found with MAC fa:16:3e:56:c1:dd, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RDdkIpTt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:13:24 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:13:24 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:13:24 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:13:24 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:13:24 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-326c8d7a-2a9b-45f8-84a9-8a6e7e2599dc tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:13:24 user nova-compute[73078]:   <nova:package version="0.0.0"/>
Aug 14 18:13:24 user nova-compute[73078]:   <nova:name>tempest-device-tagging-server-954582950</nova:name>
Aug 14 18:13:24 user nova-compute[73078]:   <nova:creationTime>2023-08-14 18:13:24</nova:creationTime>
Aug 14 18:13:24 user nova-compute[73078]:   <nova:flavor name="m1.tiny">
Aug 14 18:13:24 user nova-compute[73078]:     <nova:memory>512</nova:memory>
Aug 14 18:13:24 user nova-compute[73078]:     <nova:disk>1</nova:disk>
Aug 14 18:13:24 user nova-compute[73078]:     <nova:swap>0</nova:swap>
Aug 14 18:13:24 user nova-compute[73078]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:13:24 user nova-compute[73078]:     <nova:vcpus>1</nova:vcpus>
Aug 14 18:13:24 user nova-compute[73078]:   </nova:flavor>
Aug 14 18:13:24 user nova-compute[73078]:   <nova:owner>
Aug 14 18:13:24 user nova-compute[73078]:     <nova:user uuid="218142bc464f4083b053a755d818afca">tempest-TaggedAttachmentsTest-1236088660-project-member</nova:user>
Aug 14 18:13:24 user nova-compute[73078]:     <nova:project uuid="a49a3016859146b4b30ae80e5fae6e31">tempest-TaggedAttachmentsTest-1236088660</nova:project>
Aug 14 18:13:24 user nova-compute[73078]:   </nova:owner>
Aug 14 18:13:24 user nova-compute[73078]:   <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:13:24 user nova-compute[73078]:   <nova:ports>
Aug 14 18:13:24 user nova-compute[73078]:     <nova:port uuid="b1c66b74-5403-4bfb-9826-7d95c1e92356">
Aug 14 18:13:24 user nova-compute[73078]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 18:13:24 user nova-compute[73078]:     </nova:port>
Aug 14 18:13:24 user nova-compute[73078]:     <nova:port uuid="4c971778-a364-4f56-a33e-4cdc2c28cecb">
Aug 14 18:13:24 user nova-compute[73078]:       <nova:ip type="fixed" address="10.10.10.36" ipVersion="4"/>
Aug 14 18:13:24 user nova-compute[73078]:     </nova:port>
Aug 14 18:13:24 user nova-compute[73078]:   </nova:ports>
Aug 14 18:13:24 user nova-compute[73078]: </nova:instance>
Aug 14 18:13:24 user nova-compute[73078]:  {{(pid=73078) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d63eb06-2833-4ffe-b393-79b4339781de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:13:24 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8efb50-1504-4514-8bab-07e72e0b8cdb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-326c8d7a-2a9b-45f8-84a9-8a6e7e2599dc tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lock "interface-ad1d1145-1a70-4a9c-b563-6bda437dc0cc-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.424s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632] added
Aug 14 18:13:24 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG nova.compute.manager [req-e5cc735f-cb7e-4e62-90c6-191dca237223 req-c35a6db1-6cb0-49ec-8c6e-d47090ceeb4d service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Received event network-vif-plugged-4c971778-a364-4f56-a33e-4cdc2c28cecb {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e5cc735f-cb7e-4e62-90c6-191dca237223 req-c35a6db1-6cb0-49ec-8c6e-d47090ceeb4d service nova] Acquiring lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e5cc735f-cb7e-4e62-90c6-191dca237223 req-c35a6db1-6cb0-49ec-8c6e-d47090ceeb4d service nova] Lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e5cc735f-cb7e-4e62-90c6-191dca237223 req-c35a6db1-6cb0-49ec-8c6e-d47090ceeb4d service nova] Lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG nova.compute.manager [req-e5cc735f-cb7e-4e62-90c6-191dca237223 req-c35a6db1-6cb0-49ec-8c6e-d47090ceeb4d service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] No waiting events found dispatching network-vif-plugged-4c971778-a364-4f56-a33e-4cdc2c28cecb {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:13:24 user nova-compute[73078]: WARNING nova.compute.manager [req-e5cc735f-cb7e-4e62-90c6-191dca237223 req-c35a6db1-6cb0-49ec-8c6e-d47090ceeb4d service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Received unexpected event network-vif-plugged-4c971778-a364-4f56-a33e-4cdc2c28cecb for instance with vm_state active and task_state None.
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c324a02-3fb6-4f45-b50d-f4ebac136757]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG nova.network.neutron [req-e75cb498-a7a1-4086-a2b4-76ebb2c53701 req-a2a5c6c2-cd5e-4eb5-a7fd-deefb4761c5e service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Updated VIF entry in instance network info cache for port 4c971778-a364-4f56-a33e-4cdc2c28cecb. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG nova.network.neutron [req-e75cb498-a7a1-4086-a2b4-76ebb2c53701 req-a2a5c6c2-cd5e-4eb5-a7fd-deefb4761c5e service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Updating instance_info_cache with network_info: [{"id": "b1c66b74-5403-4bfb-9826-7d95c1e92356", "address": "fa:16:3e:56:c1:dd", "network": {"id": "371d3de4-ece5-41b8-8adc-277ac218f7ee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1480740037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a49a3016859146b4b30ae80e5fae6e31", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c66b74-54", "ovs_interfaceid": "b1c66b74-5403-4bfb-9826-7d95c1e92356", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c971778-a364-4f56-a33e-4cdc2c28cecb", "address": "fa:16:3e:9a:79:fc", "network": {"id": "2f1f148b-226f-47ff-9de6-be8487c133c4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-486282127", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a49a3016859146b4b30ae80e5fae6e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c971778-a3", "ovs_interfaceid": "4c971778-a364-4f56-a33e-4cdc2c28cecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[172c5673-dc40-4d2a-b95e-a66e6a8c33ce]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RDdkIpTt {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e75cb498-a7a1-4086-a2b4-76ebb2c53701 req-a2a5c6c2-cd5e-4eb5-a7fd-deefb4761c5e service nova] Releasing lock "refresh_cache-ad1d1145-1a70-4a9c-b563-6bda437dc0cc" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RDdkIpTt" returned: 0 in 0.029s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8cfb32-4651-44e1-bd68-e8a50bbdcf08]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RDdkIpTt'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3de23f1-10b8-49e9-9418-33525203390c]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe27e8c-0f2d-4003-8c1a-80f2564e33b1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:13:24 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:13:24 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:13:24 user nova-compute[73078]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 (non-flash)
Aug 14 18:13:24 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:13:24 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:13:24 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:13:24 user nova-compute[73078]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 (non-flash)
Aug 14 18:13:24 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe796749-f990-45b2-911e-5fef590db8da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632, portal: 172.16.0.220,3260]
Aug 14 18:13:24 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632, portal: 172.16.0.220,3260] successful.
Aug 14 18:13:24 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-3549a318-0ffd-4e84-853d-ed26975ff00e tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.360s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcca2d36-3800-47b2-8c8e-a6451140f6fe]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8afeea-125c-4e48-8cc6-53ea5ec390c9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:13:24 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:13:24 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:13:24 user nova-compute[73078]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 (non-flash)
Aug 14 18:13:24 user nova-compute[73078]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632 (non-flash)
Aug 14 18:13:24 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:13:24 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:13:24 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:13:24 user nova-compute[73078]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 (non-flash)
Aug 14 18:13:24 user nova-compute[73078]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632 (non-flash)
Aug 14 18:13:24 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.394s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb44baa2-79fc-49a4-902f-66d68e3e3c72]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RDdkIpTt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:13:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Acquiring lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:25 user nova-compute[73078]: DEBUG nova.objects.instance [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lazy-loading 'flavor' on Instance uuid ad1d1145-1a70-4a9c-b563-6bda437dc0cc {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:13:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Acquiring lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:25 user nova-compute[73078]: INFO nova.compute.manager [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Attaching volume 763fe1b7-07ac-4eb5-9f46-b97158834021 to /dev/vdb
Aug 14 18:13:25 user nova-compute[73078]: DEBUG os_brick.utils [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:13:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd359e2-a932-4acc-bde9-c680c8e6a350]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dd0a3b-6ed1-4bef-9ccf-eb9a0505bc32]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3899e6-b63a-4f11-b27d-b4004591176f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c502c6f5-4173-41ad-9fea-653ff871ab79]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:13:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:13:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:13:25 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:13:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c340dfe-12a1-4d3d-879f-fc56941e441d]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:13:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:13:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:13:25 user nova-compute[73078]: DEBUG os_brick.utils [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:13:25 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Updating existing volume attachment record: 0b9b2329-9629-4221-b35d-a13e05faedec {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:13:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.440s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:13:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] <== connect_volume: return (1443ms) {'type': 'block', 'scsi_wwn': '26139346663336136', 'path': '/dev/sdf'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:13:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139346663336136', 'path': '/dev/sdf'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:13:25 user nova-compute[73078]: DEBUG nova.objects.instance [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lazy-loading 'flavor' on Instance uuid 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:13:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 18:13:25 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:13:25 user nova-compute[73078]:   <source dev="/dev/sdf"/>
Aug 14 18:13:25 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:13:25 user nova-compute[73078]:   <serial>47395855-b833-46c1-9841-ed81c1bee632</serial>
Aug 14 18:13:25 user nova-compute[73078]: </disk>
Aug 14 18:13:25 user nova-compute[73078]:  {{(pid=73078) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 18:13:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:13:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:13:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] No VIF found with MAC fa:16:3e:63:16:7b, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:13:26 user nova-compute[73078]: DEBUG nova.compute.manager [req-e3d8cfb9-02e0-4598-97a8-f1d234b4e98c req-0df34288-dbd9-410f-818d-89eb8f4f651d service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Received event network-vif-plugged-4c971778-a364-4f56-a33e-4cdc2c28cecb {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:13:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e3d8cfb9-02e0-4598-97a8-f1d234b4e98c req-0df34288-dbd9-410f-818d-89eb8f4f651d service nova] Acquiring lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e3d8cfb9-02e0-4598-97a8-f1d234b4e98c req-0df34288-dbd9-410f-818d-89eb8f4f651d service nova] Lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e3d8cfb9-02e0-4598-97a8-f1d234b4e98c req-0df34288-dbd9-410f-818d-89eb8f4f651d service nova] Lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:26 user nova-compute[73078]: DEBUG nova.compute.manager [req-e3d8cfb9-02e0-4598-97a8-f1d234b4e98c req-0df34288-dbd9-410f-818d-89eb8f4f651d service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] No waiting events found dispatching network-vif-plugged-4c971778-a364-4f56-a33e-4cdc2c28cecb {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:13:26 user nova-compute[73078]: WARNING nova.compute.manager [req-e3d8cfb9-02e0-4598-97a8-f1d234b4e98c req-0df34288-dbd9-410f-818d-89eb8f4f651d service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Received unexpected event network-vif-plugged-4c971778-a364-4f56-a33e-4cdc2c28cecb for instance with vm_state active and task_state None.
Aug 14 18:13:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:28 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:13:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XvguCpZj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:13:28 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:13:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:13:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:13:28 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:13:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:13:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:13:28 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:13:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:28 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a62ad4-2b07-4d17-b672-31eccf897c9c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:13:28 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:28 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99034aa-5c82-4039-a69f-a9be59cfcd2e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31] added
Aug 14 18:13:28 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:29 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:29 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d78bef-5763-4f88-8b09-c04439065fd6]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:29 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:29 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:29 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:29 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2145ce-2a7d-43b9-987d-45623118372d]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:29 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:29 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XvguCpZj {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:29 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XvguCpZj" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:29 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[29db5913-ffb4-4879-8079-8ea8a76127de]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:29 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XvguCpZj'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:29 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:29 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:29 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0472a3a-80e5-47ce-896e-50eec0e9871b]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:29 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:29 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:29 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:29 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[344a2b6f-387b-43fd-b8a1-fbeb6fd05353]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:29 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:13:29 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:13:29 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:13:29 user nova-compute[73078]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 (non-flash)
Aug 14 18:13:29 user nova-compute[73078]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632 (non-flash)
Aug 14 18:13:29 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:13:29 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:13:29 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:13:29 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:13:29 user nova-compute[73078]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 (non-flash)
Aug 14 18:13:29 user nova-compute[73078]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632 (non-flash)
Aug 14 18:13:29 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:13:29 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e500f8c1-c27f-42aa-87e1-19097fa06553 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "10f9d4a9-ee3f-45bd-95e4-edd4819dcf30" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.807s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9a5559fe-9bb7-4ede-9194-2e392f08665c tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Acquiring lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9a5559fe-9bb7-4ede-9194-2e392f08665c tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:29 user nova-compute[73078]: INFO nova.compute.manager [None req-9a5559fe-9bb7-4ede-9194-2e392f08665c tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Detaching volume 4313835b-9f25-4127-a89f-0b3898c77641
Aug 14 18:13:29 user nova-compute[73078]: INFO nova.virt.block_device [None req-9a5559fe-9bb7-4ede-9194-2e392f08665c tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Attempting to driver detach volume 4313835b-9f25-4127-a89f-0b3898c77641 from mountpoint /dev/sdc
Aug 14 18:13:29 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9a5559fe-9bb7-4ede-9194-2e392f08665c tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Attempting to detach device sdc from instance 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a from the persistent domain config. {{(pid=73078) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 18:13:29 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-9a5559fe-9bb7-4ede-9194-2e392f08665c tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:13:29 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:13:29 user nova-compute[73078]:   <source dev="/dev/sdc"/>
Aug 14 18:13:29 user nova-compute[73078]:   <target dev="sdc" bus="scsi"/>
Aug 14 18:13:29 user nova-compute[73078]:   <serial>4313835b-9f25-4127-a89f-0b3898c77641</serial>
Aug 14 18:13:29 user nova-compute[73078]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 14 18:13:29 user nova-compute[73078]: </disk>
Aug 14 18:13:29 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:13:29 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-9a5559fe-9bb7-4ede-9194-2e392f08665c tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Successfully detached device sdc from instance 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a from the persistent domain config.
Aug 14 18:13:29 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9a5559fe-9bb7-4ede-9194-2e392f08665c tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a from the live domain config. {{(pid=73078) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 18:13:29 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-9a5559fe-9bb7-4ede-9194-2e392f08665c tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:13:29 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:13:29 user nova-compute[73078]:   <source dev="/dev/sdc"/>
Aug 14 18:13:29 user nova-compute[73078]:   <target dev="sdc" bus="scsi"/>
Aug 14 18:13:29 user nova-compute[73078]:   <serial>4313835b-9f25-4127-a89f-0b3898c77641</serial>
Aug 14 18:13:29 user nova-compute[73078]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 14 18:13:29 user nova-compute[73078]: </disk>
Aug 14 18:13:29 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:13:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Received event <DeviceRemovedEvent: 1692036810.1628094, 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73078) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 18:13:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9a5559fe-9bb7-4ede-9194-2e392f08665c tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a {{(pid=73078) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 18:13:30 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-9a5559fe-9bb7-4ede-9194-2e392f08665c tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Successfully detached device sdc from instance 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a from the live domain config.
Aug 14 18:13:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a5559fe-9bb7-4ede-9194-2e392f08665c tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:13:30 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5559fe-9bb7-4ede-9194-2e392f08665c tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RuXedqwA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:13:30 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-9a5559fe-9bb7-4ede-9194-2e392f08665c tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:13:30 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-9a5559fe-9bb7-4ede-9194-2e392f08665c tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:13:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 -p 172.16.0.220:3260 --login" returned: 0 in 1.074s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:30 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa2a942-74a1-4020-948e-c3cf96c58454]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:30 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31, portal: 172.16.0.220,3260]
Aug 14 18:13:30 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31, portal: 172.16.0.220,3260] successful.
Aug 14 18:13:30 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:30 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea932a4b-a3e4-4645-867a-77cefff75889]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:30 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:30 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1715cbd-2b1a-4a09-bdd5-0cdb55f92522]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:30 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:13:30 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:13:30 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:13:30 user nova-compute[73078]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 (non-flash)
Aug 14 18:13:30 user nova-compute[73078]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632 (non-flash)
Aug 14 18:13:30 user nova-compute[73078]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 (non-flash)
Aug 14 18:13:30 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:13:30 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:13:30 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:13:30 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:13:30 user nova-compute[73078]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 (non-flash)
Aug 14 18:13:30 user nova-compute[73078]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632 (non-flash)
Aug 14 18:13:30 user nova-compute[73078]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 (non-flash)
Aug 14 18:13:30 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:13:30 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.323s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:13:30 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:13:30 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:13:30 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:13:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:30 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3438bb-1e2d-4db6-8acd-b0e993115ccf]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:30 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:13:30 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XvguCpZj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:13:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e144bc62-83a0-4450-8fa6-f73392f4cdeb tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Acquiring lock "10f9d4a9-ee3f-45bd-95e4-edd4819dcf30" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e144bc62-83a0-4450-8fa6-f73392f4cdeb tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "10f9d4a9-ee3f-45bd-95e4-edd4819dcf30" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:30 user nova-compute[73078]: INFO nova.compute.manager [None req-e144bc62-83a0-4450-8fa6-f73392f4cdeb tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Detaching volume 47395855-b833-46c1-9841-ed81c1bee632
Aug 14 18:13:30 user nova-compute[73078]: INFO nova.virt.block_device [None req-e144bc62-83a0-4450-8fa6-f73392f4cdeb tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Attempting to driver detach volume 47395855-b833-46c1-9841-ed81c1bee632 from mountpoint /dev/vdb
Aug 14 18:13:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-e144bc62-83a0-4450-8fa6-f73392f4cdeb tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Attempting to detach device vdb from instance 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30 from the persistent domain config. {{(pid=73078) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 18:13:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-e144bc62-83a0-4450-8fa6-f73392f4cdeb tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:13:30 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:13:30 user nova-compute[73078]:   <source dev="/dev/sdf"/>
Aug 14 18:13:30 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:13:30 user nova-compute[73078]:   <serial>47395855-b833-46c1-9841-ed81c1bee632</serial>
Aug 14 18:13:30 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:13:30 user nova-compute[73078]: </disk>
Aug 14 18:13:30 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:13:30 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-e144bc62-83a0-4450-8fa6-f73392f4cdeb tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Successfully detached device vdb from instance 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30 from the persistent domain config.
Aug 14 18:13:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-e144bc62-83a0-4450-8fa6-f73392f4cdeb tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30 from the live domain config. {{(pid=73078) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 18:13:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-e144bc62-83a0-4450-8fa6-f73392f4cdeb tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:13:30 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:13:30 user nova-compute[73078]:   <source dev="/dev/sdf"/>
Aug 14 18:13:30 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:13:30 user nova-compute[73078]:   <serial>47395855-b833-46c1-9841-ed81c1bee632</serial>
Aug 14 18:13:30 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:13:30 user nova-compute[73078]: </disk>
Aug 14 18:13:30 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.356s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] <== connect_volume: return (2357ms) {'type': 'block', 'scsi_wwn': '23862346233623861', 'path': '/dev/sdg'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862346233623861', 'path': '/dev/sdg'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-9a5559fe-9bb7-4ede-9194-2e392f08665c tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.110s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5559fe-9bb7-4ede-9194-2e392f08665c tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG nova.objects.instance [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Lazy-loading 'flavor' on Instance uuid b97b330e-7a72-4d3c-8810-98a4f3a27ce7 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bbeeff-b13c-47e1-8727-3722dd2b3a2f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[820ff92d-ce1e-4b08-aca1-e01b0e855f86]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5559fe-9bb7-4ede-9194-2e392f08665c tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:13:31 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:13:31 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:13:31 user nova-compute[73078]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 (non-flash)
Aug 14 18:13:31 user nova-compute[73078]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632 (non-flash)
Aug 14 18:13:31 user nova-compute[73078]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 (non-flash)
Aug 14 18:13:31 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5559fe-9bb7-4ede-9194-2e392f08665c tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:13:31 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:13:31 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:13:31 user nova-compute[73078]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 (non-flash)
Aug 14 18:13:31 user nova-compute[73078]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632 (non-flash)
Aug 14 18:13:31 user nova-compute[73078]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 (non-flash)
Aug 14 18:13:31 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5559fe-9bb7-4ede-9194-2e392f08665c tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9882c2170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641'): ({'sdc'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-9a5559fe-9bb7-4ede-9194-2e392f08665c tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Removing single pathed devices sdc {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] attach device xml: <disk type="block" device="disk">
Aug 14 18:13:31 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:13:31 user nova-compute[73078]:   <source dev="/dev/sdg"/>
Aug 14 18:13:31 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:13:31 user nova-compute[73078]:   <serial>bec46c8b-3b81-4076-b0e0-539d3564ac31</serial>
Aug 14 18:13:31 user nova-compute[73078]: </disk>
Aug 14 18:13:31 user nova-compute[73078]:  {{(pid=73078) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7df0765-eddf-4adc-8a8f-26f5f029bd2d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c1209f-75c9-4203-850f-38d02aa6cd92]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-9a5559fe-9bb7-4ede-9194-2e392f08665c tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Flushing IO for device /dev/sdc {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d496c5-a7ee-429f-8ad9-ca4753986709]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-9a5559fe-9bb7-4ede-9194-2e392f08665c tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Received event <DeviceRemovedEvent: 1692036811.4299507, 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73078) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-e144bc62-83a0-4450-8fa6-f73392f4cdeb tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30 {{(pid=73078) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 18:13:31 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-e144bc62-83a0-4450-8fa6-f73392f4cdeb tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Successfully detached device vdb from instance 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30 from the live domain config.
Aug 14 18:13:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e144bc62-83a0-4450-8fa6-f73392f4cdeb tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-e144bc62-83a0-4450-8fa6-f73392f4cdeb tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RDdkIpTt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:13:31 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-e144bc62-83a0-4450-8fa6-f73392f4cdeb tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:13:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-e144bc62-83a0-4450-8fa6-f73392f4cdeb tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2c281f-cea3-438d-a4c7-ea282ab00cf0]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-9a5559fe-9bb7-4ede-9194-2e392f08665c tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-9a5559fe-9bb7-4ede-9194-2e392f08665c tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] SCSI volumes sdc have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5559fe-9bb7-4ede-9194-2e392f08665c tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[69421bc7-711a-4554-b049-fb4210a20789]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5559fe-9bb7-4ede-9194-2e392f08665c tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[40738309-162c-4fb9-9664-835947b31d9d]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5559fe-9bb7-4ede-9194-2e392f08665c tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641, portal: 172.16.0.220,3260]
Aug 14 18:13:31 user nova-compute[73078]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641, portal: 172.16.0.220,3260] successful.
Aug 14 18:13:31 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4313835b-9f25-4127-a89f-0b3898c77641 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70f58d0-4d55-4ef5-a243-813027e6a6fa]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5559fe-9bb7-4ede-9194-2e392f08665c tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-9a5559fe-9bb7-4ede-9194-2e392f08665c tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5559fe-9bb7-4ede-9194-2e392f08665c tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] <== disconnect_volume: return (1414ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a5559fe-9bb7-4ede-9194-2e392f08665c tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-e144bc62-83a0-4450-8fa6-f73392f4cdeb tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.146s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-e144bc62-83a0-4450-8fa6-f73392f4cdeb tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d90c80-23ac-4074-a9f2-2969f0bc8d42]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5054d8be-0123-40dd-b70a-7ea26e26bab7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-e144bc62-83a0-4450-8fa6-f73392f4cdeb tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:13:31 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:13:31 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:13:31 user nova-compute[73078]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632 (non-flash)
Aug 14 18:13:31 user nova-compute[73078]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 (non-flash)
Aug 14 18:13:31 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-e144bc62-83a0-4450-8fa6-f73392f4cdeb tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:13:31 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:13:31 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:13:31 user nova-compute[73078]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632 (non-flash)
Aug 14 18:13:31 user nova-compute[73078]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 (non-flash)
Aug 14 18:13:31 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-e144bc62-83a0-4450-8fa6-f73392f4cdeb tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9881a0790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632'): ({'sdf'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-e144bc62-83a0-4450-8fa6-f73392f4cdeb tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Removing single pathed devices sdf {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[25865ae3-5845-4952-8c9b-ae7f38c5f590]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d3ab5c-fc61-4f59-a6a1-6d125ce78796]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-e144bc62-83a0-4450-8fa6-f73392f4cdeb tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Flushing IO for device /dev/sdf {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[872112e9-4463-4a5b-a5fb-2ce2c6b817e7]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-e144bc62-83a0-4450-8fa6-f73392f4cdeb tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[06eeccb0-0362-42d5-847a-9b14baacdc2a]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-e144bc62-83a0-4450-8fa6-f73392f4cdeb tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-e144bc62-83a0-4450-8fa6-f73392f4cdeb tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] SCSI volumes sdf have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-e144bc62-83a0-4450-8fa6-f73392f4cdeb tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[20673977-b900-4e66-9557-48af1fd9b540]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-e144bc62-83a0-4450-8fa6-f73392f4cdeb tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] No VIF found with MAC fa:16:3e:5b:79:d0, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb320454-c342-49ed-a4ea-d52d03dc50eb]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-e144bc62-83a0-4450-8fa6-f73392f4cdeb tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632, portal: 172.16.0.220,3260]
Aug 14 18:13:31 user nova-compute[73078]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632, portal: 172.16.0.220,3260] successful.
Aug 14 18:13:31 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47395855-b833-46c1-9841-ed81c1bee632 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8589e37-d421-4189-90ac-fa8651e534b9]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-e144bc62-83a0-4450-8fa6-f73392f4cdeb tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-e144bc62-83a0-4450-8fa6-f73392f4cdeb tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-e144bc62-83a0-4450-8fa6-f73392f4cdeb tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] <== disconnect_volume: return (453ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:13:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e144bc62-83a0-4450-8fa6-f73392f4cdeb tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG nova.objects.instance [None req-9a5559fe-9bb7-4ede-9194-2e392f08665c tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Lazy-loading 'flavor' on Instance uuid 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9a5559fe-9bb7-4ede-9194-2e392f08665c tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.818s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f50a79eb-9622-4094-8266-c6ba3215adf6 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Lock "b97b330e-7a72-4d3c-8810-98a4f3a27ce7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.457s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvGxCsnN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:13:32 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:13:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:13:32 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:13:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:13:32 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:13:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcb5ddf-e6b6-49f0-a337-f6249b22af25]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:13:32 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[17797190-16ce-4fa3-8189-66d2943312b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7] added
Aug 14 18:13:32 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4a0699-f1f3-401f-9dd8-4693b18977e3]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d516c6b7-ab48-4d01-8c03-5d9232e5ec09]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qvGxCsnN {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qvGxCsnN" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57ad81c-8b24-4b44-b79f-c3a78e819971]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qvGxCsnN'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abf7cff-89a2-4109-9dcd-f2337d49553a]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[88864102-f11f-48af-b110-897a9d630c1b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:13:32 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:13:32 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:13:32 user nova-compute[73078]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 (non-flash)
Aug 14 18:13:32 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:13:32 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:13:32 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:13:32 user nova-compute[73078]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 (non-flash)
Aug 14 18:13:32 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9092f576-a18c-44f7-91e3-6a1188557fe0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7, portal: 172.16.0.220,3260]
Aug 14 18:13:32 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7, portal: 172.16.0.220,3260] successful.
Aug 14 18:13:32 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d51e27a-2300-47c5-8995-ded56aee02db]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff19df7-05bd-43b8-be1f-c018842f75a5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:13:33 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:13:33 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:13:33 user nova-compute[73078]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 (non-flash)
Aug 14 18:13:33 user nova-compute[73078]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 (non-flash)
Aug 14 18:13:33 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:13:33 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:13:33 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:13:33 user nova-compute[73078]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 (non-flash)
Aug 14 18:13:33 user nova-compute[73078]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 (non-flash)
Aug 14 18:13:33 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] HCTL ('34', '-', '-', 0) found on session 9 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[14293312-856b-4bb5-87f1-7f5e578765d3]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Searching for a device in session 9 and hctl ['34', '*', '*', 0] yield: None {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-6151362b-93d4-4a33-b80a-6826ffcc049f tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] volume_snapshot_create: create_info: {'snapshot_id': 'c187ed72-a553-4c26-a67f-d350bbf4960c', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=73078) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-6151362b-93d4-4a33-b80a-6826ffcc049f tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] snap xml: <domainsnapshot>
Aug 14 18:13:33 user nova-compute[73078]:   <disks>
Aug 14 18:13:33 user nova-compute[73078]:     <disk name="/dev/sdg" snapshot="external" type="file">
Aug 14 18:13:33 user nova-compute[73078]:       <source file="/dev/new_file"/>
Aug 14 18:13:33 user nova-compute[73078]:     </disk>
Aug 14 18:13:33 user nova-compute[73078]:     <disk name="vda" snapshot="no"/>
Aug 14 18:13:33 user nova-compute[73078]:   </disks>
Aug 14 18:13:33 user nova-compute[73078]: </domainsnapshot>
Aug 14 18:13:33 user nova-compute[73078]:  {{(pid=73078) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG nova.objects.instance [None req-6151362b-93d4-4a33-b80a-6826ffcc049f tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Lazy-loading 'system_metadata' on Instance uuid b97b330e-7a72-4d3c-8810-98a4f3a27ce7 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:13:33 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-6151362b-93d4-4a33-b80a-6826ffcc049f tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 18:13:33 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-1956ddd9-022a-4b9f-91ce-740e88e6f848 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] volume_snapshot_delete: delete_info: {'volume_id': 'bec46c8b-3b81-4076-b0e0-539d3564ac31'} {{(pid=73078) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [None req-1956ddd9-022a-4b9f-91ce-740e88e6f848 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Traceback (most recent call last):
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]     if delete_info['type'] != 'qcow2':
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] KeyError: 'type'
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] 
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [None req-6151362b-93d4-4a33-b80a-6826ffcc049f tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Traceback (most recent call last):
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]     rv = execute(f, *args, **kwargs)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]     six.reraise(c, e, tb)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]     raise value
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]     rv = meth(*args, **kwargs)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] 
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [None req-6151362b-93d4-4a33-b80a-6826ffcc049f tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Traceback (most recent call last):
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]     self._volume_snapshot_create(context, instance, guest,
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]     rv = execute(f, *args, **kwargs)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]     six.reraise(c, e, tb)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]     raise value
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]     rv = meth(*args, **kwargs)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] 
Aug 14 18:13:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-de4ab11c-bd55-4682-af6a-0c1639ba7afa tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Acquiring lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-de4ab11c-bd55-4682-af6a-0c1639ba7afa tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-de4ab11c-bd55-4682-af6a-0c1639ba7afa tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Acquiring lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-de4ab11c-bd55-4682-af6a-0c1639ba7afa tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-de4ab11c-bd55-4682-af6a-0c1639ba7afa tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:33 user nova-compute[73078]: INFO nova.compute.manager [None req-de4ab11c-bd55-4682-af6a-0c1639ba7afa tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Terminating instance
Aug 14 18:13:33 user nova-compute[73078]: DEBUG nova.compute.manager [None req-de4ab11c-bd55-4682-af6a-0c1639ba7afa tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [None req-1956ddd9-022a-4b9f-91ce-740e88e6f848 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver 
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver 
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-7d01de2e-099e-42a8-a076-1f5cfa0a2c70)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver 
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver 
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver 
Aug 14 18:13:33 user nova-compute[73078]: DEBUG nova.objects.instance [None req-e144bc62-83a0-4450-8fa6-f73392f4cdeb tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lazy-loading 'flavor' on Instance uuid 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver [None req-6151362b-93d4-4a33-b80a-6826ffcc049f tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot c187ed72-a553-4c26-a67f-d350bbf4960c could not be found.
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     raise value
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver 
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver 
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot c187ed72-a553-4c26-a67f-d350bbf4960c could not be found. (HTTP 404) (Request-ID: req-7ab30efe-b44c-4e3c-b283-867dcbd98682)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver 
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver 
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot c187ed72-a553-4c26-a67f-d350bbf4960c could not be found.
Aug 14 18:13:33 user nova-compute[73078]: ERROR nova.virt.libvirt.driver 
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server [None req-1956ddd9-022a-4b9f-91ce-740e88e6f848 tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Exception during message handling: KeyError: 'type'
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server 
Aug 14 18:13:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server [None req-6151362b-93d4-4a33-b80a-6826ffcc049f tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server     raise value
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 18:13:33 user nova-compute[73078]: ERROR oslo_messaging.rpc.server 
Aug 14 18:13:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e144bc62-83a0-4450-8fa6-f73392f4cdeb tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "10f9d4a9-ee3f-45bd-95e4-edd4819dcf30" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.524s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-128041b5-0a5c-450b-8c26-9baeed39041c tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Acquiring lock "b97b330e-7a72-4d3c-8810-98a4f3a27ce7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-128041b5-0a5c-450b-8c26-9baeed39041c tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Lock "b97b330e-7a72-4d3c-8810-98a4f3a27ce7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:33 user nova-compute[73078]: INFO nova.compute.manager [None req-128041b5-0a5c-450b-8c26-9baeed39041c tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Detaching volume bec46c8b-3b81-4076-b0e0-539d3564ac31
Aug 14 18:13:33 user nova-compute[73078]: DEBUG nova.compute.manager [req-ac13df2a-7f2f-4116-9c7a-ea4a0997678b req-e8914ac5-4d2e-4b02-9658-d91a201dc59a service nova] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Received event network-vif-unplugged-733825c5-0713-4980-9e5d-4a1120fb1598 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ac13df2a-7f2f-4116-9c7a-ea4a0997678b req-e8914ac5-4d2e-4b02-9658-d91a201dc59a service nova] Acquiring lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ac13df2a-7f2f-4116-9c7a-ea4a0997678b req-e8914ac5-4d2e-4b02-9658-d91a201dc59a service nova] Lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ac13df2a-7f2f-4116-9c7a-ea4a0997678b req-e8914ac5-4d2e-4b02-9658-d91a201dc59a service nova] Lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG nova.compute.manager [req-ac13df2a-7f2f-4116-9c7a-ea4a0997678b req-e8914ac5-4d2e-4b02-9658-d91a201dc59a service nova] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] No waiting events found dispatching network-vif-unplugged-733825c5-0713-4980-9e5d-4a1120fb1598 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG nova.compute.manager [req-ac13df2a-7f2f-4116-9c7a-ea4a0997678b req-e8914ac5-4d2e-4b02-9658-d91a201dc59a service nova] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Received event network-vif-unplugged-733825c5-0713-4980-9e5d-4a1120fb1598 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:13:33 user nova-compute[73078]: INFO nova.virt.block_device [None req-128041b5-0a5c-450b-8c26-9baeed39041c tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Attempting to driver detach volume bec46c8b-3b81-4076-b0e0-539d3564ac31 from mountpoint /dev/vdb
Aug 14 18:13:33 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-128041b5-0a5c-450b-8c26-9baeed39041c tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Attempting to detach device vdb from instance b97b330e-7a72-4d3c-8810-98a4f3a27ce7 from the persistent domain config. {{(pid=73078) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-128041b5-0a5c-450b-8c26-9baeed39041c tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] detach device xml: <disk type="block" device="disk">
Aug 14 18:13:33 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:13:33 user nova-compute[73078]:   <source dev="/dev/sdg"/>
Aug 14 18:13:33 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:13:33 user nova-compute[73078]:   <serial>bec46c8b-3b81-4076-b0e0-539d3564ac31</serial>
Aug 14 18:13:33 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:13:33 user nova-compute[73078]: </disk>
Aug 14 18:13:33 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:13:33 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-128041b5-0a5c-450b-8c26-9baeed39041c tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Successfully detached device vdb from instance b97b330e-7a72-4d3c-8810-98a4f3a27ce7 from the persistent domain config.
Aug 14 18:13:33 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-128041b5-0a5c-450b-8c26-9baeed39041c tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b97b330e-7a72-4d3c-8810-98a4f3a27ce7 from the live domain config. {{(pid=73078) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-128041b5-0a5c-450b-8c26-9baeed39041c tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] detach device xml: <disk type="block" device="disk">
Aug 14 18:13:33 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:13:33 user nova-compute[73078]:   <source dev="/dev/sdg"/>
Aug 14 18:13:33 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:13:33 user nova-compute[73078]:   <serial>bec46c8b-3b81-4076-b0e0-539d3564ac31</serial>
Aug 14 18:13:33 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:13:33 user nova-compute[73078]: </disk>
Aug 14 18:13:33 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Searching for a device in session 9 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvGxCsnN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23333616339643031', 'path': '/dev/sdc'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333616339643031', 'path': '/dev/sdc'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG nova.objects.instance [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Lazy-loading 'flavor' on Instance uuid e8ad453e-67b1-4af2-b85b-a5e100c11446 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 18:13:34 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:13:34 user nova-compute[73078]:   <source dev="/dev/sdc"/>
Aug 14 18:13:34 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:13:34 user nova-compute[73078]:   <serial>1f1e39c8-a854-4ecb-bdf4-e974597b7db7</serial>
Aug 14 18:13:34 user nova-compute[73078]: </disk>
Aug 14 18:13:34 user nova-compute[73078]:  {{(pid=73078) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Received event <DeviceRemovedEvent: 1692036814.3034313, b97b330e-7a72-4d3c-8810-98a4f3a27ce7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73078) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-128041b5-0a5c-450b-8c26-9baeed39041c tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b97b330e-7a72-4d3c-8810-98a4f3a27ce7 {{(pid=73078) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 18:13:34 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-128041b5-0a5c-450b-8c26-9baeed39041c tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Successfully detached device vdb from instance b97b330e-7a72-4d3c-8810-98a4f3a27ce7 from the live domain config.
Aug 14 18:13:34 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-128041b5-0a5c-450b-8c26-9baeed39041c tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-128041b5-0a5c-450b-8c26-9baeed39041c tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XvguCpZj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:13:34 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-128041b5-0a5c-450b-8c26-9baeed39041c tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:13:34 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-128041b5-0a5c-450b-8c26-9baeed39041c tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-128041b5-0a5c-450b-8c26-9baeed39041c tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-128041b5-0a5c-450b-8c26-9baeed39041c tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ec8bd2-6993-4eb8-9285-d28cf180ee7f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a5b130-819c-4b97-8783-f14d66c45fca]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-128041b5-0a5c-450b-8c26-9baeed39041c tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:13:34 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:13:34 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:13:34 user nova-compute[73078]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 (non-flash)
Aug 14 18:13:34 user nova-compute[73078]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 (non-flash)
Aug 14 18:13:34 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-128041b5-0a5c-450b-8c26-9baeed39041c tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:13:34 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:13:34 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:13:34 user nova-compute[73078]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 (non-flash)
Aug 14 18:13:34 user nova-compute[73078]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 (non-flash)
Aug 14 18:13:34 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-128041b5-0a5c-450b-8c26-9baeed39041c tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe97825b010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31'): ({'sdg'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-128041b5-0a5c-450b-8c26-9baeed39041c tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Removing single pathed devices sdg {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1630fc3-a59e-438d-93dd-7626004ddc33]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[307c1e11-8fe0-4a5c-a36f-30289bb26c4e]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-128041b5-0a5c-450b-8c26-9baeed39041c tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Flushing IO for device /dev/sdg {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92346c5-9a9d-4a6d-bfbc-2ae9c323c4e7]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-128041b5-0a5c-450b-8c26-9baeed39041c tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.046s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e306f0cf-0770-4d66-ad97-9a005459659f]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-128041b5-0a5c-450b-8c26-9baeed39041c tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-128041b5-0a5c-450b-8c26-9baeed39041c tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] SCSI volumes sdg have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-128041b5-0a5c-450b-8c26-9baeed39041c tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36cd06f-9151-4668-a0e7-15816d6f89dd]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-128041b5-0a5c-450b-8c26-9baeed39041c tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7ff4de-aba2-45ed-9fd6-fdf8d144ad45]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-128041b5-0a5c-450b-8c26-9baeed39041c tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31, portal: 172.16.0.220,3260]
Aug 14 18:13:34 user nova-compute[73078]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31, portal: 172.16.0.220,3260] successful.
Aug 14 18:13:34 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bec46c8b-3b81-4076-b0e0-539d3564ac31 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfbd032-a9c0-4988-a2ce-81005432a357]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-128041b5-0a5c-450b-8c26-9baeed39041c tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-128041b5-0a5c-450b-8c26-9baeed39041c tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-128041b5-0a5c-450b-8c26-9baeed39041c tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] <== disconnect_volume: return (314ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-128041b5-0a5c-450b-8c26-9baeed39041c tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:34 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Instance destroyed successfully.
Aug 14 18:13:34 user nova-compute[73078]: DEBUG nova.objects.instance [None req-de4ab11c-bd55-4682-af6a-0c1639ba7afa tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Lazy-loading 'resources' on Instance uuid 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-de4ab11c-bd55-4682-af6a-0c1639ba7afa tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:11:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2062379060',display_name='tempest-AttachSCSIVolumeTestJSON-server-2062379060',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2062379060',id=7,image_ref='7df27413-ba0c-438f-9f0b-994325e5ab25',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5begJ0RpTUBw/BhoW7yA3Hl8+N5qtFQsI21CQInuxm9BUSoyfj7Y3GNhE37GUGawAca3iEnAVf6ncr6AJRwd6+6hticeA8Pa/igPXCOkR2HipnVX44Ub+Jy7QfRbAhUg==',key_name='tempest-keypair-1308980545',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:11:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ff3894cf6eba466da26bad6c3bd978f7',ramdisk_id='',reservation_id='r-gsq12z9z',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7df27413-ba0c-438f-9f0b-994325e5ab25',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1163083945',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1163083945-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:11:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1cc41673ab284557a5f88bc6487a2ad2',uuid=0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "733825c5-0713-4980-9e5d-4a1120fb1598", "address": "fa:16:3e:e5:43:d0", "network": {"id": "3f423cdf-1eb1-4a1b-acf0-37ef2a8dfdca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1815766145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff3894cf6eba466da26bad6c3bd978f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap733825c5-07", "ovs_interfaceid": "733825c5-0713-4980-9e5d-4a1120fb1598", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-de4ab11c-bd55-4682-af6a-0c1639ba7afa tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Converting VIF {"id": "733825c5-0713-4980-9e5d-4a1120fb1598", "address": "fa:16:3e:e5:43:d0", "network": {"id": "3f423cdf-1eb1-4a1b-acf0-37ef2a8dfdca", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1815766145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff3894cf6eba466da26bad6c3bd978f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap733825c5-07", "ovs_interfaceid": "733825c5-0713-4980-9e5d-4a1120fb1598", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-de4ab11c-bd55-4682-af6a-0c1639ba7afa tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:43:d0,bridge_name='br-int',has_traffic_filtering=True,id=733825c5-0713-4980-9e5d-4a1120fb1598,network=Network(3f423cdf-1eb1-4a1b-acf0-37ef2a8dfdca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap733825c5-07') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG os_vif [None req-de4ab11c-bd55-4682-af6a-0c1639ba7afa tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:43:d0,bridge_name='br-int',has_traffic_filtering=True,id=733825c5-0713-4980-9e5d-4a1120fb1598,network=Network(3f423cdf-1eb1-4a1b-acf0-37ef2a8dfdca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap733825c5-07') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap733825c5-07, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:13:34 user nova-compute[73078]: INFO os_vif [None req-de4ab11c-bd55-4682-af6a-0c1639ba7afa tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:43:d0,bridge_name='br-int',has_traffic_filtering=True,id=733825c5-0713-4980-9e5d-4a1120fb1598,network=Network(3f423cdf-1eb1-4a1b-acf0-37ef2a8dfdca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap733825c5-07')
Aug 14 18:13:34 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-de4ab11c-bd55-4682-af6a-0c1639ba7afa tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Deleting instance files /opt/stack/data/nova/instances/0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a_del
Aug 14 18:13:34 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-de4ab11c-bd55-4682-af6a-0c1639ba7afa tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Deletion of /opt/stack/data/nova/instances/0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a_del complete
Aug 14 18:13:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] No VIF found with MAC fa:16:3e:2d:b8:f6, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:34 user nova-compute[73078]: INFO nova.compute.manager [None req-de4ab11c-bd55-4682-af6a-0c1639ba7afa tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Took 1.58 seconds to destroy the instance on the hypervisor.
Aug 14 18:13:34 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-de4ab11c-bd55-4682-af6a-0c1639ba7afa tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:13:34 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-47d0092c-b295-4fcd-bad0-5d3b98a0a450 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Lock "e8ad453e-67b1-4af2-b85b-a5e100c11446" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.504s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ywWndEOV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:13:35 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:13:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:13:35 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:13:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:13:35 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e30810-7d90-43c9-a076-0f3d22338a00]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:13:35 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3946d6-d3de-4f5a-b0c0-9248f39823fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021] added
Aug 14 18:13:35 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a2992a-b3cb-4c27-b249-6dcef6936456]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbbe1e6-9c8f-4553-96f3-08eefc1cdbfb]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ywWndEOV {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ywWndEOV" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f95ed32-5321-42cf-8072-bd3ce506ae14]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ywWndEOV'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71f7650-d001-40c9-a97f-139741644cb3]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2761604e-1840-4345-a63b-490854d613a8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:13:35 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:13:35 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:13:35 user nova-compute[73078]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 (non-flash)
Aug 14 18:13:35 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:13:35 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:13:35 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:13:35 user nova-compute[73078]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 (non-flash)
Aug 14 18:13:35 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG nova.objects.instance [None req-128041b5-0a5c-450b-8c26-9baeed39041c tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Lazy-loading 'flavor' on Instance uuid b97b330e-7a72-4d3c-8810-98a4f3a27ce7 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c14268-8150-4cfd-8da0-95810ac89c0b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021, portal: 172.16.0.220,3260]
Aug 14 18:13:35 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021, portal: 172.16.0.220,3260] successful.
Aug 14 18:13:35 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[73df3b38-65d5-42f7-a927-694f365c774f]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-128041b5-0a5c-450b-8c26-9baeed39041c tempest-VolumesAssistedSnapshotsTest-1520522767 tempest-VolumesAssistedSnapshotsTest-1520522767-project-admin] Lock "b97b330e-7a72-4d3c-8810-98a4f3a27ce7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.961s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0ae9ca-2f2d-4d5e-8f32-19f3a8833125]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021 (non-flash)
Aug 14 18:13:35 user nova-compute[73078]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:13:35 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:13:35 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:13:35 user nova-compute[73078]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 (non-flash)
Aug 14 18:13:35 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021 (non-flash)
Aug 14 18:13:35 user nova-compute[73078]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:13:35 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:13:35 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:13:35 user nova-compute[73078]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 (non-flash)
Aug 14 18:13:35 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] HCTL ('37', '-', '-', 0) found on session 10 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d04493-2f13-4eab-b4e8-649400939e85]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Searching for a device in session 10 and hctl ['37', '*', '*', 0] yield: None {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Acquiring lock "e8ad453e-67b1-4af2-b85b-a5e100c11446" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Lock "e8ad453e-67b1-4af2-b85b-a5e100c11446" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG os_brick.utils [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1397c0e6-86fe-4aac-b338-cc362791bcf7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[542a5c00-c8c7-4be9-823c-838334101dd0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9904994b-9abe-45ad-a62e-41442e35cf41]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fe61d0-0679-45a3-9728-a9c04fae55f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG nova.compute.manager [req-6b5a1774-950c-4720-b9ea-2273b0481a76 req-fd387a94-bc8a-45b6-a37e-711f0fbd2222 service nova] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Received event network-vif-plugged-733825c5-0713-4980-9e5d-4a1120fb1598 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6b5a1774-950c-4720-b9ea-2273b0481a76 req-fd387a94-bc8a-45b6-a37e-711f0fbd2222 service nova] Acquiring lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6b5a1774-950c-4720-b9ea-2273b0481a76 req-fd387a94-bc8a-45b6-a37e-711f0fbd2222 service nova] Lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6b5a1774-950c-4720-b9ea-2273b0481a76 req-fd387a94-bc8a-45b6-a37e-711f0fbd2222 service nova] Lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG nova.compute.manager [req-6b5a1774-950c-4720-b9ea-2273b0481a76 req-fd387a94-bc8a-45b6-a37e-711f0fbd2222 service nova] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] No waiting events found dispatching network-vif-plugged-733825c5-0713-4980-9e5d-4a1120fb1598 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:13:35 user nova-compute[73078]: WARNING nova.compute.manager [req-6b5a1774-950c-4720-b9ea-2273b0481a76 req-fd387a94-bc8a-45b6-a37e-711f0fbd2222 service nova] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Received unexpected event network-vif-plugged-733825c5-0713-4980-9e5d-4a1120fb1598 for instance with vm_state active and task_state deleting.
Aug 14 18:13:35 user nova-compute[73078]: DEBUG nova.compute.manager [req-6b5a1774-950c-4720-b9ea-2273b0481a76 req-fd387a94-bc8a-45b6-a37e-711f0fbd2222 service nova] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Received event network-vif-plugged-733825c5-0713-4980-9e5d-4a1120fb1598 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6b5a1774-950c-4720-b9ea-2273b0481a76 req-fd387a94-bc8a-45b6-a37e-711f0fbd2222 service nova] Acquiring lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6b5a1774-950c-4720-b9ea-2273b0481a76 req-fd387a94-bc8a-45b6-a37e-711f0fbd2222 service nova] Lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6b5a1774-950c-4720-b9ea-2273b0481a76 req-fd387a94-bc8a-45b6-a37e-711f0fbd2222 service nova] Lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG nova.compute.manager [req-6b5a1774-950c-4720-b9ea-2273b0481a76 req-fd387a94-bc8a-45b6-a37e-711f0fbd2222 service nova] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] No waiting events found dispatching network-vif-plugged-733825c5-0713-4980-9e5d-4a1120fb1598 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:13:35 user nova-compute[73078]: WARNING nova.compute.manager [req-6b5a1774-950c-4720-b9ea-2273b0481a76 req-fd387a94-bc8a-45b6-a37e-711f0fbd2222 service nova] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Received unexpected event network-vif-plugged-733825c5-0713-4980-9e5d-4a1120fb1598 for instance with vm_state active and task_state deleting.
Aug 14 18:13:35 user nova-compute[73078]: DEBUG nova.compute.manager [req-6b5a1774-950c-4720-b9ea-2273b0481a76 req-fd387a94-bc8a-45b6-a37e-711f0fbd2222 service nova] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Received event network-vif-plugged-733825c5-0713-4980-9e5d-4a1120fb1598 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6b5a1774-950c-4720-b9ea-2273b0481a76 req-fd387a94-bc8a-45b6-a37e-711f0fbd2222 service nova] Acquiring lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6b5a1774-950c-4720-b9ea-2273b0481a76 req-fd387a94-bc8a-45b6-a37e-711f0fbd2222 service nova] Lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6b5a1774-950c-4720-b9ea-2273b0481a76 req-fd387a94-bc8a-45b6-a37e-711f0fbd2222 service nova] Lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG nova.compute.manager [req-6b5a1774-950c-4720-b9ea-2273b0481a76 req-fd387a94-bc8a-45b6-a37e-711f0fbd2222 service nova] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] No waiting events found dispatching network-vif-plugged-733825c5-0713-4980-9e5d-4a1120fb1598 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:13:35 user nova-compute[73078]: WARNING nova.compute.manager [req-6b5a1774-950c-4720-b9ea-2273b0481a76 req-fd387a94-bc8a-45b6-a37e-711f0fbd2222 service nova] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Received unexpected event network-vif-plugged-733825c5-0713-4980-9e5d-4a1120fb1598 for instance with vm_state active and task_state deleting.
Aug 14 18:13:35 user nova-compute[73078]: DEBUG nova.compute.manager [req-6b5a1774-950c-4720-b9ea-2273b0481a76 req-fd387a94-bc8a-45b6-a37e-711f0fbd2222 service nova] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Received event network-vif-unplugged-733825c5-0713-4980-9e5d-4a1120fb1598 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6b5a1774-950c-4720-b9ea-2273b0481a76 req-fd387a94-bc8a-45b6-a37e-711f0fbd2222 service nova] Acquiring lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6b5a1774-950c-4720-b9ea-2273b0481a76 req-fd387a94-bc8a-45b6-a37e-711f0fbd2222 service nova] Lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6b5a1774-950c-4720-b9ea-2273b0481a76 req-fd387a94-bc8a-45b6-a37e-711f0fbd2222 service nova] Lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG nova.compute.manager [req-6b5a1774-950c-4720-b9ea-2273b0481a76 req-fd387a94-bc8a-45b6-a37e-711f0fbd2222 service nova] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] No waiting events found dispatching network-vif-unplugged-733825c5-0713-4980-9e5d-4a1120fb1598 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG nova.compute.manager [req-6b5a1774-950c-4720-b9ea-2273b0481a76 req-fd387a94-bc8a-45b6-a37e-711f0fbd2222 service nova] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Received event network-vif-unplugged-733825c5-0713-4980-9e5d-4a1120fb1598 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:13:35 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:13:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a865f5a6-be7a-4671-baf7-0bdd33a92845]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:13:35 user nova-compute[73078]: DEBUG os_brick.utils [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:13:35 user nova-compute[73078]: INFO nova.compute.manager [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Swapping volume 1f1e39c8-a854-4ecb-bdf4-e974597b7db7 for 7a3e2365-55ce-4728-b393-6e4f54b4bdd6
Aug 14 18:13:36 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:13:36 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Took 1.30 seconds to deallocate network for instance.
Aug 14 18:13:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-de4ab11c-bd55-4682-af6a-0c1639ba7afa tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-de4ab11c-bd55-4682-af6a-0c1639ba7afa tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:36 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-de4ab11c-bd55-4682-af6a-0c1639ba7afa tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:13:36 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-de4ab11c-bd55-4682-af6a-0c1639ba7afa tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:13:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-de4ab11c-bd55-4682-af6a-0c1639ba7afa tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:36 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Searching for a device in session 10 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:13:36 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ywWndEOV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:13:36 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:13:36 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23334336334663536', 'path': '/dev/sdf'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:13:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334336334663536', 'path': '/dev/sdf'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:13:36 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-de4ab11c-bd55-4682-af6a-0c1639ba7afa tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Deleted allocations for instance 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a
Aug 14 18:13:36 user nova-compute[73078]: DEBUG nova.objects.instance [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lazy-loading 'flavor' on Instance uuid ad1d1145-1a70-4a9c-b563-6bda437dc0cc {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:13:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 18:13:36 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:13:36 user nova-compute[73078]:   <source dev="/dev/sdf"/>
Aug 14 18:13:36 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:13:36 user nova-compute[73078]:   <serial>763fe1b7-07ac-4eb5-9f46-b97158834021</serial>
Aug 14 18:13:36 user nova-compute[73078]: </disk>
Aug 14 18:13:36 user nova-compute[73078]:  {{(pid=73078) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 18:13:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-de4ab11c-bd55-4682-af6a-0c1639ba7afa tempest-AttachSCSIVolumeTestJSON-1163083945 tempest-AttachSCSIVolumeTestJSON-1163083945-project-member] Lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.439s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:37 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:13:37 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] No BDM found with device name hda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:13:37 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] No VIF found with MAC fa:16:3e:56:c1:dd, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:13:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-688e684b-a8ca-4699-a81a-209bed3ed00d tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.038s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:37 user nova-compute[73078]: DEBUG nova.compute.manager [req-95ec02d8-9fdd-4f9b-8265-84bf1fc11178 req-a0580cdd-347e-4aa2-97d5-950d2a04fa39 service nova] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Received event network-vif-plugged-733825c5-0713-4980-9e5d-4a1120fb1598 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:13:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-95ec02d8-9fdd-4f9b-8265-84bf1fc11178 req-a0580cdd-347e-4aa2-97d5-950d2a04fa39 service nova] Acquiring lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-95ec02d8-9fdd-4f9b-8265-84bf1fc11178 req-a0580cdd-347e-4aa2-97d5-950d2a04fa39 service nova] Lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-95ec02d8-9fdd-4f9b-8265-84bf1fc11178 req-a0580cdd-347e-4aa2-97d5-950d2a04fa39 service nova] Lock "0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:37 user nova-compute[73078]: DEBUG nova.compute.manager [req-95ec02d8-9fdd-4f9b-8265-84bf1fc11178 req-a0580cdd-347e-4aa2-97d5-950d2a04fa39 service nova] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] No waiting events found dispatching network-vif-plugged-733825c5-0713-4980-9e5d-4a1120fb1598 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:13:37 user nova-compute[73078]: WARNING nova.compute.manager [req-95ec02d8-9fdd-4f9b-8265-84bf1fc11178 req-a0580cdd-347e-4aa2-97d5-950d2a04fa39 service nova] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Received unexpected event network-vif-plugged-733825c5-0713-4980-9e5d-4a1120fb1598 for instance with vm_state deleted and task_state None.
Aug 14 18:13:37 user nova-compute[73078]: DEBUG nova.compute.manager [req-95ec02d8-9fdd-4f9b-8265-84bf1fc11178 req-a0580cdd-347e-4aa2-97d5-950d2a04fa39 service nova] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Received event network-vif-deleted-733825c5-0713-4980-9e5d-4a1120fb1598 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0c018078-a68d-4ac5-960a-8ea7881ba7ae tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Acquiring lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0c018078-a68d-4ac5-960a-8ea7881ba7ae tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:39 user nova-compute[73078]: INFO nova.compute.manager [None req-0c018078-a68d-4ac5-960a-8ea7881ba7ae tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Detaching volume 763fe1b7-07ac-4eb5-9f46-b97158834021
Aug 14 18:13:39 user nova-compute[73078]: INFO nova.virt.block_device [None req-0c018078-a68d-4ac5-960a-8ea7881ba7ae tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Attempting to driver detach volume 763fe1b7-07ac-4eb5-9f46-b97158834021 from mountpoint /dev/vdb
Aug 14 18:13:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-0c018078-a68d-4ac5-960a-8ea7881ba7ae tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Attempting to detach device vdb from instance ad1d1145-1a70-4a9c-b563-6bda437dc0cc from the persistent domain config. {{(pid=73078) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-0c018078-a68d-4ac5-960a-8ea7881ba7ae tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:13:39 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:13:39 user nova-compute[73078]:   <source dev="/dev/sdf"/>
Aug 14 18:13:39 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:13:39 user nova-compute[73078]:   <serial>763fe1b7-07ac-4eb5-9f46-b97158834021</serial>
Aug 14 18:13:39 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 18:13:39 user nova-compute[73078]: </disk>
Aug 14 18:13:39 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:13:39 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-0c018078-a68d-4ac5-960a-8ea7881ba7ae tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Successfully detached device vdb from instance ad1d1145-1a70-4a9c-b563-6bda437dc0cc from the persistent domain config.
Aug 14 18:13:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-0c018078-a68d-4ac5-960a-8ea7881ba7ae tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ad1d1145-1a70-4a9c-b563-6bda437dc0cc from the live domain config. {{(pid=73078) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-0c018078-a68d-4ac5-960a-8ea7881ba7ae tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:13:39 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:13:39 user nova-compute[73078]:   <source dev="/dev/sdf"/>
Aug 14 18:13:39 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:13:39 user nova-compute[73078]:   <serial>763fe1b7-07ac-4eb5-9f46-b97158834021</serial>
Aug 14 18:13:39 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 18:13:39 user nova-compute[73078]: </disk>
Aug 14 18:13:39 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Received event <DeviceRemovedEvent: 1692036819.7143912, ad1d1145-1a70-4a9c-b563-6bda437dc0cc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73078) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-0c018078-a68d-4ac5-960a-8ea7881ba7ae tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ad1d1145-1a70-4a9c-b563-6bda437dc0cc {{(pid=73078) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 18:13:39 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-0c018078-a68d-4ac5-960a-8ea7881ba7ae tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Successfully detached device vdb from instance ad1d1145-1a70-4a9c-b563-6bda437dc0cc from the live domain config.
Aug 14 18:13:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c018078-a68d-4ac5-960a-8ea7881ba7ae tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c018078-a68d-4ac5-960a-8ea7881ba7ae tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ywWndEOV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:13:39 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-0c018078-a68d-4ac5-960a-8ea7881ba7ae tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:13:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-0c018078-a68d-4ac5-960a-8ea7881ba7ae tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-0c018078-a68d-4ac5-960a-8ea7881ba7ae tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c018078-a68d-4ac5-960a-8ea7881ba7ae tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc27ac2-39ba-4c70-9789-37ce3c01e92c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5899098a-1364-4c66-a156-e451d9202df1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c018078-a68d-4ac5-960a-8ea7881ba7ae tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021 (non-flash)
Aug 14 18:13:39 user nova-compute[73078]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:13:39 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:13:39 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:13:39 user nova-compute[73078]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 (non-flash)
Aug 14 18:13:39 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c018078-a68d-4ac5-960a-8ea7881ba7ae tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021 (non-flash)
Aug 14 18:13:39 user nova-compute[73078]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:13:39 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:13:39 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:13:39 user nova-compute[73078]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 (non-flash)
Aug 14 18:13:39 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c018078-a68d-4ac5-960a-8ea7881ba7ae tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe97825a4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021'): ({'sdf'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-0c018078-a68d-4ac5-960a-8ea7881ba7ae tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Removing single pathed devices sdf {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fc904e-69f1-4d7e-b1a2-5f3a423f9b65]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfe15e2-4bd6-42a2-9d5d-690841a06f47]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-0c018078-a68d-4ac5-960a-8ea7881ba7ae tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Flushing IO for device /dev/sdf {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef10dcc-b223-430b-8a4c-5815a823afbc]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-0c018078-a68d-4ac5-960a-8ea7881ba7ae tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abad95a-0965-4d2c-88ed-479624cb93d6]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-0c018078-a68d-4ac5-960a-8ea7881ba7ae tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-0c018078-a68d-4ac5-960a-8ea7881ba7ae tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] SCSI volumes sdf have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c018078-a68d-4ac5-960a-8ea7881ba7ae tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbbe8b1-c5bc-4f0b-8a13-42198202b5df]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c018078-a68d-4ac5-960a-8ea7881ba7ae tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd61db8-7482-4eeb-bd12-e5a5e115af6e]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c018078-a68d-4ac5-960a-8ea7881ba7ae tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021, portal: 172.16.0.220,3260]
Aug 14 18:13:39 user nova-compute[73078]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021, portal: 172.16.0.220,3260] successful.
Aug 14 18:13:39 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:763fe1b7-07ac-4eb5-9f46-b97158834021 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc48b5c1-430f-425c-ab87-547898d0eaff]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c018078-a68d-4ac5-960a-8ea7881ba7ae tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-0c018078-a68d-4ac5-960a-8ea7881ba7ae tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c018078-a68d-4ac5-960a-8ea7881ba7ae tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] <== disconnect_volume: return (265ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:13:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c018078-a68d-4ac5-960a-8ea7881ba7ae tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:13:40 user nova-compute[73078]: DEBUG nova.objects.instance [None req-0c018078-a68d-4ac5-960a-8ea7881ba7ae tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lazy-loading 'flavor' on Instance uuid ad1d1145-1a70-4a9c-b563-6bda437dc0cc {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:13:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0c018078-a68d-4ac5-960a-8ea7881ba7ae tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.681s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-93c10dd4-1ef2-4724-adff-8f44cb8450ea tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Acquiring lock "interface-ad1d1145-1a70-4a9c-b563-6bda437dc0cc-4c971778-a364-4f56-a33e-4cdc2c28cecb" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-93c10dd4-1ef2-4724-adff-8f44cb8450ea tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lock "interface-ad1d1145-1a70-4a9c-b563-6bda437dc0cc-4c971778-a364-4f56-a33e-4cdc2c28cecb" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:41 user nova-compute[73078]: DEBUG nova.objects.instance [None req-93c10dd4-1ef2-4724-adff-8f44cb8450ea tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lazy-loading 'flavor' on Instance uuid ad1d1145-1a70-4a9c-b563-6bda437dc0cc {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:13:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-93c10dd4-1ef2-4724-adff-8f44cb8450ea tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:11:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-954582950',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-954582950',id=10,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoZf8Rqz7EiN0P+Qjv1ph9KYV+Un7MKTbl1dwK14KSEc1xx5BX1LfWxWzRq6aPqPl/92nhScUmx3GJQuV5xlN5gzpJdNxWJ8eHGLQ/HA+DwQ8SXejqjnnPB+yC1+OGwhQ==',key_name='tempest-keypair-1334960197',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:11:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a49a3016859146b4b30ae80e5fae6e31',ramdisk_id='',reservation_id='r-cn5ox3sk',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1236088660',owner_user_name='tempest-TaggedAttachmentsTest-1236088660-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:11:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='218142bc464f4083b053a755d818afca',uuid=ad1d1145-1a70-4a9c-b563-6bda437dc0cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c971778-a364-4f56-a33e-4cdc2c28cecb", "address": "fa:16:3e:9a:79:fc", "network": {"id": "2f1f148b-226f-47ff-9de6-be8487c133c4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-486282127", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a49a3016859146b4b30ae80e5fae6e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c971778-a3", "ovs_interfaceid": "4c971778-a364-4f56-a33e-4cdc2c28cecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:13:41 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-93c10dd4-1ef2-4724-adff-8f44cb8450ea tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Converting VIF {"id": "4c971778-a364-4f56-a33e-4cdc2c28cecb", "address": "fa:16:3e:9a:79:fc", "network": {"id": "2f1f148b-226f-47ff-9de6-be8487c133c4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-486282127", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a49a3016859146b4b30ae80e5fae6e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c971778-a3", "ovs_interfaceid": "4c971778-a364-4f56-a33e-4cdc2c28cecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:13:41 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-93c10dd4-1ef2-4724-adff-8f44cb8450ea tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:79:fc,bridge_name='br-int',has_traffic_filtering=True,id=4c971778-a364-4f56-a33e-4cdc2c28cecb,network=Network(2f1f148b-226f-47ff-9de6-be8487c133c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c971778-a3') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:13:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-93c10dd4-1ef2-4724-adff-8f44cb8450ea tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9a:79:fc"/><model type="virtio"/><mtu size="1442"/><target dev="tap4c971778-a3"/></interface> {{(pid=73078) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 14 18:13:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-93c10dd4-1ef2-4724-adff-8f44cb8450ea tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9a:79:fc"/><model type="virtio"/><mtu size="1442"/><target dev="tap4c971778-a3"/></interface> {{(pid=73078) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 14 18:13:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-93c10dd4-1ef2-4724-adff-8f44cb8450ea tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Attempting to detach device tap4c971778-a3 from instance ad1d1145-1a70-4a9c-b563-6bda437dc0cc from the persistent domain config. {{(pid=73078) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 18:13:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-93c10dd4-1ef2-4724-adff-8f44cb8450ea tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] detach device xml: <interface type="ethernet">
Aug 14 18:13:41 user nova-compute[73078]:   <mac address="fa:16:3e:9a:79:fc"/>
Aug 14 18:13:41 user nova-compute[73078]:   <model type="virtio"/>
Aug 14 18:13:41 user nova-compute[73078]:   <mtu size="1442"/>
Aug 14 18:13:41 user nova-compute[73078]:   <target dev="tap4c971778-a3"/>
Aug 14 18:13:41 user nova-compute[73078]: </interface>
Aug 14 18:13:41 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:13:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-93c10dd4-1ef2-4724-adff-8f44cb8450ea tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9a:79:fc"/><model type="virtio"/><mtu size="1442"/><target dev="tap4c971778-a3"/></interface> {{(pid=73078) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 14 18:13:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-93c10dd4-1ef2-4724-adff-8f44cb8450ea tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9a:79:fc"/><model type="virtio"/><mtu size="1442"/><target dev="tap4c971778-a3"/></interface>not found in domain: <domain type='kvm' id='11'>
Aug 14 18:13:41 user nova-compute[73078]:   <name>instance-0000000a</name>
Aug 14 18:13:41 user nova-compute[73078]:   <uuid>ad1d1145-1a70-4a9c-b563-6bda437dc0cc</uuid>
Aug 14 18:13:41 user nova-compute[73078]:   <metadata>
Aug 14 18:13:41 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:13:41 user nova-compute[73078]:   <nova:package version="0.0.0"/>
Aug 14 18:13:41 user nova-compute[73078]:   <nova:name>tempest-device-tagging-server-954582950</nova:name>
Aug 14 18:13:41 user nova-compute[73078]:   <nova:creationTime>2023-08-14 18:13:24</nova:creationTime>
Aug 14 18:13:41 user nova-compute[73078]:   <nova:flavor name="m1.tiny">
Aug 14 18:13:41 user nova-compute[73078]:     <nova:memory>512</nova:memory>
Aug 14 18:13:41 user nova-compute[73078]:     <nova:disk>1</nova:disk>
Aug 14 18:13:41 user nova-compute[73078]:     <nova:swap>0</nova:swap>
Aug 14 18:13:41 user nova-compute[73078]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:13:41 user nova-compute[73078]:     <nova:vcpus>1</nova:vcpus>
Aug 14 18:13:41 user nova-compute[73078]:   </nova:flavor>
Aug 14 18:13:41 user nova-compute[73078]:   <nova:owner>
Aug 14 18:13:41 user nova-compute[73078]:     <nova:user uuid="218142bc464f4083b053a755d818afca">tempest-TaggedAttachmentsTest-1236088660-project-member</nova:user>
Aug 14 18:13:41 user nova-compute[73078]:     <nova:project uuid="a49a3016859146b4b30ae80e5fae6e31">tempest-TaggedAttachmentsTest-1236088660</nova:project>
Aug 14 18:13:41 user nova-compute[73078]:   </nova:owner>
Aug 14 18:13:41 user nova-compute[73078]:   <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:13:41 user nova-compute[73078]:   <nova:ports>
Aug 14 18:13:41 user nova-compute[73078]:     <nova:port uuid="b1c66b74-5403-4bfb-9826-7d95c1e92356">
Aug 14 18:13:41 user nova-compute[73078]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 18:13:41 user nova-compute[73078]:     </nova:port>
Aug 14 18:13:41 user nova-compute[73078]:     <nova:port uuid="4c971778-a364-4f56-a33e-4cdc2c28cecb">
Aug 14 18:13:41 user nova-compute[73078]:       <nova:ip type="fixed" address="10.10.10.36" ipVersion="4"/>
Aug 14 18:13:41 user nova-compute[73078]:     </nova:port>
Aug 14 18:13:41 user nova-compute[73078]:   </nova:ports>
Aug 14 18:13:41 user nova-compute[73078]: </nova:instance>
Aug 14 18:13:41 user nova-compute[73078]:   </metadata>
Aug 14 18:13:41 user nova-compute[73078]:   <memory unit='KiB'>524288</memory>
Aug 14 18:13:41 user nova-compute[73078]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 14 18:13:41 user nova-compute[73078]:   <vcpu placement='static'>1</vcpu>
Aug 14 18:13:41 user nova-compute[73078]:   <resource>
Aug 14 18:13:41 user nova-compute[73078]:     <partition>/machine</partition>
Aug 14 18:13:41 user nova-compute[73078]:   </resource>
Aug 14 18:13:41 user nova-compute[73078]:   <sysinfo type='smbios'>
Aug 14 18:13:41 user nova-compute[73078]:     <system>
Aug 14 18:13:41 user nova-compute[73078]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 14 18:13:41 user nova-compute[73078]:       <entry name='product'>OpenStack Nova</entry>
Aug 14 18:13:41 user nova-compute[73078]:       <entry name='version'>0.0.0</entry>
Aug 14 18:13:41 user nova-compute[73078]:       <entry name='serial'>ad1d1145-1a70-4a9c-b563-6bda437dc0cc</entry>
Aug 14 18:13:41 user nova-compute[73078]:       <entry name='uuid'>ad1d1145-1a70-4a9c-b563-6bda437dc0cc</entry>
Aug 14 18:13:41 user nova-compute[73078]:       <entry name='family'>Virtual Machine</entry>
Aug 14 18:13:41 user nova-compute[73078]:     </system>
Aug 14 18:13:41 user nova-compute[73078]:   </sysinfo>
Aug 14 18:13:41 user nova-compute[73078]:   <os>
Aug 14 18:13:41 user nova-compute[73078]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 14 18:13:41 user nova-compute[73078]:     <boot dev='hd'/>
Aug 14 18:13:41 user nova-compute[73078]:     <smbios mode='sysinfo'/>
Aug 14 18:13:41 user nova-compute[73078]:   </os>
Aug 14 18:13:41 user nova-compute[73078]:   <features>
Aug 14 18:13:41 user nova-compute[73078]:     <acpi/>
Aug 14 18:13:41 user nova-compute[73078]:     <apic/>
Aug 14 18:13:41 user nova-compute[73078]:     <vmcoreinfo state='on'/>
Aug 14 18:13:41 user nova-compute[73078]:   </features>
Aug 14 18:13:41 user nova-compute[73078]:   <cpu mode='custom' match='exact' check='full'>
Aug 14 18:13:41 user nova-compute[73078]:     <model fallback='forbid'>Nehalem</model>
Aug 14 18:13:41 user nova-compute[73078]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 14 18:13:41 user nova-compute[73078]:     <feature policy='require' name='vme'/>
Aug 14 18:13:41 user nova-compute[73078]:     <feature policy='require' name='x2apic'/>
Aug 14 18:13:41 user nova-compute[73078]:     <feature policy='require' name='hypervisor'/>
Aug 14 18:13:41 user nova-compute[73078]:   </cpu>
Aug 14 18:13:41 user nova-compute[73078]:   <clock offset='utc'>
Aug 14 18:13:41 user nova-compute[73078]:     <timer name='pit' tickpolicy='delay'/>
Aug 14 18:13:41 user nova-compute[73078]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 14 18:13:41 user nova-compute[73078]:     <timer name='hpet' present='no'/>
Aug 14 18:13:41 user nova-compute[73078]:   </clock>
Aug 14 18:13:41 user nova-compute[73078]:   <on_poweroff>destroy</on_poweroff>
Aug 14 18:13:41 user nova-compute[73078]:   <on_reboot>restart</on_reboot>
Aug 14 18:13:41 user nova-compute[73078]:   <on_crash>destroy</on_crash>
Aug 14 18:13:41 user nova-compute[73078]:   <devices>
Aug 14 18:13:41 user nova-compute[73078]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 14 18:13:41 user nova-compute[73078]:     <disk type='file' device='disk'>
Aug 14 18:13:41 user nova-compute[73078]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 14 18:13:41 user nova-compute[73078]:       <source file='/opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/disk' index='2'/>
Aug 14 18:13:41 user nova-compute[73078]:       <backingStore type='file' index='3'>
Aug 14 18:13:41 user nova-compute[73078]:         <format type='raw'/>
Aug 14 18:13:41 user nova-compute[73078]:         <source file='/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd'/>
Aug 14 18:13:41 user nova-compute[73078]:         <backingStore/>
Aug 14 18:13:41 user nova-compute[73078]:       </backingStore>
Aug 14 18:13:41 user nova-compute[73078]:       <target dev='vda' bus='virtio'/>
Aug 14 18:13:41 user nova-compute[73078]:       <alias name='virtio-disk0'/>
Aug 14 18:13:41 user nova-compute[73078]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 14 18:13:41 user nova-compute[73078]:     </disk>
Aug 14 18:13:41 user nova-compute[73078]:     <disk type='file' device='cdrom'>
Aug 14 18:13:41 user nova-compute[73078]:       <driver name='qemu' type='raw' cache='none'/>
Aug 14 18:13:41 user nova-compute[73078]:       <source file='/opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/disk.config' index='1'/>
Aug 14 18:13:41 user nova-compute[73078]:       <backingStore/>
Aug 14 18:13:41 user nova-compute[73078]:       <target dev='hda' bus='ide'/>
Aug 14 18:13:41 user nova-compute[73078]:       <readonly/>
Aug 14 18:13:41 user nova-compute[73078]:       <alias name='ide0-0-0'/>
Aug 14 18:13:41 user nova-compute[73078]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 14 18:13:41 user nova-compute[73078]:     </disk>
Aug 14 18:13:41 user nova-compute[73078]:     <controller type='usb' index='0' model='none'>
Aug 14 18:13:41 user nova-compute[73078]:       <alias name='usb'/>
Aug 14 18:13:41 user nova-compute[73078]:     </controller>
Aug 14 18:13:41 user nova-compute[73078]:     <controller type='pci' index='0' model='pci-root'>
Aug 14 18:13:41 user nova-compute[73078]:       <alias name='pci.0'/>
Aug 14 18:13:41 user nova-compute[73078]:     </controller>
Aug 14 18:13:41 user nova-compute[73078]:     <controller type='ide' index='0'>
Aug 14 18:13:41 user nova-compute[73078]:       <alias name='ide'/>
Aug 14 18:13:41 user nova-compute[73078]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 14 18:13:41 user nova-compute[73078]:     </controller>
Aug 14 18:13:41 user nova-compute[73078]:     <interface type='ethernet'>
Aug 14 18:13:41 user nova-compute[73078]:       <mac address='fa:16:3e:56:c1:dd'/>
Aug 14 18:13:41 user nova-compute[73078]:       <target dev='tapb1c66b74-54'/>
Aug 14 18:13:41 user nova-compute[73078]:       <model type='virtio'/>
Aug 14 18:13:41 user nova-compute[73078]:       <mtu size='1442'/>
Aug 14 18:13:41 user nova-compute[73078]:       <alias name='net0'/>
Aug 14 18:13:41 user nova-compute[73078]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 14 18:13:41 user nova-compute[73078]:     </interface>
Aug 14 18:13:41 user nova-compute[73078]:     <interface type='ethernet'>
Aug 14 18:13:41 user nova-compute[73078]:       <mac address='fa:16:3e:9a:79:fc'/>
Aug 14 18:13:41 user nova-compute[73078]:       <target dev='tap4c971778-a3'/>
Aug 14 18:13:41 user nova-compute[73078]:       <model type='virtio'/>
Aug 14 18:13:41 user nova-compute[73078]:       <mtu size='1442'/>
Aug 14 18:13:41 user nova-compute[73078]:       <alias name='net1'/>
Aug 14 18:13:41 user nova-compute[73078]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 14 18:13:41 user nova-compute[73078]:     </interface>
Aug 14 18:13:41 user nova-compute[73078]:     <serial type='pty'>
Aug 14 18:13:41 user nova-compute[73078]:       <source path='/dev/pts/10'/>
Aug 14 18:13:41 user nova-compute[73078]:       <log file='/opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/console.log' append='off'/>
Aug 14 18:13:41 user nova-compute[73078]:       <target type='isa-serial' port='0'>
Aug 14 18:13:41 user nova-compute[73078]:         <model name='isa-serial'/>
Aug 14 18:13:41 user nova-compute[73078]:       </target>
Aug 14 18:13:41 user nova-compute[73078]:       <alias name='serial0'/>
Aug 14 18:13:41 user nova-compute[73078]:     </serial>
Aug 14 18:13:41 user nova-compute[73078]:     <console type='pty' tty='/dev/pts/10'>
Aug 14 18:13:41 user nova-compute[73078]:       <source path='/dev/pts/10'/>
Aug 14 18:13:41 user nova-compute[73078]:       <log file='/opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/console.log' append='off'/>
Aug 14 18:13:41 user nova-compute[73078]:       <target type='serial' port='0'/>
Aug 14 18:13:41 user nova-compute[73078]:       <alias name='serial0'/>
Aug 14 18:13:41 user nova-compute[73078]:     </console>
Aug 14 18:13:41 user nova-compute[73078]:     <input type='mouse' bus='ps2'>
Aug 14 18:13:41 user nova-compute[73078]:       <alias name='input0'/>
Aug 14 18:13:41 user nova-compute[73078]:     </input>
Aug 14 18:13:41 user nova-compute[73078]:     <input type='keyboard' bus='ps2'>
Aug 14 18:13:41 user nova-compute[73078]:       <alias name='input1'/>
Aug 14 18:13:41 user nova-compute[73078]:     </input>
Aug 14 18:13:41 user nova-compute[73078]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Aug 14 18:13:41 user nova-compute[73078]:       <listen type='address' address='0.0.0.0'/>
Aug 14 18:13:41 user nova-compute[73078]:     </graphics>
Aug 14 18:13:41 user nova-compute[73078]:     <audio id='1' type='none'/>
Aug 14 18:13:41 user nova-compute[73078]:     <video>
Aug 14 18:13:41 user nova-compute[73078]:       <model type='virtio' heads='1' primary='yes'/>
Aug 14 18:13:41 user nova-compute[73078]:       <alias name='video0'/>
Aug 14 18:13:41 user nova-compute[73078]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 14 18:13:41 user nova-compute[73078]:     </video>
Aug 14 18:13:41 user nova-compute[73078]:     <memballoon model='virtio'>
Aug 14 18:13:41 user nova-compute[73078]:       <stats period='10'/>
Aug 14 18:13:41 user nova-compute[73078]:       <alias name='balloon0'/>
Aug 14 18:13:41 user nova-compute[73078]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 14 18:13:41 user nova-compute[73078]:     </memballoon>
Aug 14 18:13:41 user nova-compute[73078]:     <rng model='virtio'>
Aug 14 18:13:41 user nova-compute[73078]:       <backend model='random'>/dev/urandom</backend>
Aug 14 18:13:41 user nova-compute[73078]:       <alias name='rng0'/>
Aug 14 18:13:41 user nova-compute[73078]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 14 18:13:41 user nova-compute[73078]:     </rng>
Aug 14 18:13:41 user nova-compute[73078]:   </devices>
Aug 14 18:13:41 user nova-compute[73078]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 14 18:13:41 user nova-compute[73078]:     <label>libvirt-ad1d1145-1a70-4a9c-b563-6bda437dc0cc</label>
Aug 14 18:13:41 user nova-compute[73078]:     <imagelabel>libvirt-ad1d1145-1a70-4a9c-b563-6bda437dc0cc</imagelabel>
Aug 14 18:13:41 user nova-compute[73078]:   </seclabel>
Aug 14 18:13:41 user nova-compute[73078]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 14 18:13:41 user nova-compute[73078]:     <label>+64055:+108</label>
Aug 14 18:13:41 user nova-compute[73078]:     <imagelabel>+64055:+108</imagelabel>
Aug 14 18:13:41 user nova-compute[73078]:   </seclabel>
Aug 14 18:13:41 user nova-compute[73078]: </domain>
Aug 14 18:13:41 user nova-compute[73078]:  {{(pid=73078) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 14 18:13:41 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-93c10dd4-1ef2-4724-adff-8f44cb8450ea tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Successfully detached device tap4c971778-a3 from instance ad1d1145-1a70-4a9c-b563-6bda437dc0cc from the persistent domain config.
Aug 14 18:13:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-93c10dd4-1ef2-4724-adff-8f44cb8450ea tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] (1/8): Attempting to detach device tap4c971778-a3 with device alias net1 from instance ad1d1145-1a70-4a9c-b563-6bda437dc0cc from the live domain config. {{(pid=73078) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 18:13:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-93c10dd4-1ef2-4724-adff-8f44cb8450ea tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] detach device xml: <interface type="ethernet">
Aug 14 18:13:41 user nova-compute[73078]:   <mac address="fa:16:3e:9a:79:fc"/>
Aug 14 18:13:41 user nova-compute[73078]:   <model type="virtio"/>
Aug 14 18:13:41 user nova-compute[73078]:   <mtu size="1442"/>
Aug 14 18:13:41 user nova-compute[73078]:   <target dev="tap4c971778-a3"/>
Aug 14 18:13:41 user nova-compute[73078]: </interface>
Aug 14 18:13:41 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:13:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Received event <DeviceRemovedEvent: 1692036821.7825344, ad1d1145-1a70-4a9c-b563-6bda437dc0cc => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73078) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 18:13:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-93c10dd4-1ef2-4724-adff-8f44cb8450ea tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Start waiting for the detach event from libvirt for device tap4c971778-a3 with device alias net1 for instance ad1d1145-1a70-4a9c-b563-6bda437dc0cc {{(pid=73078) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 18:13:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-93c10dd4-1ef2-4724-adff-8f44cb8450ea tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9a:79:fc"/><model type="virtio"/><mtu size="1442"/><target dev="tap4c971778-a3"/></interface> {{(pid=73078) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 14 18:13:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-93c10dd4-1ef2-4724-adff-8f44cb8450ea tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9a:79:fc"/><model type="virtio"/><mtu size="1442"/><target dev="tap4c971778-a3"/></interface>not found in domain: <domain type='kvm' id='11'>
Aug 14 18:13:41 user nova-compute[73078]:   <name>instance-0000000a</name>
Aug 14 18:13:41 user nova-compute[73078]:   <uuid>ad1d1145-1a70-4a9c-b563-6bda437dc0cc</uuid>
Aug 14 18:13:41 user nova-compute[73078]:   <metadata>
Aug 14 18:13:41 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:13:41 user nova-compute[73078]:   <nova:package version="0.0.0"/>
Aug 14 18:13:41 user nova-compute[73078]:   <nova:name>tempest-device-tagging-server-954582950</nova:name>
Aug 14 18:13:41 user nova-compute[73078]:   <nova:creationTime>2023-08-14 18:13:24</nova:creationTime>
Aug 14 18:13:41 user nova-compute[73078]:   <nova:flavor name="m1.tiny">
Aug 14 18:13:41 user nova-compute[73078]:     <nova:memory>512</nova:memory>
Aug 14 18:13:41 user nova-compute[73078]:     <nova:disk>1</nova:disk>
Aug 14 18:13:41 user nova-compute[73078]:     <nova:swap>0</nova:swap>
Aug 14 18:13:41 user nova-compute[73078]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:13:41 user nova-compute[73078]:     <nova:vcpus>1</nova:vcpus>
Aug 14 18:13:41 user nova-compute[73078]:   </nova:flavor>
Aug 14 18:13:41 user nova-compute[73078]:   <nova:owner>
Aug 14 18:13:41 user nova-compute[73078]:     <nova:user uuid="218142bc464f4083b053a755d818afca">tempest-TaggedAttachmentsTest-1236088660-project-member</nova:user>
Aug 14 18:13:41 user nova-compute[73078]:     <nova:project uuid="a49a3016859146b4b30ae80e5fae6e31">tempest-TaggedAttachmentsTest-1236088660</nova:project>
Aug 14 18:13:41 user nova-compute[73078]:   </nova:owner>
Aug 14 18:13:41 user nova-compute[73078]:   <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:13:41 user nova-compute[73078]:   <nova:ports>
Aug 14 18:13:41 user nova-compute[73078]:     <nova:port uuid="b1c66b74-5403-4bfb-9826-7d95c1e92356">
Aug 14 18:13:41 user nova-compute[73078]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 18:13:41 user nova-compute[73078]:     </nova:port>
Aug 14 18:13:41 user nova-compute[73078]:     <nova:port uuid="4c971778-a364-4f56-a33e-4cdc2c28cecb">
Aug 14 18:13:41 user nova-compute[73078]:       <nova:ip type="fixed" address="10.10.10.36" ipVersion="4"/>
Aug 14 18:13:41 user nova-compute[73078]:     </nova:port>
Aug 14 18:13:41 user nova-compute[73078]:   </nova:ports>
Aug 14 18:13:41 user nova-compute[73078]: </nova:instance>
Aug 14 18:13:41 user nova-compute[73078]:   </metadata>
Aug 14 18:13:41 user nova-compute[73078]:   <memory unit='KiB'>524288</memory>
Aug 14 18:13:41 user nova-compute[73078]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 14 18:13:41 user nova-compute[73078]:   <vcpu placement='static'>1</vcpu>
Aug 14 18:13:41 user nova-compute[73078]:   <resource>
Aug 14 18:13:41 user nova-compute[73078]:     <partition>/machine</partition>
Aug 14 18:13:41 user nova-compute[73078]:   </resource>
Aug 14 18:13:41 user nova-compute[73078]:   <sysinfo type='smbios'>
Aug 14 18:13:41 user nova-compute[73078]:     <system>
Aug 14 18:13:41 user nova-compute[73078]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 14 18:13:41 user nova-compute[73078]:       <entry name='product'>OpenStack Nova</entry>
Aug 14 18:13:41 user nova-compute[73078]:       <entry name='version'>0.0.0</entry>
Aug 14 18:13:41 user nova-compute[73078]:       <entry name='serial'>ad1d1145-1a70-4a9c-b563-6bda437dc0cc</entry>
Aug 14 18:13:41 user nova-compute[73078]:       <entry name='uuid'>ad1d1145-1a70-4a9c-b563-6bda437dc0cc</entry>
Aug 14 18:13:41 user nova-compute[73078]:       <entry name='family'>Virtual Machine</entry>
Aug 14 18:13:41 user nova-compute[73078]:     </system>
Aug 14 18:13:41 user nova-compute[73078]:   </sysinfo>
Aug 14 18:13:41 user nova-compute[73078]:   <os>
Aug 14 18:13:41 user nova-compute[73078]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 14 18:13:41 user nova-compute[73078]:     <boot dev='hd'/>
Aug 14 18:13:41 user nova-compute[73078]:     <smbios mode='sysinfo'/>
Aug 14 18:13:41 user nova-compute[73078]:   </os>
Aug 14 18:13:41 user nova-compute[73078]:   <features>
Aug 14 18:13:41 user nova-compute[73078]:     <acpi/>
Aug 14 18:13:41 user nova-compute[73078]:     <apic/>
Aug 14 18:13:41 user nova-compute[73078]:     <vmcoreinfo state='on'/>
Aug 14 18:13:41 user nova-compute[73078]:   </features>
Aug 14 18:13:41 user nova-compute[73078]:   <cpu mode='custom' match='exact' check='full'>
Aug 14 18:13:41 user nova-compute[73078]:     <model fallback='forbid'>Nehalem</model>
Aug 14 18:13:41 user nova-compute[73078]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 14 18:13:41 user nova-compute[73078]:     <feature policy='require' name='vme'/>
Aug 14 18:13:41 user nova-compute[73078]:     <feature policy='require' name='x2apic'/>
Aug 14 18:13:41 user nova-compute[73078]:     <feature policy='require' name='hypervisor'/>
Aug 14 18:13:41 user nova-compute[73078]:   </cpu>
Aug 14 18:13:41 user nova-compute[73078]:   <clock offset='utc'>
Aug 14 18:13:41 user nova-compute[73078]:     <timer name='pit' tickpolicy='delay'/>
Aug 14 18:13:41 user nova-compute[73078]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 14 18:13:41 user nova-compute[73078]:     <timer name='hpet' present='no'/>
Aug 14 18:13:41 user nova-compute[73078]:   </clock>
Aug 14 18:13:41 user nova-compute[73078]:   <on_poweroff>destroy</on_poweroff>
Aug 14 18:13:41 user nova-compute[73078]:   <on_reboot>restart</on_reboot>
Aug 14 18:13:41 user nova-compute[73078]:   <on_crash>destroy</on_crash>
Aug 14 18:13:41 user nova-compute[73078]:   <devices>
Aug 14 18:13:41 user nova-compute[73078]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 14 18:13:41 user nova-compute[73078]:     <disk type='file' device='disk'>
Aug 14 18:13:41 user nova-compute[73078]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 14 18:13:41 user nova-compute[73078]:       <source file='/opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/disk' index='2'/>
Aug 14 18:13:41 user nova-compute[73078]:       <backingStore type='file' index='3'>
Aug 14 18:13:41 user nova-compute[73078]:         <format type='raw'/>
Aug 14 18:13:41 user nova-compute[73078]:         <source file='/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd'/>
Aug 14 18:13:41 user nova-compute[73078]:         <backingStore/>
Aug 14 18:13:41 user nova-compute[73078]:       </backingStore>
Aug 14 18:13:41 user nova-compute[73078]:       <target dev='vda' bus='virtio'/>
Aug 14 18:13:41 user nova-compute[73078]:       <alias name='virtio-disk0'/>
Aug 14 18:13:41 user nova-compute[73078]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 14 18:13:41 user nova-compute[73078]:     </disk>
Aug 14 18:13:41 user nova-compute[73078]:     <disk type='file' device='cdrom'>
Aug 14 18:13:41 user nova-compute[73078]:       <driver name='qemu' type='raw' cache='none'/>
Aug 14 18:13:41 user nova-compute[73078]:       <source file='/opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/disk.config' index='1'/>
Aug 14 18:13:41 user nova-compute[73078]:       <backingStore/>
Aug 14 18:13:41 user nova-compute[73078]:       <target dev='hda' bus='ide'/>
Aug 14 18:13:41 user nova-compute[73078]:       <readonly/>
Aug 14 18:13:41 user nova-compute[73078]:       <alias name='ide0-0-0'/>
Aug 14 18:13:41 user nova-compute[73078]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 14 18:13:41 user nova-compute[73078]:     </disk>
Aug 14 18:13:41 user nova-compute[73078]:     <controller type='usb' index='0' model='none'>
Aug 14 18:13:41 user nova-compute[73078]:       <alias name='usb'/>
Aug 14 18:13:41 user nova-compute[73078]:     </controller>
Aug 14 18:13:41 user nova-compute[73078]:     <controller type='pci' index='0' model='pci-root'>
Aug 14 18:13:41 user nova-compute[73078]:       <alias name='pci.0'/>
Aug 14 18:13:41 user nova-compute[73078]:     </controller>
Aug 14 18:13:41 user nova-compute[73078]:     <controller type='ide' index='0'>
Aug 14 18:13:41 user nova-compute[73078]:       <alias name='ide'/>
Aug 14 18:13:41 user nova-compute[73078]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 14 18:13:41 user nova-compute[73078]:     </controller>
Aug 14 18:13:41 user nova-compute[73078]:     <interface type='ethernet'>
Aug 14 18:13:41 user nova-compute[73078]:       <mac address='fa:16:3e:56:c1:dd'/>
Aug 14 18:13:41 user nova-compute[73078]:       <target dev='tapb1c66b74-54'/>
Aug 14 18:13:41 user nova-compute[73078]:       <model type='virtio'/>
Aug 14 18:13:41 user nova-compute[73078]:       <mtu size='1442'/>
Aug 14 18:13:41 user nova-compute[73078]:       <alias name='net0'/>
Aug 14 18:13:41 user nova-compute[73078]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 14 18:13:41 user nova-compute[73078]:     </interface>
Aug 14 18:13:41 user nova-compute[73078]:     <serial type='pty'>
Aug 14 18:13:41 user nova-compute[73078]:       <source path='/dev/pts/10'/>
Aug 14 18:13:41 user nova-compute[73078]:       <log file='/opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/console.log' append='off'/>
Aug 14 18:13:41 user nova-compute[73078]:       <target type='isa-serial' port='0'>
Aug 14 18:13:41 user nova-compute[73078]:         <model name='isa-serial'/>
Aug 14 18:13:41 user nova-compute[73078]:       </target>
Aug 14 18:13:41 user nova-compute[73078]:       <alias name='serial0'/>
Aug 14 18:13:41 user nova-compute[73078]:     </serial>
Aug 14 18:13:41 user nova-compute[73078]:     <console type='pty' tty='/dev/pts/10'>
Aug 14 18:13:41 user nova-compute[73078]:       <source path='/dev/pts/10'/>
Aug 14 18:13:41 user nova-compute[73078]:       <log file='/opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/console.log' append='off'/>
Aug 14 18:13:41 user nova-compute[73078]:       <target type='serial' port='0'/>
Aug 14 18:13:41 user nova-compute[73078]:       <alias name='serial0'/>
Aug 14 18:13:41 user nova-compute[73078]:     </console>
Aug 14 18:13:41 user nova-compute[73078]:     <input type='mouse' bus='ps2'>
Aug 14 18:13:41 user nova-compute[73078]:       <alias name='input0'/>
Aug 14 18:13:41 user nova-compute[73078]:     </input>
Aug 14 18:13:41 user nova-compute[73078]:     <input type='keyboard' bus='ps2'>
Aug 14 18:13:41 user nova-compute[73078]:       <alias name='input1'/>
Aug 14 18:13:41 user nova-compute[73078]:     </input>
Aug 14 18:13:41 user nova-compute[73078]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Aug 14 18:13:41 user nova-compute[73078]:       <listen type='address' address='0.0.0.0'/>
Aug 14 18:13:41 user nova-compute[73078]:     </graphics>
Aug 14 18:13:41 user nova-compute[73078]:     <audio id='1' type='none'/>
Aug 14 18:13:41 user nova-compute[73078]:     <video>
Aug 14 18:13:41 user nova-compute[73078]:       <model type='virtio' heads='1' primary='yes'/>
Aug 14 18:13:41 user nova-compute[73078]:       <alias name='video0'/>
Aug 14 18:13:41 user nova-compute[73078]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 14 18:13:41 user nova-compute[73078]:     </video>
Aug 14 18:13:41 user nova-compute[73078]:     <memballoon model='virtio'>
Aug 14 18:13:41 user nova-compute[73078]:       <stats period='10'/>
Aug 14 18:13:41 user nova-compute[73078]:       <alias name='balloon0'/>
Aug 14 18:13:41 user nova-compute[73078]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 14 18:13:41 user nova-compute[73078]:     </memballoon>
Aug 14 18:13:41 user nova-compute[73078]:     <rng model='virtio'>
Aug 14 18:13:41 user nova-compute[73078]:       <backend model='random'>/dev/urandom</backend>
Aug 14 18:13:41 user nova-compute[73078]:       <alias name='rng0'/>
Aug 14 18:13:41 user nova-compute[73078]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 14 18:13:41 user nova-compute[73078]:     </rng>
Aug 14 18:13:41 user nova-compute[73078]:   </devices>
Aug 14 18:13:41 user nova-compute[73078]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 14 18:13:41 user nova-compute[73078]:     <label>libvirt-ad1d1145-1a70-4a9c-b563-6bda437dc0cc</label>
Aug 14 18:13:41 user nova-compute[73078]:     <imagelabel>libvirt-ad1d1145-1a70-4a9c-b563-6bda437dc0cc</imagelabel>
Aug 14 18:13:41 user nova-compute[73078]:   </seclabel>
Aug 14 18:13:41 user nova-compute[73078]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 14 18:13:41 user nova-compute[73078]:     <label>+64055:+108</label>
Aug 14 18:13:41 user nova-compute[73078]:     <imagelabel>+64055:+108</imagelabel>
Aug 14 18:13:41 user nova-compute[73078]:   </seclabel>
Aug 14 18:13:41 user nova-compute[73078]: </domain>
Aug 14 18:13:41 user nova-compute[73078]:  {{(pid=73078) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 14 18:13:41 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-93c10dd4-1ef2-4724-adff-8f44cb8450ea tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Successfully detached device tap4c971778-a3 from instance ad1d1145-1a70-4a9c-b563-6bda437dc0cc from the live domain config.
Aug 14 18:13:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-93c10dd4-1ef2-4724-adff-8f44cb8450ea tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:11:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-954582950',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-954582950',id=10,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoZf8Rqz7EiN0P+Qjv1ph9KYV+Un7MKTbl1dwK14KSEc1xx5BX1LfWxWzRq6aPqPl/92nhScUmx3GJQuV5xlN5gzpJdNxWJ8eHGLQ/HA+DwQ8SXejqjnnPB+yC1+OGwhQ==',key_name='tempest-keypair-1334960197',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:11:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a49a3016859146b4b30ae80e5fae6e31',ramdisk_id='',reservation_id='r-cn5ox3sk',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1236088660',owner_user_name='tempest-TaggedAttachmentsTest-1236088660-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:11:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='218142bc464f4083b053a755d818afca',uuid=ad1d1145-1a70-4a9c-b563-6bda437dc0cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c971778-a364-4f56-a33e-4cdc2c28cecb", "address": "fa:16:3e:9a:79:fc", "network": {"id": "2f1f148b-226f-47ff-9de6-be8487c133c4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-486282127", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a49a3016859146b4b30ae80e5fae6e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c971778-a3", "ovs_interfaceid": "4c971778-a364-4f56-a33e-4cdc2c28cecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:13:41 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-93c10dd4-1ef2-4724-adff-8f44cb8450ea tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Converting VIF {"id": "4c971778-a364-4f56-a33e-4cdc2c28cecb", "address": "fa:16:3e:9a:79:fc", "network": {"id": "2f1f148b-226f-47ff-9de6-be8487c133c4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-486282127", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a49a3016859146b4b30ae80e5fae6e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c971778-a3", "ovs_interfaceid": "4c971778-a364-4f56-a33e-4cdc2c28cecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:13:41 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-93c10dd4-1ef2-4724-adff-8f44cb8450ea tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:79:fc,bridge_name='br-int',has_traffic_filtering=True,id=4c971778-a364-4f56-a33e-4cdc2c28cecb,network=Network(2f1f148b-226f-47ff-9de6-be8487c133c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c971778-a3') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:13:41 user nova-compute[73078]: DEBUG os_vif [None req-93c10dd4-1ef2-4724-adff-8f44cb8450ea tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:79:fc,bridge_name='br-int',has_traffic_filtering=True,id=4c971778-a364-4f56-a33e-4cdc2c28cecb,network=Network(2f1f148b-226f-47ff-9de6-be8487c133c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c971778-a3') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:13:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c971778-a3, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:13:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:13:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:41 user nova-compute[73078]: INFO os_vif [None req-93c10dd4-1ef2-4724-adff-8f44cb8450ea tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:79:fc,bridge_name='br-int',has_traffic_filtering=True,id=4c971778-a364-4f56-a33e-4cdc2c28cecb,network=Network(2f1f148b-226f-47ff-9de6-be8487c133c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c971778-a3')
Aug 14 18:13:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-93c10dd4-1ef2-4724-adff-8f44cb8450ea tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:13:41 user nova-compute[73078]:   <nova:package version="0.0.0"/>
Aug 14 18:13:41 user nova-compute[73078]:   <nova:name>tempest-device-tagging-server-954582950</nova:name>
Aug 14 18:13:41 user nova-compute[73078]:   <nova:creationTime>2023-08-14 18:13:41</nova:creationTime>
Aug 14 18:13:41 user nova-compute[73078]:   <nova:flavor name="m1.tiny">
Aug 14 18:13:41 user nova-compute[73078]:     <nova:memory>512</nova:memory>
Aug 14 18:13:41 user nova-compute[73078]:     <nova:disk>1</nova:disk>
Aug 14 18:13:41 user nova-compute[73078]:     <nova:swap>0</nova:swap>
Aug 14 18:13:41 user nova-compute[73078]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:13:41 user nova-compute[73078]:     <nova:vcpus>1</nova:vcpus>
Aug 14 18:13:41 user nova-compute[73078]:   </nova:flavor>
Aug 14 18:13:41 user nova-compute[73078]:   <nova:owner>
Aug 14 18:13:41 user nova-compute[73078]:     <nova:user uuid="218142bc464f4083b053a755d818afca">tempest-TaggedAttachmentsTest-1236088660-project-member</nova:user>
Aug 14 18:13:41 user nova-compute[73078]:     <nova:project uuid="a49a3016859146b4b30ae80e5fae6e31">tempest-TaggedAttachmentsTest-1236088660</nova:project>
Aug 14 18:13:41 user nova-compute[73078]:   </nova:owner>
Aug 14 18:13:41 user nova-compute[73078]:   <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:13:41 user nova-compute[73078]:   <nova:ports>
Aug 14 18:13:41 user nova-compute[73078]:     <nova:port uuid="b1c66b74-5403-4bfb-9826-7d95c1e92356">
Aug 14 18:13:41 user nova-compute[73078]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 18:13:41 user nova-compute[73078]:     </nova:port>
Aug 14 18:13:41 user nova-compute[73078]:   </nova:ports>
Aug 14 18:13:41 user nova-compute[73078]: </nova:instance>
Aug 14 18:13:41 user nova-compute[73078]:  {{(pid=73078) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 14 18:13:42 user nova-compute[73078]: DEBUG nova.compute.manager [req-745f8d7e-f125-419e-97cc-e8adaa253d2e req-546a1dde-af95-4666-80e2-6450b85f7c28 service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Received event network-vif-unplugged-4c971778-a364-4f56-a33e-4cdc2c28cecb {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:13:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-745f8d7e-f125-419e-97cc-e8adaa253d2e req-546a1dde-af95-4666-80e2-6450b85f7c28 service nova] Acquiring lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-745f8d7e-f125-419e-97cc-e8adaa253d2e req-546a1dde-af95-4666-80e2-6450b85f7c28 service nova] Lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-745f8d7e-f125-419e-97cc-e8adaa253d2e req-546a1dde-af95-4666-80e2-6450b85f7c28 service nova] Lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:42 user nova-compute[73078]: DEBUG nova.compute.manager [req-745f8d7e-f125-419e-97cc-e8adaa253d2e req-546a1dde-af95-4666-80e2-6450b85f7c28 service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] No waiting events found dispatching network-vif-unplugged-4c971778-a364-4f56-a33e-4cdc2c28cecb {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:13:42 user nova-compute[73078]: WARNING nova.compute.manager [req-745f8d7e-f125-419e-97cc-e8adaa253d2e req-546a1dde-af95-4666-80e2-6450b85f7c28 service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Received unexpected event network-vif-unplugged-4c971778-a364-4f56-a33e-4cdc2c28cecb for instance with vm_state active and task_state None.
Aug 14 18:13:42 user nova-compute[73078]: DEBUG nova.compute.manager [req-93f2da73-367e-42f8-8540-591961c5bcbb req-35739d82-f817-409d-9f4f-ba49369d5549 service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Received event network-vif-deleted-4c971778-a364-4f56-a33e-4cdc2c28cecb {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:13:42 user nova-compute[73078]: INFO nova.compute.manager [req-93f2da73-367e-42f8-8540-591961c5bcbb req-35739d82-f817-409d-9f4f-ba49369d5549 service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Neutron deleted interface 4c971778-a364-4f56-a33e-4cdc2c28cecb; detaching it from the instance and deleting it from the info cache
Aug 14 18:13:42 user nova-compute[73078]: DEBUG nova.network.neutron [req-93f2da73-367e-42f8-8540-591961c5bcbb req-35739d82-f817-409d-9f4f-ba49369d5549 service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Updating instance_info_cache with network_info: [{"id": "b1c66b74-5403-4bfb-9826-7d95c1e92356", "address": "fa:16:3e:56:c1:dd", "network": {"id": "371d3de4-ece5-41b8-8adc-277ac218f7ee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1480740037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a49a3016859146b4b30ae80e5fae6e31", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c66b74-54", "ovs_interfaceid": "b1c66b74-5403-4bfb-9826-7d95c1e92356", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:13:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-93c10dd4-1ef2-4724-adff-8f44cb8450ea tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Acquiring lock "refresh_cache-ad1d1145-1a70-4a9c-b563-6bda437dc0cc" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:13:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-93c10dd4-1ef2-4724-adff-8f44cb8450ea tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Acquired lock "refresh_cache-ad1d1145-1a70-4a9c-b563-6bda437dc0cc" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:13:42 user nova-compute[73078]: DEBUG nova.network.neutron [None req-93c10dd4-1ef2-4724-adff-8f44cb8450ea tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:13:42 user nova-compute[73078]: DEBUG nova.objects.instance [req-93f2da73-367e-42f8-8540-591961c5bcbb req-35739d82-f817-409d-9f4f-ba49369d5549 service nova] Lazy-loading 'system_metadata' on Instance uuid ad1d1145-1a70-4a9c-b563-6bda437dc0cc {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:13:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:42 user nova-compute[73078]: DEBUG nova.objects.instance [req-93f2da73-367e-42f8-8540-591961c5bcbb req-35739d82-f817-409d-9f4f-ba49369d5549 service nova] Lazy-loading 'flavor' on Instance uuid ad1d1145-1a70-4a9c-b563-6bda437dc0cc {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:13:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [req-93f2da73-367e-42f8-8540-591961c5bcbb req-35739d82-f817-409d-9f4f-ba49369d5549 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:11:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-954582950',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-954582950',id=10,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoZf8Rqz7EiN0P+Qjv1ph9KYV+Un7MKTbl1dwK14KSEc1xx5BX1LfWxWzRq6aPqPl/92nhScUmx3GJQuV5xlN5gzpJdNxWJ8eHGLQ/HA+DwQ8SXejqjnnPB+yC1+OGwhQ==',key_name='tempest-keypair-1334960197',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:11:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a49a3016859146b4b30ae80e5fae6e31',ramdisk_id='',reservation_id='r-cn5ox3sk',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1236088660',owner_user_name='tempest-TaggedAttachmentsTest-1236088660-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:11:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='218142bc464f4083b053a755d818afca',uuid=ad1d1145-1a70-4a9c-b563-6bda437dc0cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c971778-a364-4f56-a33e-4cdc2c28cecb", "address": "fa:16:3e:9a:79:fc", "network": {"id": "2f1f148b-226f-47ff-9de6-be8487c133c4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-486282127", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a49a3016859146b4b30ae80e5fae6e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c971778-a3", "ovs_interfaceid": "4c971778-a364-4f56-a33e-4cdc2c28cecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:13:42 user nova-compute[73078]: DEBUG nova.network.os_vif_util [req-93f2da73-367e-42f8-8540-591961c5bcbb req-35739d82-f817-409d-9f4f-ba49369d5549 service nova] Converting VIF {"id": "4c971778-a364-4f56-a33e-4cdc2c28cecb", "address": "fa:16:3e:9a:79:fc", "network": {"id": "2f1f148b-226f-47ff-9de6-be8487c133c4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-486282127", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a49a3016859146b4b30ae80e5fae6e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c971778-a3", "ovs_interfaceid": "4c971778-a364-4f56-a33e-4cdc2c28cecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:13:42 user nova-compute[73078]: DEBUG nova.network.os_vif_util [req-93f2da73-367e-42f8-8540-591961c5bcbb req-35739d82-f817-409d-9f4f-ba49369d5549 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:79:fc,bridge_name='br-int',has_traffic_filtering=True,id=4c971778-a364-4f56-a33e-4cdc2c28cecb,network=Network(2f1f148b-226f-47ff-9de6-be8487c133c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c971778-a3') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:13:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [req-93f2da73-367e-42f8-8540-591961c5bcbb req-35739d82-f817-409d-9f4f-ba49369d5549 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9a:79:fc"/><model type="virtio"/><mtu size="1442"/><target dev="tap4c971778-a3"/></interface> {{(pid=73078) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 14 18:13:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [req-93f2da73-367e-42f8-8540-591961c5bcbb req-35739d82-f817-409d-9f4f-ba49369d5549 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9a:79:fc"/><model type="virtio"/><mtu size="1442"/><target dev="tap4c971778-a3"/></interface>not found in domain: <domain type='kvm' id='11'>
Aug 14 18:13:42 user nova-compute[73078]:   <name>instance-0000000a</name>
Aug 14 18:13:42 user nova-compute[73078]:   <uuid>ad1d1145-1a70-4a9c-b563-6bda437dc0cc</uuid>
Aug 14 18:13:42 user nova-compute[73078]:   <metadata>
Aug 14 18:13:42 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:13:42 user nova-compute[73078]:   <nova:package version="0.0.0"/>
Aug 14 18:13:42 user nova-compute[73078]:   <nova:name>tempest-device-tagging-server-954582950</nova:name>
Aug 14 18:13:42 user nova-compute[73078]:   <nova:creationTime>2023-08-14 18:13:41</nova:creationTime>
Aug 14 18:13:42 user nova-compute[73078]:   <nova:flavor name="m1.tiny">
Aug 14 18:13:42 user nova-compute[73078]:     <nova:memory>512</nova:memory>
Aug 14 18:13:42 user nova-compute[73078]:     <nova:disk>1</nova:disk>
Aug 14 18:13:42 user nova-compute[73078]:     <nova:swap>0</nova:swap>
Aug 14 18:13:42 user nova-compute[73078]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:13:42 user nova-compute[73078]:     <nova:vcpus>1</nova:vcpus>
Aug 14 18:13:42 user nova-compute[73078]:   </nova:flavor>
Aug 14 18:13:42 user nova-compute[73078]:   <nova:owner>
Aug 14 18:13:42 user nova-compute[73078]:     <nova:user uuid="218142bc464f4083b053a755d818afca">tempest-TaggedAttachmentsTest-1236088660-project-member</nova:user>
Aug 14 18:13:42 user nova-compute[73078]:     <nova:project uuid="a49a3016859146b4b30ae80e5fae6e31">tempest-TaggedAttachmentsTest-1236088660</nova:project>
Aug 14 18:13:42 user nova-compute[73078]:   </nova:owner>
Aug 14 18:13:42 user nova-compute[73078]:   <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:13:42 user nova-compute[73078]:   <nova:ports>
Aug 14 18:13:42 user nova-compute[73078]:     <nova:port uuid="b1c66b74-5403-4bfb-9826-7d95c1e92356">
Aug 14 18:13:42 user nova-compute[73078]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 18:13:42 user nova-compute[73078]:     </nova:port>
Aug 14 18:13:42 user nova-compute[73078]:   </nova:ports>
Aug 14 18:13:42 user nova-compute[73078]: </nova:instance>
Aug 14 18:13:42 user nova-compute[73078]:   </metadata>
Aug 14 18:13:42 user nova-compute[73078]:   <memory unit='KiB'>524288</memory>
Aug 14 18:13:42 user nova-compute[73078]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 14 18:13:42 user nova-compute[73078]:   <vcpu placement='static'>1</vcpu>
Aug 14 18:13:42 user nova-compute[73078]:   <resource>
Aug 14 18:13:42 user nova-compute[73078]:     <partition>/machine</partition>
Aug 14 18:13:42 user nova-compute[73078]:   </resource>
Aug 14 18:13:42 user nova-compute[73078]:   <sysinfo type='smbios'>
Aug 14 18:13:42 user nova-compute[73078]:     <system>
Aug 14 18:13:42 user nova-compute[73078]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 14 18:13:42 user nova-compute[73078]:       <entry name='product'>OpenStack Nova</entry>
Aug 14 18:13:42 user nova-compute[73078]:       <entry name='version'>0.0.0</entry>
Aug 14 18:13:42 user nova-compute[73078]:       <entry name='serial'>ad1d1145-1a70-4a9c-b563-6bda437dc0cc</entry>
Aug 14 18:13:42 user nova-compute[73078]:       <entry name='uuid'>ad1d1145-1a70-4a9c-b563-6bda437dc0cc</entry>
Aug 14 18:13:42 user nova-compute[73078]:       <entry name='family'>Virtual Machine</entry>
Aug 14 18:13:42 user nova-compute[73078]:     </system>
Aug 14 18:13:42 user nova-compute[73078]:   </sysinfo>
Aug 14 18:13:42 user nova-compute[73078]:   <os>
Aug 14 18:13:42 user nova-compute[73078]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 14 18:13:42 user nova-compute[73078]:     <boot dev='hd'/>
Aug 14 18:13:42 user nova-compute[73078]:     <smbios mode='sysinfo'/>
Aug 14 18:13:42 user nova-compute[73078]:   </os>
Aug 14 18:13:42 user nova-compute[73078]:   <features>
Aug 14 18:13:42 user nova-compute[73078]:     <acpi/>
Aug 14 18:13:42 user nova-compute[73078]:     <apic/>
Aug 14 18:13:42 user nova-compute[73078]:     <vmcoreinfo state='on'/>
Aug 14 18:13:42 user nova-compute[73078]:   </features>
Aug 14 18:13:42 user nova-compute[73078]:   <cpu mode='custom' match='exact' check='full'>
Aug 14 18:13:42 user nova-compute[73078]:     <model fallback='forbid'>Nehalem</model>
Aug 14 18:13:42 user nova-compute[73078]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 14 18:13:42 user nova-compute[73078]:     <feature policy='require' name='vme'/>
Aug 14 18:13:42 user nova-compute[73078]:     <feature policy='require' name='x2apic'/>
Aug 14 18:13:42 user nova-compute[73078]:     <feature policy='require' name='hypervisor'/>
Aug 14 18:13:42 user nova-compute[73078]:   </cpu>
Aug 14 18:13:42 user nova-compute[73078]:   <clock offset='utc'>
Aug 14 18:13:42 user nova-compute[73078]:     <timer name='pit' tickpolicy='delay'/>
Aug 14 18:13:42 user nova-compute[73078]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 14 18:13:42 user nova-compute[73078]:     <timer name='hpet' present='no'/>
Aug 14 18:13:42 user nova-compute[73078]:   </clock>
Aug 14 18:13:42 user nova-compute[73078]:   <on_poweroff>destroy</on_poweroff>
Aug 14 18:13:42 user nova-compute[73078]:   <on_reboot>restart</on_reboot>
Aug 14 18:13:42 user nova-compute[73078]:   <on_crash>destroy</on_crash>
Aug 14 18:13:42 user nova-compute[73078]:   <devices>
Aug 14 18:13:42 user nova-compute[73078]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 14 18:13:42 user nova-compute[73078]:     <disk type='file' device='disk'>
Aug 14 18:13:42 user nova-compute[73078]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 14 18:13:42 user nova-compute[73078]:       <source file='/opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/disk' index='2'/>
Aug 14 18:13:42 user nova-compute[73078]:       <backingStore type='file' index='3'>
Aug 14 18:13:42 user nova-compute[73078]:         <format type='raw'/>
Aug 14 18:13:42 user nova-compute[73078]:         <source file='/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd'/>
Aug 14 18:13:42 user nova-compute[73078]:         <backingStore/>
Aug 14 18:13:42 user nova-compute[73078]:       </backingStore>
Aug 14 18:13:42 user nova-compute[73078]:       <target dev='vda' bus='virtio'/>
Aug 14 18:13:42 user nova-compute[73078]:       <alias name='virtio-disk0'/>
Aug 14 18:13:42 user nova-compute[73078]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 14 18:13:42 user nova-compute[73078]:     </disk>
Aug 14 18:13:42 user nova-compute[73078]:     <disk type='file' device='cdrom'>
Aug 14 18:13:42 user nova-compute[73078]:       <driver name='qemu' type='raw' cache='none'/>
Aug 14 18:13:42 user nova-compute[73078]:       <source file='/opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/disk.config' index='1'/>
Aug 14 18:13:42 user nova-compute[73078]:       <backingStore/>
Aug 14 18:13:42 user nova-compute[73078]:       <target dev='hda' bus='ide'/>
Aug 14 18:13:42 user nova-compute[73078]:       <readonly/>
Aug 14 18:13:42 user nova-compute[73078]:       <alias name='ide0-0-0'/>
Aug 14 18:13:42 user nova-compute[73078]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 14 18:13:42 user nova-compute[73078]:     </disk>
Aug 14 18:13:42 user nova-compute[73078]:     <controller type='usb' index='0' model='none'>
Aug 14 18:13:42 user nova-compute[73078]:       <alias name='usb'/>
Aug 14 18:13:42 user nova-compute[73078]:     </controller>
Aug 14 18:13:42 user nova-compute[73078]:     <controller type='pci' index='0' model='pci-root'>
Aug 14 18:13:42 user nova-compute[73078]:       <alias name='pci.0'/>
Aug 14 18:13:42 user nova-compute[73078]:     </controller>
Aug 14 18:13:42 user nova-compute[73078]:     <controller type='ide' index='0'>
Aug 14 18:13:42 user nova-compute[73078]:       <alias name='ide'/>
Aug 14 18:13:42 user nova-compute[73078]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 14 18:13:42 user nova-compute[73078]:     </controller>
Aug 14 18:13:42 user nova-compute[73078]:     <interface type='ethernet'>
Aug 14 18:13:42 user nova-compute[73078]:       <mac address='fa:16:3e:56:c1:dd'/>
Aug 14 18:13:42 user nova-compute[73078]:       <target dev='tapb1c66b74-54'/>
Aug 14 18:13:42 user nova-compute[73078]:       <model type='virtio'/>
Aug 14 18:13:42 user nova-compute[73078]:       <mtu size='1442'/>
Aug 14 18:13:42 user nova-compute[73078]:       <alias name='net0'/>
Aug 14 18:13:42 user nova-compute[73078]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 14 18:13:42 user nova-compute[73078]:     </interface>
Aug 14 18:13:42 user nova-compute[73078]:     <serial type='pty'>
Aug 14 18:13:42 user nova-compute[73078]:       <source path='/dev/pts/10'/>
Aug 14 18:13:42 user nova-compute[73078]:       <log file='/opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/console.log' append='off'/>
Aug 14 18:13:42 user nova-compute[73078]:       <target type='isa-serial' port='0'>
Aug 14 18:13:42 user nova-compute[73078]:         <model name='isa-serial'/>
Aug 14 18:13:42 user nova-compute[73078]:       </target>
Aug 14 18:13:42 user nova-compute[73078]:       <alias name='serial0'/>
Aug 14 18:13:42 user nova-compute[73078]:     </serial>
Aug 14 18:13:42 user nova-compute[73078]:     <console type='pty' tty='/dev/pts/10'>
Aug 14 18:13:42 user nova-compute[73078]:       <source path='/dev/pts/10'/>
Aug 14 18:13:42 user nova-compute[73078]:       <log file='/opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/console.log' append='off'/>
Aug 14 18:13:42 user nova-compute[73078]:       <target type='serial' port='0'/>
Aug 14 18:13:42 user nova-compute[73078]:       <alias name='serial0'/>
Aug 14 18:13:42 user nova-compute[73078]:     </console>
Aug 14 18:13:42 user nova-compute[73078]:     <input type='mouse' bus='ps2'>
Aug 14 18:13:42 user nova-compute[73078]:       <alias name='input0'/>
Aug 14 18:13:42 user nova-compute[73078]:     </input>
Aug 14 18:13:42 user nova-compute[73078]:     <input type='keyboard' bus='ps2'>
Aug 14 18:13:42 user nova-compute[73078]:       <alias name='input1'/>
Aug 14 18:13:42 user nova-compute[73078]:     </input>
Aug 14 18:13:42 user nova-compute[73078]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Aug 14 18:13:42 user nova-compute[73078]:       <listen type='address' address='0.0.0.0'/>
Aug 14 18:13:42 user nova-compute[73078]:     </graphics>
Aug 14 18:13:42 user nova-compute[73078]:     <audio id='1' type='none'/>
Aug 14 18:13:42 user nova-compute[73078]:     <video>
Aug 14 18:13:42 user nova-compute[73078]:       <model type='virtio' heads='1' primary='yes'/>
Aug 14 18:13:42 user nova-compute[73078]:       <alias name='video0'/>
Aug 14 18:13:42 user nova-compute[73078]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 14 18:13:42 user nova-compute[73078]:     </video>
Aug 14 18:13:42 user nova-compute[73078]:     <memballoon model='virtio'>
Aug 14 18:13:42 user nova-compute[73078]:       <stats period='10'/>
Aug 14 18:13:42 user nova-compute[73078]:       <alias name='balloon0'/>
Aug 14 18:13:42 user nova-compute[73078]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 14 18:13:42 user nova-compute[73078]:     </memballoon>
Aug 14 18:13:42 user nova-compute[73078]:     <rng model='virtio'>
Aug 14 18:13:42 user nova-compute[73078]:       <backend model='random'>/dev/urandom</backend>
Aug 14 18:13:42 user nova-compute[73078]:       <alias name='rng0'/>
Aug 14 18:13:42 user nova-compute[73078]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 14 18:13:42 user nova-compute[73078]:     </rng>
Aug 14 18:13:42 user nova-compute[73078]:   </devices>
Aug 14 18:13:42 user nova-compute[73078]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 14 18:13:42 user nova-compute[73078]:     <label>libvirt-ad1d1145-1a70-4a9c-b563-6bda437dc0cc</label>
Aug 14 18:13:42 user nova-compute[73078]:     <imagelabel>libvirt-ad1d1145-1a70-4a9c-b563-6bda437dc0cc</imagelabel>
Aug 14 18:13:42 user nova-compute[73078]:   </seclabel>
Aug 14 18:13:42 user nova-compute[73078]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 14 18:13:42 user nova-compute[73078]:     <label>+64055:+108</label>
Aug 14 18:13:42 user nova-compute[73078]:     <imagelabel>+64055:+108</imagelabel>
Aug 14 18:13:42 user nova-compute[73078]:   </seclabel>
Aug 14 18:13:42 user nova-compute[73078]: </domain>
Aug 14 18:13:42 user nova-compute[73078]:  {{(pid=73078) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 14 18:13:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [req-93f2da73-367e-42f8-8540-591961c5bcbb req-35739d82-f817-409d-9f4f-ba49369d5549 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9a:79:fc"/><model type="virtio"/><mtu size="1442"/><target dev="tap4c971778-a3"/></interface> {{(pid=73078) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 14 18:13:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [req-93f2da73-367e-42f8-8540-591961c5bcbb req-35739d82-f817-409d-9f4f-ba49369d5549 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9a:79:fc"/><model type="virtio"/><mtu size="1442"/><target dev="tap4c971778-a3"/></interface>not found in domain: <domain type='kvm' id='11'>
Aug 14 18:13:42 user nova-compute[73078]:   <name>instance-0000000a</name>
Aug 14 18:13:42 user nova-compute[73078]:   <uuid>ad1d1145-1a70-4a9c-b563-6bda437dc0cc</uuid>
Aug 14 18:13:42 user nova-compute[73078]:   <metadata>
Aug 14 18:13:42 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:13:42 user nova-compute[73078]:   <nova:package version="0.0.0"/>
Aug 14 18:13:42 user nova-compute[73078]:   <nova:name>tempest-device-tagging-server-954582950</nova:name>
Aug 14 18:13:42 user nova-compute[73078]:   <nova:creationTime>2023-08-14 18:13:41</nova:creationTime>
Aug 14 18:13:42 user nova-compute[73078]:   <nova:flavor name="m1.tiny">
Aug 14 18:13:42 user nova-compute[73078]:     <nova:memory>512</nova:memory>
Aug 14 18:13:42 user nova-compute[73078]:     <nova:disk>1</nova:disk>
Aug 14 18:13:42 user nova-compute[73078]:     <nova:swap>0</nova:swap>
Aug 14 18:13:42 user nova-compute[73078]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:13:42 user nova-compute[73078]:     <nova:vcpus>1</nova:vcpus>
Aug 14 18:13:42 user nova-compute[73078]:   </nova:flavor>
Aug 14 18:13:42 user nova-compute[73078]:   <nova:owner>
Aug 14 18:13:42 user nova-compute[73078]:     <nova:user uuid="218142bc464f4083b053a755d818afca">tempest-TaggedAttachmentsTest-1236088660-project-member</nova:user>
Aug 14 18:13:42 user nova-compute[73078]:     <nova:project uuid="a49a3016859146b4b30ae80e5fae6e31">tempest-TaggedAttachmentsTest-1236088660</nova:project>
Aug 14 18:13:42 user nova-compute[73078]:   </nova:owner>
Aug 14 18:13:42 user nova-compute[73078]:   <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:13:42 user nova-compute[73078]:   <nova:ports>
Aug 14 18:13:42 user nova-compute[73078]:     <nova:port uuid="b1c66b74-5403-4bfb-9826-7d95c1e92356">
Aug 14 18:13:42 user nova-compute[73078]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 18:13:42 user nova-compute[73078]:     </nova:port>
Aug 14 18:13:42 user nova-compute[73078]:   </nova:ports>
Aug 14 18:13:42 user nova-compute[73078]: </nova:instance>
Aug 14 18:13:42 user nova-compute[73078]:   </metadata>
Aug 14 18:13:42 user nova-compute[73078]:   <memory unit='KiB'>524288</memory>
Aug 14 18:13:42 user nova-compute[73078]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 14 18:13:42 user nova-compute[73078]:   <vcpu placement='static'>1</vcpu>
Aug 14 18:13:42 user nova-compute[73078]:   <resource>
Aug 14 18:13:42 user nova-compute[73078]:     <partition>/machine</partition>
Aug 14 18:13:42 user nova-compute[73078]:   </resource>
Aug 14 18:13:42 user nova-compute[73078]:   <sysinfo type='smbios'>
Aug 14 18:13:42 user nova-compute[73078]:     <system>
Aug 14 18:13:42 user nova-compute[73078]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 14 18:13:42 user nova-compute[73078]:       <entry name='product'>OpenStack Nova</entry>
Aug 14 18:13:42 user nova-compute[73078]:       <entry name='version'>0.0.0</entry>
Aug 14 18:13:42 user nova-compute[73078]:       <entry name='serial'>ad1d1145-1a70-4a9c-b563-6bda437dc0cc</entry>
Aug 14 18:13:42 user nova-compute[73078]:       <entry name='uuid'>ad1d1145-1a70-4a9c-b563-6bda437dc0cc</entry>
Aug 14 18:13:42 user nova-compute[73078]:       <entry name='family'>Virtual Machine</entry>
Aug 14 18:13:42 user nova-compute[73078]:     </system>
Aug 14 18:13:42 user nova-compute[73078]:   </sysinfo>
Aug 14 18:13:42 user nova-compute[73078]:   <os>
Aug 14 18:13:42 user nova-compute[73078]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 14 18:13:42 user nova-compute[73078]:     <boot dev='hd'/>
Aug 14 18:13:42 user nova-compute[73078]:     <smbios mode='sysinfo'/>
Aug 14 18:13:42 user nova-compute[73078]:   </os>
Aug 14 18:13:42 user nova-compute[73078]:   <features>
Aug 14 18:13:42 user nova-compute[73078]:     <acpi/>
Aug 14 18:13:42 user nova-compute[73078]:     <apic/>
Aug 14 18:13:42 user nova-compute[73078]:     <vmcoreinfo state='on'/>
Aug 14 18:13:42 user nova-compute[73078]:   </features>
Aug 14 18:13:42 user nova-compute[73078]:   <cpu mode='custom' match='exact' check='full'>
Aug 14 18:13:42 user nova-compute[73078]:     <model fallback='forbid'>Nehalem</model>
Aug 14 18:13:42 user nova-compute[73078]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 14 18:13:42 user nova-compute[73078]:     <feature policy='require' name='vme'/>
Aug 14 18:13:42 user nova-compute[73078]:     <feature policy='require' name='x2apic'/>
Aug 14 18:13:42 user nova-compute[73078]:     <feature policy='require' name='hypervisor'/>
Aug 14 18:13:42 user nova-compute[73078]:   </cpu>
Aug 14 18:13:42 user nova-compute[73078]:   <clock offset='utc'>
Aug 14 18:13:42 user nova-compute[73078]:     <timer name='pit' tickpolicy='delay'/>
Aug 14 18:13:42 user nova-compute[73078]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 14 18:13:42 user nova-compute[73078]:     <timer name='hpet' present='no'/>
Aug 14 18:13:42 user nova-compute[73078]:   </clock>
Aug 14 18:13:42 user nova-compute[73078]:   <on_poweroff>destroy</on_poweroff>
Aug 14 18:13:42 user nova-compute[73078]:   <on_reboot>restart</on_reboot>
Aug 14 18:13:42 user nova-compute[73078]:   <on_crash>destroy</on_crash>
Aug 14 18:13:42 user nova-compute[73078]:   <devices>
Aug 14 18:13:42 user nova-compute[73078]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 14 18:13:42 user nova-compute[73078]:     <disk type='file' device='disk'>
Aug 14 18:13:42 user nova-compute[73078]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 14 18:13:42 user nova-compute[73078]:       <source file='/opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/disk' index='2'/>
Aug 14 18:13:42 user nova-compute[73078]:       <backingStore type='file' index='3'>
Aug 14 18:13:42 user nova-compute[73078]:         <format type='raw'/>
Aug 14 18:13:42 user nova-compute[73078]:         <source file='/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd'/>
Aug 14 18:13:42 user nova-compute[73078]:         <backingStore/>
Aug 14 18:13:42 user nova-compute[73078]:       </backingStore>
Aug 14 18:13:42 user nova-compute[73078]:       <target dev='vda' bus='virtio'/>
Aug 14 18:13:42 user nova-compute[73078]:       <alias name='virtio-disk0'/>
Aug 14 18:13:42 user nova-compute[73078]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 14 18:13:42 user nova-compute[73078]:     </disk>
Aug 14 18:13:42 user nova-compute[73078]:     <disk type='file' device='cdrom'>
Aug 14 18:13:42 user nova-compute[73078]:       <driver name='qemu' type='raw' cache='none'/>
Aug 14 18:13:42 user nova-compute[73078]:       <source file='/opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/disk.config' index='1'/>
Aug 14 18:13:42 user nova-compute[73078]:       <backingStore/>
Aug 14 18:13:42 user nova-compute[73078]:       <target dev='hda' bus='ide'/>
Aug 14 18:13:42 user nova-compute[73078]:       <readonly/>
Aug 14 18:13:42 user nova-compute[73078]:       <alias name='ide0-0-0'/>
Aug 14 18:13:42 user nova-compute[73078]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 14 18:13:42 user nova-compute[73078]:     </disk>
Aug 14 18:13:42 user nova-compute[73078]:     <controller type='usb' index='0' model='none'>
Aug 14 18:13:42 user nova-compute[73078]:       <alias name='usb'/>
Aug 14 18:13:42 user nova-compute[73078]:     </controller>
Aug 14 18:13:42 user nova-compute[73078]:     <controller type='pci' index='0' model='pci-root'>
Aug 14 18:13:42 user nova-compute[73078]:       <alias name='pci.0'/>
Aug 14 18:13:42 user nova-compute[73078]:     </controller>
Aug 14 18:13:42 user nova-compute[73078]:     <controller type='ide' index='0'>
Aug 14 18:13:42 user nova-compute[73078]:       <alias name='ide'/>
Aug 14 18:13:42 user nova-compute[73078]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 14 18:13:42 user nova-compute[73078]:     </controller>
Aug 14 18:13:42 user nova-compute[73078]:     <interface type='ethernet'>
Aug 14 18:13:42 user nova-compute[73078]:       <mac address='fa:16:3e:56:c1:dd'/>
Aug 14 18:13:42 user nova-compute[73078]:       <target dev='tapb1c66b74-54'/>
Aug 14 18:13:42 user nova-compute[73078]:       <model type='virtio'/>
Aug 14 18:13:42 user nova-compute[73078]:       <mtu size='1442'/>
Aug 14 18:13:42 user nova-compute[73078]:       <alias name='net0'/>
Aug 14 18:13:42 user nova-compute[73078]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 14 18:13:42 user nova-compute[73078]:     </interface>
Aug 14 18:13:42 user nova-compute[73078]:     <serial type='pty'>
Aug 14 18:13:42 user nova-compute[73078]:       <source path='/dev/pts/10'/>
Aug 14 18:13:42 user nova-compute[73078]:       <log file='/opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/console.log' append='off'/>
Aug 14 18:13:42 user nova-compute[73078]:       <target type='isa-serial' port='0'>
Aug 14 18:13:42 user nova-compute[73078]:         <model name='isa-serial'/>
Aug 14 18:13:42 user nova-compute[73078]:       </target>
Aug 14 18:13:42 user nova-compute[73078]:       <alias name='serial0'/>
Aug 14 18:13:42 user nova-compute[73078]:     </serial>
Aug 14 18:13:42 user nova-compute[73078]:     <console type='pty' tty='/dev/pts/10'>
Aug 14 18:13:42 user nova-compute[73078]:       <source path='/dev/pts/10'/>
Aug 14 18:13:42 user nova-compute[73078]:       <log file='/opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/console.log' append='off'/>
Aug 14 18:13:42 user nova-compute[73078]:       <target type='serial' port='0'/>
Aug 14 18:13:42 user nova-compute[73078]:       <alias name='serial0'/>
Aug 14 18:13:42 user nova-compute[73078]:     </console>
Aug 14 18:13:42 user nova-compute[73078]:     <input type='mouse' bus='ps2'>
Aug 14 18:13:42 user nova-compute[73078]:       <alias name='input0'/>
Aug 14 18:13:42 user nova-compute[73078]:     </input>
Aug 14 18:13:42 user nova-compute[73078]:     <input type='keyboard' bus='ps2'>
Aug 14 18:13:42 user nova-compute[73078]:       <alias name='input1'/>
Aug 14 18:13:42 user nova-compute[73078]:     </input>
Aug 14 18:13:42 user nova-compute[73078]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Aug 14 18:13:42 user nova-compute[73078]:       <listen type='address' address='0.0.0.0'/>
Aug 14 18:13:42 user nova-compute[73078]:     </graphics>
Aug 14 18:13:42 user nova-compute[73078]:     <audio id='1' type='none'/>
Aug 14 18:13:42 user nova-compute[73078]:     <video>
Aug 14 18:13:42 user nova-compute[73078]:       <model type='virtio' heads='1' primary='yes'/>
Aug 14 18:13:42 user nova-compute[73078]:       <alias name='video0'/>
Aug 14 18:13:42 user nova-compute[73078]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 14 18:13:42 user nova-compute[73078]:     </video>
Aug 14 18:13:42 user nova-compute[73078]:     <memballoon model='virtio'>
Aug 14 18:13:42 user nova-compute[73078]:       <stats period='10'/>
Aug 14 18:13:42 user nova-compute[73078]:       <alias name='balloon0'/>
Aug 14 18:13:42 user nova-compute[73078]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 14 18:13:42 user nova-compute[73078]:     </memballoon>
Aug 14 18:13:42 user nova-compute[73078]:     <rng model='virtio'>
Aug 14 18:13:42 user nova-compute[73078]:       <backend model='random'>/dev/urandom</backend>
Aug 14 18:13:42 user nova-compute[73078]:       <alias name='rng0'/>
Aug 14 18:13:42 user nova-compute[73078]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 14 18:13:42 user nova-compute[73078]:     </rng>
Aug 14 18:13:42 user nova-compute[73078]:   </devices>
Aug 14 18:13:42 user nova-compute[73078]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 14 18:13:42 user nova-compute[73078]:     <label>libvirt-ad1d1145-1a70-4a9c-b563-6bda437dc0cc</label>
Aug 14 18:13:42 user nova-compute[73078]:     <imagelabel>libvirt-ad1d1145-1a70-4a9c-b563-6bda437dc0cc</imagelabel>
Aug 14 18:13:42 user nova-compute[73078]:   </seclabel>
Aug 14 18:13:42 user nova-compute[73078]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 14 18:13:42 user nova-compute[73078]:     <label>+64055:+108</label>
Aug 14 18:13:42 user nova-compute[73078]:     <imagelabel>+64055:+108</imagelabel>
Aug 14 18:13:42 user nova-compute[73078]:   </seclabel>
Aug 14 18:13:42 user nova-compute[73078]: </domain>
Aug 14 18:13:42 user nova-compute[73078]:  {{(pid=73078) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 14 18:13:42 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [req-93f2da73-367e-42f8-8540-591961c5bcbb req-35739d82-f817-409d-9f4f-ba49369d5549 service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Detaching interface fa:16:3e:9a:79:fc failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap4c971778-a3' not found.
Aug 14 18:13:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [req-93f2da73-367e-42f8-8540-591961c5bcbb req-35739d82-f817-409d-9f4f-ba49369d5549 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:11:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-954582950',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-954582950',id=10,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoZf8Rqz7EiN0P+Qjv1ph9KYV+Un7MKTbl1dwK14KSEc1xx5BX1LfWxWzRq6aPqPl/92nhScUmx3GJQuV5xlN5gzpJdNxWJ8eHGLQ/HA+DwQ8SXejqjnnPB+yC1+OGwhQ==',key_name='tempest-keypair-1334960197',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:11:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a49a3016859146b4b30ae80e5fae6e31',ramdisk_id='',reservation_id='r-cn5ox3sk',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1236088660',owner_user_name='tempest-TaggedAttachmentsTest-1236088660-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:11:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='218142bc464f4083b053a755d818afca',uuid=ad1d1145-1a70-4a9c-b563-6bda437dc0cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c971778-a364-4f56-a33e-4cdc2c28cecb", "address": "fa:16:3e:9a:79:fc", "network": {"id": "2f1f148b-226f-47ff-9de6-be8487c133c4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-486282127", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a49a3016859146b4b30ae80e5fae6e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c971778-a3", "ovs_interfaceid": "4c971778-a364-4f56-a33e-4cdc2c28cecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:13:42 user nova-compute[73078]: DEBUG nova.network.os_vif_util [req-93f2da73-367e-42f8-8540-591961c5bcbb req-35739d82-f817-409d-9f4f-ba49369d5549 service nova] Converting VIF {"id": "4c971778-a364-4f56-a33e-4cdc2c28cecb", "address": "fa:16:3e:9a:79:fc", "network": {"id": "2f1f148b-226f-47ff-9de6-be8487c133c4", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-486282127", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a49a3016859146b4b30ae80e5fae6e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c971778-a3", "ovs_interfaceid": "4c971778-a364-4f56-a33e-4cdc2c28cecb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:13:42 user nova-compute[73078]: DEBUG nova.network.os_vif_util [req-93f2da73-367e-42f8-8540-591961c5bcbb req-35739d82-f817-409d-9f4f-ba49369d5549 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:79:fc,bridge_name='br-int',has_traffic_filtering=True,id=4c971778-a364-4f56-a33e-4cdc2c28cecb,network=Network(2f1f148b-226f-47ff-9de6-be8487c133c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c971778-a3') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:13:42 user nova-compute[73078]: DEBUG os_vif [req-93f2da73-367e-42f8-8540-591961c5bcbb req-35739d82-f817-409d-9f4f-ba49369d5549 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:79:fc,bridge_name='br-int',has_traffic_filtering=True,id=4c971778-a364-4f56-a33e-4cdc2c28cecb,network=Network(2f1f148b-226f-47ff-9de6-be8487c133c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c971778-a3') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:13:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c971778-a3, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:13:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:13:42 user nova-compute[73078]: INFO os_vif [req-93f2da73-367e-42f8-8540-591961c5bcbb req-35739d82-f817-409d-9f4f-ba49369d5549 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:79:fc,bridge_name='br-int',has_traffic_filtering=True,id=4c971778-a364-4f56-a33e-4cdc2c28cecb,network=Network(2f1f148b-226f-47ff-9de6-be8487c133c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c971778-a3')
Aug 14 18:13:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [req-93f2da73-367e-42f8-8540-591961c5bcbb req-35739d82-f817-409d-9f4f-ba49369d5549 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:13:42 user nova-compute[73078]:   <nova:package version="0.0.0"/>
Aug 14 18:13:42 user nova-compute[73078]:   <nova:name>tempest-device-tagging-server-954582950</nova:name>
Aug 14 18:13:42 user nova-compute[73078]:   <nova:creationTime>2023-08-14 18:13:42</nova:creationTime>
Aug 14 18:13:42 user nova-compute[73078]:   <nova:flavor name="m1.tiny">
Aug 14 18:13:42 user nova-compute[73078]:     <nova:memory>512</nova:memory>
Aug 14 18:13:42 user nova-compute[73078]:     <nova:disk>1</nova:disk>
Aug 14 18:13:42 user nova-compute[73078]:     <nova:swap>0</nova:swap>
Aug 14 18:13:42 user nova-compute[73078]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:13:42 user nova-compute[73078]:     <nova:vcpus>1</nova:vcpus>
Aug 14 18:13:42 user nova-compute[73078]:   </nova:flavor>
Aug 14 18:13:42 user nova-compute[73078]:   <nova:owner>
Aug 14 18:13:42 user nova-compute[73078]:     <nova:user uuid="218142bc464f4083b053a755d818afca">tempest-TaggedAttachmentsTest-1236088660-project-member</nova:user>
Aug 14 18:13:42 user nova-compute[73078]:     <nova:project uuid="a49a3016859146b4b30ae80e5fae6e31">tempest-TaggedAttachmentsTest-1236088660</nova:project>
Aug 14 18:13:42 user nova-compute[73078]:   </nova:owner>
Aug 14 18:13:42 user nova-compute[73078]:   <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:13:42 user nova-compute[73078]:   <nova:ports>
Aug 14 18:13:42 user nova-compute[73078]:     <nova:port uuid="b1c66b74-5403-4bfb-9826-7d95c1e92356">
Aug 14 18:13:42 user nova-compute[73078]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 18:13:42 user nova-compute[73078]:     </nova:port>
Aug 14 18:13:42 user nova-compute[73078]:   </nova:ports>
Aug 14 18:13:42 user nova-compute[73078]: </nova:instance>
Aug 14 18:13:42 user nova-compute[73078]:  {{(pid=73078) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 14 18:13:42 user nova-compute[73078]: DEBUG nova.network.neutron [None req-93c10dd4-1ef2-4724-adff-8f44cb8450ea tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Updating instance_info_cache with network_info: [{"id": "b1c66b74-5403-4bfb-9826-7d95c1e92356", "address": "fa:16:3e:56:c1:dd", "network": {"id": "371d3de4-ece5-41b8-8adc-277ac218f7ee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1480740037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a49a3016859146b4b30ae80e5fae6e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c66b74-54", "ovs_interfaceid": "b1c66b74-5403-4bfb-9826-7d95c1e92356", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:13:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-93c10dd4-1ef2-4724-adff-8f44cb8450ea tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Releasing lock "refresh_cache-ad1d1145-1a70-4a9c-b563-6bda437dc0cc" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:13:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-93c10dd4-1ef2-4724-adff-8f44cb8450ea tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lock "interface-ad1d1145-1a70-4a9c-b563-6bda437dc0cc-4c971778-a364-4f56-a33e-4cdc2c28cecb" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.359s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:43 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:13:43 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:13:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-1f88cb97-4f22-439e-99f2-d7cb8d5aff36" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:13:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-1f88cb97-4f22-439e-99f2-d7cb8d5aff36" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:13:43 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:13:43 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Updating instance_info_cache with network_info: [{"id": "8df77a26-faab-47ca-a39b-3df6930cd1d5", "address": "fa:16:3e:2d:25:52", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df77a26-fa", "ovs_interfaceid": "8df77a26-faab-47ca-a39b-3df6930cd1d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:13:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-1f88cb97-4f22-439e-99f2-d7cb8d5aff36" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:13:43 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:13:43 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:13:43 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:13:44 user nova-compute[73078]: DEBUG nova.compute.manager [req-56766604-aea5-4883-bcfc-088a5147235a req-eae9671a-6e7d-4b99-945b-39f96d1613a7 service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Received event network-vif-plugged-4c971778-a364-4f56-a33e-4cdc2c28cecb {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:13:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-56766604-aea5-4883-bcfc-088a5147235a req-eae9671a-6e7d-4b99-945b-39f96d1613a7 service nova] Acquiring lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-56766604-aea5-4883-bcfc-088a5147235a req-eae9671a-6e7d-4b99-945b-39f96d1613a7 service nova] Lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-56766604-aea5-4883-bcfc-088a5147235a req-eae9671a-6e7d-4b99-945b-39f96d1613a7 service nova] Lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:44 user nova-compute[73078]: DEBUG nova.compute.manager [req-56766604-aea5-4883-bcfc-088a5147235a req-eae9671a-6e7d-4b99-945b-39f96d1613a7 service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] No waiting events found dispatching network-vif-plugged-4c971778-a364-4f56-a33e-4cdc2c28cecb {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:13:44 user nova-compute[73078]: WARNING nova.compute.manager [req-56766604-aea5-4883-bcfc-088a5147235a req-eae9671a-6e7d-4b99-945b-39f96d1613a7 service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Received unexpected event network-vif-plugged-4c971778-a364-4f56-a33e-4cdc2c28cecb for instance with vm_state active and task_state None.
Aug 14 18:13:44 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:13:44 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:13:44 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:13:44 user nova-compute[73078]: DEBUG nova.compute.manager [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYEAXIqK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e8ad453e-67b1-4af2-b85b-a5e100c11446', 'attached_at': '', 'detached_at': '', 'volume_id': '7a3e2365-55ce-4728-b393-6e4f54b4bdd6', 'serial': '7a3e2365-55ce-4728-b393-6e4f54b4bdd6'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvGxCsnN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'e8ad453e-67b1-4af2-b85b-a5e100c11446', 'attached_at': '', 'detached_at': '', 'volume_id': '1f1e39c8-a854-4ecb-bdf4-e974597b7db7', 'serial'} {{(pid=73078) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 14 18:13:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:13:44 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYEAXIqK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:13:44 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:13:44 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:13:44 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:13:44 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:13:44 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:13:44 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:13:44 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:13:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[77eb42bb-6590-4d3b-8bea-9538c4d775ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:13:45 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de71a9a-b73d-4591-896e-a556c7367417]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6] added
Aug 14 18:13:45 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb36cee-11d9-4b52-a6c1-295db76b535e]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a12394-43ad-4622-aba9-f4e91f2d48ed]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hYEAXIqK {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hYEAXIqK" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d03311c-4bf8-411e-b6d4-30512718c64d]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hYEAXIqK'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe15a8f-0c36-487a-bda5-7cb454c34578]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac77bb9-1d62-4957-9a7f-6b7722d2a014]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:13:45 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:13:45 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:13:45 user nova-compute[73078]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 (non-flash)
Aug 14 18:13:45 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:13:45 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:13:45 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:13:45 user nova-compute[73078]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 (non-flash)
Aug 14 18:13:45 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb67a43-579b-46a2-a424-79b09afe8897]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6, portal: 172.16.0.220,3260]
Aug 14 18:13:45 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6, portal: 172.16.0.220,3260] successful.
Aug 14 18:13:45 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b73282-4ca5-4012-86a4-449744992eec]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c581f99-70a6-40ee-a880-363e27d9c4df]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6 (non-flash)
Aug 14 18:13:45 user nova-compute[73078]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:13:45 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:13:45 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:13:45 user nova-compute[73078]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 (non-flash)
Aug 14 18:13:45 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6 (non-flash)
Aug 14 18:13:45 user nova-compute[73078]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:13:45 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:13:45 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:13:45 user nova-compute[73078]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 (non-flash)
Aug 14 18:13:45 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] HCTL ('37', '-', '-', 0) found on session 11 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa46315a-402e-4f2b-b69c-79214a0dade3]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Searching for a device in session 11 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYEAXIqK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b97b330e-7a72-4d3c-8810-98a4f3a27ce7/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b97b330e-7a72-4d3c-8810-98a4f3a27ce7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b97b330e-7a72-4d3c-8810-98a4f3a27ce7/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:46 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:13:46 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23538373331373862', 'path': '/dev/sdf'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:13:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538373331373862', 'path': '/dev/sdf'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:13:46 user nova-compute[73078]: DEBUG nova.objects.instance [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Lazy-loading 'flavor' on Instance uuid e8ad453e-67b1-4af2-b85b-a5e100c11446 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:13:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b97b330e-7a72-4d3c-8810-98a4f3a27ce7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73078) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 18:13:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:47 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] COPY block job progress, current cursor: 188743680 final cursor: 1073741824 {{(pid=73078) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 18:13:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json" returned: 0 in 0.266s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:47 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] COPY block job progress, current cursor: 373293056 final cursor: 1073741824 {{(pid=73078) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 18:13:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ef78e898-48fa-437d-8c91-7b6f6a3b20fa tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Acquiring lock "d5d44771-7499-43ac-972a-22b9d9fd6840" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ef78e898-48fa-437d-8c91-7b6f6a3b20fa tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lock "d5d44771-7499-43ac-972a-22b9d9fd6840" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ef78e898-48fa-437d-8c91-7b6f6a3b20fa tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Acquiring lock "d5d44771-7499-43ac-972a-22b9d9fd6840-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ef78e898-48fa-437d-8c91-7b6f6a3b20fa tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lock "d5d44771-7499-43ac-972a-22b9d9fd6840-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ef78e898-48fa-437d-8c91-7b6f6a3b20fa tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lock "d5d44771-7499-43ac-972a-22b9d9fd6840-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:47 user nova-compute[73078]: INFO nova.compute.manager [None req-ef78e898-48fa-437d-8c91-7b6f6a3b20fa tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Terminating instance
Aug 14 18:13:47 user nova-compute[73078]: DEBUG nova.compute.manager [None req-ef78e898-48fa-437d-8c91-7b6f6a3b20fa tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:13:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:48 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] COPY block job progress, current cursor: 528482304 final cursor: 1073741824 {{(pid=73078) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 18:13:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d44771-7499-43ac-972a-22b9d9fd6840/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:48 user nova-compute[73078]: DEBUG nova.compute.manager [req-74feea2b-3dbf-4204-8ffa-c4b4f2ff425f req-fb41bdcc-3185-4e99-9eeb-9fafaa21bc48 service nova] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Received event network-vif-unplugged-37e13a55-0707-43d4-ab51-064fe38c2377 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:13:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-74feea2b-3dbf-4204-8ffa-c4b4f2ff425f req-fb41bdcc-3185-4e99-9eeb-9fafaa21bc48 service nova] Acquiring lock "d5d44771-7499-43ac-972a-22b9d9fd6840-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-74feea2b-3dbf-4204-8ffa-c4b4f2ff425f req-fb41bdcc-3185-4e99-9eeb-9fafaa21bc48 service nova] Lock "d5d44771-7499-43ac-972a-22b9d9fd6840-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-74feea2b-3dbf-4204-8ffa-c4b4f2ff425f req-fb41bdcc-3185-4e99-9eeb-9fafaa21bc48 service nova] Lock "d5d44771-7499-43ac-972a-22b9d9fd6840-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:48 user nova-compute[73078]: DEBUG nova.compute.manager [req-74feea2b-3dbf-4204-8ffa-c4b4f2ff425f req-fb41bdcc-3185-4e99-9eeb-9fafaa21bc48 service nova] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] No waiting events found dispatching network-vif-unplugged-37e13a55-0707-43d4-ab51-064fe38c2377 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:13:48 user nova-compute[73078]: DEBUG nova.compute.manager [req-74feea2b-3dbf-4204-8ffa-c4b4f2ff425f req-fb41bdcc-3185-4e99-9eeb-9fafaa21bc48 service nova] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Received event network-vif-unplugged-37e13a55-0707-43d4-ab51-064fe38c2377 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:13:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d44771-7499-43ac-972a-22b9d9fd6840/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d44771-7499-43ac-972a-22b9d9fd6840/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d44771-7499-43ac-972a-22b9d9fd6840/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:48 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] COPY block job progress, current cursor: 662700032 final cursor: 1073741824 {{(pid=73078) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 18:13:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8ad453e-67b1-4af2-b85b-a5e100c11446/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:48 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Instance destroyed successfully.
Aug 14 18:13:48 user nova-compute[73078]: DEBUG nova.objects.instance [None req-ef78e898-48fa-437d-8c91-7b6f6a3b20fa tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lazy-loading 'resources' on Instance uuid d5d44771-7499-43ac-972a-22b9d9fd6840 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:13:48 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-ef78e898-48fa-437d-8c91-7b6f6a3b20fa tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:11:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1982726398',display_name='tempest-VolumesActionsTest-instance-1982726398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1982726398',id=12,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:12:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eed80f7f96d14ae490e428db42e1f6f3',ramdisk_id='',reservation_id='r-4len85c6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1155799078',owner_user_name='tempest-VolumesActionsTest-1155799078-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:12:04Z,user_data=None,user_id='31255ab4abf34860a048d6f74033c64c',uuid=d5d44771-7499-43ac-972a-22b9d9fd6840,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37e13a55-0707-43d4-ab51-064fe38c2377", "address": "fa:16:3e:92:2c:35", "network": {"id": "747446a8-4755-480b-a3b1-44648769bb00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1534750515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed80f7f96d14ae490e428db42e1f6f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e13a55-07", "ovs_interfaceid": "37e13a55-0707-43d4-ab51-064fe38c2377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:13:48 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-ef78e898-48fa-437d-8c91-7b6f6a3b20fa tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Converting VIF {"id": "37e13a55-0707-43d4-ab51-064fe38c2377", "address": "fa:16:3e:92:2c:35", "network": {"id": "747446a8-4755-480b-a3b1-44648769bb00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1534750515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed80f7f96d14ae490e428db42e1f6f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e13a55-07", "ovs_interfaceid": "37e13a55-0707-43d4-ab51-064fe38c2377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:13:48 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-ef78e898-48fa-437d-8c91-7b6f6a3b20fa tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:2c:35,bridge_name='br-int',has_traffic_filtering=True,id=37e13a55-0707-43d4-ab51-064fe38c2377,network=Network(747446a8-4755-480b-a3b1-44648769bb00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e13a55-07') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:13:48 user nova-compute[73078]: DEBUG os_vif [None req-ef78e898-48fa-437d-8c91-7b6f6a3b20fa tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:2c:35,bridge_name='br-int',has_traffic_filtering=True,id=37e13a55-0707-43d4-ab51-064fe38c2377,network=Network(747446a8-4755-480b-a3b1-44648769bb00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e13a55-07') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:13:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37e13a55-07, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:13:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:13:48 user nova-compute[73078]: INFO os_vif [None req-ef78e898-48fa-437d-8c91-7b6f6a3b20fa tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:2c:35,bridge_name='br-int',has_traffic_filtering=True,id=37e13a55-0707-43d4-ab51-064fe38c2377,network=Network(747446a8-4755-480b-a3b1-44648769bb00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e13a55-07')
Aug 14 18:13:48 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-ef78e898-48fa-437d-8c91-7b6f6a3b20fa tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Deleting instance files /opt/stack/data/nova/instances/d5d44771-7499-43ac-972a-22b9d9fd6840_del
Aug 14 18:13:48 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-ef78e898-48fa-437d-8c91-7b6f6a3b20fa tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Deletion of /opt/stack/data/nova/instances/d5d44771-7499-43ac-972a-22b9d9fd6840_del complete
Aug 14 18:13:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8ad453e-67b1-4af2-b85b-a5e100c11446/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8ad453e-67b1-4af2-b85b-a5e100c11446/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:49 user nova-compute[73078]: INFO nova.compute.manager [None req-ef78e898-48fa-437d-8c91-7b6f6a3b20fa tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 14 18:13:49 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-ef78e898-48fa-437d-8c91-7b6f6a3b20fa tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:13:49 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:13:49 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:13:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8ad453e-67b1-4af2-b85b-a5e100c11446/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:13:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:13:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:13:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:13:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] COPY block job progress, current cursor: 831520768 final cursor: 1073741824 {{(pid=73078) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 18:13:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:49 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692036814.693159, 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:13:49 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] VM Stopped (Lifecycle Event)
Aug 14 18:13:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG nova.compute.manager [None req-8fb59419-c93d-485c-9762-3fcb287d5378 None None] [instance: 0a1f14c4-b5b3-43b9-97b4-1a4e176d1d2a] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG nova.compute.manager [req-0d03a82a-8baa-4f31-9964-63e265f337da req-ad01495a-e0dd-48e9-ab42-4efedad64d97 service nova] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Received event network-vif-deleted-37e13a55-0707-43d4-ab51-064fe38c2377 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:13:50 user nova-compute[73078]: INFO nova.compute.manager [req-0d03a82a-8baa-4f31-9964-63e265f337da req-ad01495a-e0dd-48e9-ab42-4efedad64d97 service nova] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Neutron deleted interface 37e13a55-0707-43d4-ab51-064fe38c2377; detaching it from the instance and deleting it from the info cache
Aug 14 18:13:50 user nova-compute[73078]: DEBUG nova.network.neutron [req-0d03a82a-8baa-4f31-9964-63e265f337da req-ad01495a-e0dd-48e9-ab42-4efedad64d97 service nova] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73078) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:13:50 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:13:50 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:13:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=6788MB free_disk=25.477691650390625GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:50 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Took 1.22 seconds to deallocate network for instance.
Aug 14 18:13:50 user nova-compute[73078]: DEBUG nova.compute.manager [req-0d03a82a-8baa-4f31-9964-63e265f337da req-ad01495a-e0dd-48e9-ab42-4efedad64d97 service nova] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Detach interface failed, port_id=37e13a55-0707-43d4-ab51-064fe38c2377, reason: Instance d5d44771-7499-43ac-972a-22b9d9fd6840 could not be found. {{(pid=73078) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ef78e898-48fa-437d-8c91-7b6f6a3b20fa tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvGxCsnN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:13:50 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:13:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[735f4157-fc95-4f1e-8d2c-1010cb430566]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG nova.compute.manager [req-3388f270-a4ba-4901-985b-da55bed3eb1d req-7fe27e84-980d-4cdf-b7d4-59ec543e14bf service nova] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Received event network-vif-plugged-37e13a55-0707-43d4-ab51-064fe38c2377 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3388f270-a4ba-4901-985b-da55bed3eb1d req-7fe27e84-980d-4cdf-b7d4-59ec543e14bf service nova] Acquiring lock "d5d44771-7499-43ac-972a-22b9d9fd6840-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3388f270-a4ba-4901-985b-da55bed3eb1d req-7fe27e84-980d-4cdf-b7d4-59ec543e14bf service nova] Lock "d5d44771-7499-43ac-972a-22b9d9fd6840-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3388f270-a4ba-4901-985b-da55bed3eb1d req-7fe27e84-980d-4cdf-b7d4-59ec543e14bf service nova] Lock "d5d44771-7499-43ac-972a-22b9d9fd6840-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG nova.compute.manager [req-3388f270-a4ba-4901-985b-da55bed3eb1d req-7fe27e84-980d-4cdf-b7d4-59ec543e14bf service nova] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] No waiting events found dispatching network-vif-plugged-37e13a55-0707-43d4-ab51-064fe38c2377 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:13:50 user nova-compute[73078]: WARNING nova.compute.manager [req-3388f270-a4ba-4901-985b-da55bed3eb1d req-7fe27e84-980d-4cdf-b7d4-59ec543e14bf service nova] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Received unexpected event network-vif-plugged-37e13a55-0707-43d4-ab51-064fe38c2377 for instance with vm_state deleted and task_state None.
Aug 14 18:13:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66dcacc-b827-4951-a354-aa40c9262440]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6 (non-flash)
Aug 14 18:13:50 user nova-compute[73078]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:13:50 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:13:50 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:13:50 user nova-compute[73078]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 (non-flash)
Aug 14 18:13:50 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6 (non-flash)
Aug 14 18:13:50 user nova-compute[73078]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:13:50 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:13:50 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:13:50 user nova-compute[73078]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 (non-flash)
Aug 14 18:13:50 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe97825a3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7'): ({'sdc'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Removing single pathed devices sdc {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance de80e188-9385-4613-8a6c-aa72b624ad55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 1f88cb97-4f22-439e-99f2-d7cb8d5aff36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 3c840309-9884-4c8a-a6ee-1acd44f32c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 24c00db3-2457-443d-b5ab-7e6ecaa57515 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance b97b330e-7a72-4d3c-8810-98a4f3a27ce7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance ad1d1145-1a70-4a9c-b563-6bda437dc0cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance e8ad453e-67b1-4af2-b85b-a5e100c11446 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance d5d44771-7499-43ac-972a-22b9d9fd6840 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[029bffe8-bce0-4b15-8e60-6c5b6c22adeb]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2ca85f-f446-484f-a5e3-de123f861cdd]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Flushing IO for device /dev/sdc {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0211877a-9b97-4513-9ecd-e2a0fa7044ba]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f180e35-cb23-4f6a-bf9b-d29cde85d64b]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] SCSI volumes sdc have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fcbfb8-6b07-4b52-a75e-e09882998cec]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d651392-3224-4563-b17b-a1be26eabc20]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7, portal: 172.16.0.220,3260]
Aug 14 18:13:50 user nova-compute[73078]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7, portal: 172.16.0.220,3260] successful.
Aug 14 18:13:50 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8c1efe-32ba-498d-8526-120a2f3a4fb5]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] <== disconnect_volume: return (320ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG nova.compute.manager [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYEAXIqK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'e8ad453e-67b1-4af2-b85b-a5e100c11446', 'attached_at': '', 'detached_at': '', 'volume_id': '7a3e2365-55ce-4728-b393-6e4f54b4bdd6', 'serial'} {{(pid=73078) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG nova.compute.manager [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] swap_volume: removing Cinder connection for volume 1f1e39c8-a854-4ecb-bdf4-e974597b7db7 {{(pid=73078) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.541s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ef78e898-48fa-437d-8c91-7b6f6a3b20fa tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.474s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:51 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-ef78e898-48fa-437d-8c91-7b6f6a3b20fa tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:13:51 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-ef78e898-48fa-437d-8c91-7b6f6a3b20fa tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:13:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ef78e898-48fa-437d-8c91-7b6f6a3b20fa tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.365s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:51 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-ef78e898-48fa-437d-8c91-7b6f6a3b20fa tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Deleted allocations for instance d5d44771-7499-43ac-972a-22b9d9fd6840
Aug 14 18:13:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ef78e898-48fa-437d-8c91-7b6f6a3b20fa tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lock "d5d44771-7499-43ac-972a-22b9d9fd6840" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.403s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:51 user nova-compute[73078]: DEBUG nova.compute.manager [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] swap_volume: Updating volume 1f1e39c8-a854-4ecb-bdf4-e974597b7db7 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "hYEAXIqK", "auth_password": "zXiCVL1xgvNoYr", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "7a3e2365-55ce-4728-b393-6e4f54b4bdd6"}, "status": "reserved", "instance": "e8ad453e-67b1-4af2-b85b-a5e100c11446", "attached_at": "", "detached_at": "", "volume_id": "7a3e2365-55ce-4728-b393-6e4f54b4bdd6", "serial": "7a3e2365-55ce-4728-b393-6e4f54b4bdd6"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '7a3e2365-55ce-4728-b393-6e4f54b4bdd6', 'no_device': None, 'attachment_id': '0571025b-83a3-41ca-a526-945adc3a92d4'} {{(pid=73078) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 14 18:13:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2adbc7c9-ee13-4532-9b48-2e22cd95bd28 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Lock "e8ad453e-67b1-4af2-b85b-a5e100c11446" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.004s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:13:51 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:13:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Acquiring lock "e8ad453e-67b1-4af2-b85b-a5e100c11446" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:13:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Lock "e8ad453e-67b1-4af2-b85b-a5e100c11446" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:13:52 user nova-compute[73078]: DEBUG os_brick.utils [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:13:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9c2394-58d0-40eb-9774-194078d40ba4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04fa7d4-8c59-4038-9d1c-2ef18b7c11b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:13:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6ddbaf-dd05-44e3-8bb9-64bed11cd963]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c340fe29-cdd0-4909-afef-cf4025aa3883]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:13:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:13:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:13:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:13:52 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:13:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc029faf-e0da-423f-9b96-70261ddeccc3]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:13:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:13:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:13:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:13:52 user nova-compute[73078]: DEBUG os_brick.utils [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:13:52 user nova-compute[73078]: INFO nova.compute.manager [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Swapping volume 7a3e2365-55ce-4728-b393-6e4f54b4bdd6 for 1f1e39c8-a854-4ecb-bdf4-e974597b7db7
Aug 14 18:13:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:13:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:01 user nova-compute[73078]: DEBUG nova.compute.manager [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvGxCsnN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e8ad453e-67b1-4af2-b85b-a5e100c11446', 'attached_at': '', 'detached_at': '', 'volume_id': '1f1e39c8-a854-4ecb-bdf4-e974597b7db7', 'serial': '1f1e39c8-a854-4ecb-bdf4-e974597b7db7'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYEAXIqK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '7a3e2365-55ce-4728-b393-6e4f54b4bdd6'}, 'status': 'reserved', 'instance': 'e8ad453e-67b1-4af2-b85b-a5e100c11446', 'attached_at': '', 'detached_at': '', 'volume_id': '7a3e2365-55ce-4728-b393-6e4f54b4bdd6', 'serial'} {{(pid=73078) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 14 18:14:01 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:14:01 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvGxCsnN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:14:01 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:14:01 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:14:01 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:14:01 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:14:01 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:14:01 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:14:01 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:14:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:01 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eaf4c07-dda8-4787-95a7-d67a693c027b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:01 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:14:01 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:14:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:01 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[20848d7a-dce8-4bcf-94df-425eaf3de863]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:01 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7] added
Aug 14 18:14:01 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:14:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:01 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[650ee0e2-2815-4796-a0ff-6d348f0cc9b4]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:01 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:14:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:01 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d9e08a-e07c-4adc-bc87-5b007d1a0317]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:01 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:14:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qvGxCsnN {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qvGxCsnN" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:01 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[864d877a-82d6-47f4-b3d9-9bb28dab2038]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:01 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qvGxCsnN'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:14:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:02 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5e0199-dd2e-44db-a796-4d10426f8750]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:14:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:02 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5473d8-e5d6-4b25-be01-73552bc3096c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6 (non-flash)
Aug 14 18:14:02 user nova-compute[73078]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:14:02 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:14:02 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:14:02 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:14:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6 (non-flash)
Aug 14 18:14:02 user nova-compute[73078]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:14:02 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:14:02 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:14:02 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:14:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --login" returned: 0 in 1.066s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:03 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbc0440-2d06-45ae-9d6d-8468df2ab8f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7, portal: 172.16.0.220,3260]
Aug 14 18:14:03 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7, portal: 172.16.0.220,3260] successful.
Aug 14 18:14:03 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:14:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.055s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:03 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[394d6727-b81e-423f-85dc-f0261a72d776]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:14:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.085s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:03 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f7f102-99b9-4ee9-9df3-f4283b704c37]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6 (non-flash)
Aug 14 18:14:03 user nova-compute[73078]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 (non-flash)
Aug 14 18:14:03 user nova-compute[73078]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:14:03 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:14:03 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:14:03 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:14:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6 (non-flash)
Aug 14 18:14:03 user nova-compute[73078]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 (non-flash)
Aug 14 18:14:03 user nova-compute[73078]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:14:03 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:14:03 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:14:03 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:14:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.391s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:14:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:14:03 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] HCTL ('34', '-', '-', 0) found on session 12 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:14:03 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:14:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:03 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6af5ce4-4733-4c77-8f4d-75967213a2f5]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:03 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: None {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:14:03 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692036828.811375, d5d44771-7499-43ac-972a-22b9d9fd6840 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:14:03 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] VM Stopped (Lifecycle Event)
Aug 14 18:14:03 user nova-compute[73078]: DEBUG nova.compute.manager [None req-14c23f45-ceb6-458e-aaa5-4cc9635dc3ed None None] [instance: d5d44771-7499-43ac-972a-22b9d9fd6840] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:14:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:14:04 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:14:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvGxCsnN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:14:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.419s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:14:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] <== connect_volume: return (2421ms) {'type': 'block', 'scsi_wwn': '23333616339643031', 'path': '/dev/sdc'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:14:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333616339643031', 'path': '/dev/sdc'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:14:04 user nova-compute[73078]: DEBUG nova.objects.instance [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Lazy-loading 'flavor' on Instance uuid e8ad453e-67b1-4af2-b85b-a5e100c11446 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:14:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73078) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 18:14:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] COPY block job progress, current cursor: 158334976 final cursor: 1073741824 {{(pid=73078) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 18:14:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] COPY block job progress, current cursor: 338690048 final cursor: 1073741824 {{(pid=73078) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 18:14:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] COPY block job progress, current cursor: 489684992 final cursor: 1073741824 {{(pid=73078) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 18:14:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] COPY block job progress, current cursor: 671088640 final cursor: 1073741824 {{(pid=73078) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 18:14:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] COPY block job progress, current cursor: 852492288 final cursor: 1073741824 {{(pid=73078) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 18:14:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] COPY block job progress, current cursor: 1023410176 final cursor: 1073741824 {{(pid=73078) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73078) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYEAXIqK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '7a3e2365-55ce-4728-b393-6e4f54b4bdd6'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:14:08 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:14:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50ee914-6738-4c52-8cb9-3247f35c8c18]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e811e899-dfef-48b8-942d-133937e547f0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6 (non-flash)
Aug 14 18:14:08 user nova-compute[73078]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 (non-flash)
Aug 14 18:14:08 user nova-compute[73078]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:14:08 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:14:08 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:14:08 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6 (non-flash)
Aug 14 18:14:08 user nova-compute[73078]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 (non-flash)
Aug 14 18:14:08 user nova-compute[73078]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:14:08 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:14:08 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:14:08 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9882c0ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6'): ({'sdf'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Removing single pathed devices sdf {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffb5579-81b2-48be-b72f-adc0965e85a4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c740f8-9d28-4450-822d-259205243253]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Flushing IO for device /dev/sdf {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01714e0-0775-44ec-8e05-5905b8b7316b]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[038293ab-8cb3-417d-8760-38aff9a42f26]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] SCSI volumes sdf have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.063s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[baab5dd6-8cf0-4b81-b642-0f4a77024e8f]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.150s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fda37dd-dde5-46b8-a0ef-e3c741b497ca]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6, portal: 172.16.0.220,3260]
Aug 14 18:14:08 user nova-compute[73078]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6, portal: 172.16.0.220,3260] successful.
Aug 14 18:14:08 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a3e2365-55ce-4728-b393-6e4f54b4bdd6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6c7e40-7846-4c2d-8b19-92f1c8ea8863]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.411s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] <== disconnect_volume: return (412ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG nova.compute.manager [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvGxCsnN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'e8ad453e-67b1-4af2-b85b-a5e100c11446', 'attached_at': '', 'detached_at': '', 'volume_id': '1f1e39c8-a854-4ecb-bdf4-e974597b7db7', 'serial'} {{(pid=73078) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG nova.compute.manager [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] swap_volume: removing Cinder connection for volume 7a3e2365-55ce-4728-b393-6e4f54b4bdd6 {{(pid=73078) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 14 18:14:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:14:09 user nova-compute[73078]: DEBUG nova.compute.manager [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] swap_volume: Updating volume 7a3e2365-55ce-4728-b393-6e4f54b4bdd6 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "qvGxCsnN", "auth_password": "ht03ob4IqS1F8T", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "1f1e39c8-a854-4ecb-bdf4-e974597b7db7"}, "status": "reserved", "instance": "e8ad453e-67b1-4af2-b85b-a5e100c11446", "attached_at": "", "detached_at": "", "volume_id": "1f1e39c8-a854-4ecb-bdf4-e974597b7db7", "serial": "1f1e39c8-a854-4ecb-bdf4-e974597b7db7"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '1f1e39c8-a854-4ecb-bdf4-e974597b7db7', 'no_device': None, 'attachment_id': '9c67b7c0-5d2c-42b4-9198-84692e871d65'} {{(pid=73078) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 14 18:14:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-6007f203-6951-42e9-8bd5-f5964b1c31d9 tempest-TestVolumeSwap-670596568 tempest-TestVolumeSwap-670596568-project-admin] Lock "e8ad453e-67b1-4af2-b85b-a5e100c11446" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.451s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8ebc5aee-43df-4984-8604-c0b2b205e427 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Acquiring lock "e8ad453e-67b1-4af2-b85b-a5e100c11446" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8ebc5aee-43df-4984-8604-c0b2b205e427 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Lock "e8ad453e-67b1-4af2-b85b-a5e100c11446" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:10 user nova-compute[73078]: INFO nova.compute.manager [None req-8ebc5aee-43df-4984-8604-c0b2b205e427 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Detaching volume 1f1e39c8-a854-4ecb-bdf4-e974597b7db7
Aug 14 18:14:11 user nova-compute[73078]: INFO nova.virt.block_device [None req-8ebc5aee-43df-4984-8604-c0b2b205e427 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Attempting to driver detach volume 1f1e39c8-a854-4ecb-bdf4-e974597b7db7 from mountpoint /dev/vdb
Aug 14 18:14:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8ebc5aee-43df-4984-8604-c0b2b205e427 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Attempting to detach device vdb from instance e8ad453e-67b1-4af2-b85b-a5e100c11446 from the persistent domain config. {{(pid=73078) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-8ebc5aee-43df-4984-8604-c0b2b205e427 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:14:11 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:14:11 user nova-compute[73078]:   <source dev="/dev/sdc"/>
Aug 14 18:14:11 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:14:11 user nova-compute[73078]:   <serial>1f1e39c8-a854-4ecb-bdf4-e974597b7db7</serial>
Aug 14 18:14:11 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:14:11 user nova-compute[73078]: </disk>
Aug 14 18:14:11 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:14:11 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-8ebc5aee-43df-4984-8604-c0b2b205e427 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Successfully detached device vdb from instance e8ad453e-67b1-4af2-b85b-a5e100c11446 from the persistent domain config.
Aug 14 18:14:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8ebc5aee-43df-4984-8604-c0b2b205e427 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e8ad453e-67b1-4af2-b85b-a5e100c11446 from the live domain config. {{(pid=73078) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-8ebc5aee-43df-4984-8604-c0b2b205e427 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:14:11 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:14:11 user nova-compute[73078]:   <source dev="/dev/sdc"/>
Aug 14 18:14:11 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:14:11 user nova-compute[73078]:   <serial>1f1e39c8-a854-4ecb-bdf4-e974597b7db7</serial>
Aug 14 18:14:11 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:14:11 user nova-compute[73078]: </disk>
Aug 14 18:14:11 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG nova.compute.manager [req-23a6b5a0-7802-4112-987f-9eb60daddb53 req-b0f8f230-a004-4583-a602-0989f3f19066 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-changed-be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG nova.compute.manager [req-23a6b5a0-7802-4112-987f-9eb60daddb53 req-b0f8f230-a004-4583-a602-0989f3f19066 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Refreshing instance network info cache due to event network-changed-be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-23a6b5a0-7802-4112-987f-9eb60daddb53 req-b0f8f230-a004-4583-a602-0989f3f19066 service nova] Acquiring lock "refresh_cache-3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-23a6b5a0-7802-4112-987f-9eb60daddb53 req-b0f8f230-a004-4583-a602-0989f3f19066 service nova] Acquired lock "refresh_cache-3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG nova.network.neutron [req-23a6b5a0-7802-4112-987f-9eb60daddb53 req-b0f8f230-a004-4583-a602-0989f3f19066 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Refreshing network info cache for port be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Received event <DeviceRemovedEvent: 1692036851.472462, e8ad453e-67b1-4af2-b85b-a5e100c11446 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73078) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8ebc5aee-43df-4984-8604-c0b2b205e427 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e8ad453e-67b1-4af2-b85b-a5e100c11446 {{(pid=73078) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 18:14:11 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-8ebc5aee-43df-4984-8604-c0b2b205e427 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Successfully detached device vdb from instance e8ad453e-67b1-4af2-b85b-a5e100c11446 from the live domain config.
Aug 14 18:14:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ebc5aee-43df-4984-8604-c0b2b205e427 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebc5aee-43df-4984-8604-c0b2b205e427 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvGxCsnN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '1f1e39c8-a854-4ecb-bdf4-e974597b7db7'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:14:11 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-8ebc5aee-43df-4984-8604-c0b2b205e427 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:14:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-8ebc5aee-43df-4984-8604-c0b2b205e427 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-8ebc5aee-43df-4984-8604-c0b2b205e427 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebc5aee-43df-4984-8604-c0b2b205e427 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG nova.network.neutron [req-23a6b5a0-7802-4112-987f-9eb60daddb53 req-b0f8f230-a004-4583-a602-0989f3f19066 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Updated VIF entry in instance network info cache for port be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG nova.network.neutron [req-23a6b5a0-7802-4112-987f-9eb60daddb53 req-b0f8f230-a004-4583-a602-0989f3f19066 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Updating instance_info_cache with network_info: [{"id": "be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0", "address": "fa:16:3e:fd:5d:15", "network": {"id": "b3d5a7bd-ce61-46db-9a30-3da3cc663f58", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-779880358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe9ed0fb-59", "ovs_interfaceid": "be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b845300e-603e-4702-a3cc-cecf5bfcf026", "address": "fa:16:3e:b5:e0:ae", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb845300e-60", "ovs_interfaceid": "b845300e-603e-4702-a3cc-cecf5bfcf026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1547f0c-cfbd-481c-9657-a3ed79040d1e", "address": "fa:16:3e:70:aa:9c", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1547f0c-cf", "ovs_interfaceid": "d1547f0c-cfbd-481c-9657-a3ed79040d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f725089c-89c9-447a-88e7-a427ad17f344", "address": "fa:16:3e:63:ea:ff", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf725089c-89", "ovs_interfaceid": "f725089c-89c9-447a-88e7-a427ad17f344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0da08486-8ca6-4ab9-8328-7073e9a8b0f3", "address": "fa:16:3e:b4:77:23", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da08486-8c", "ovs_interfaceid": "0da08486-8ca6-4ab9-8328-7073e9a8b0f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "febea954-f895-4078-acd2-c9f87479a76b", "address": "fa:16:3e:ee:00:df", "network": {"id": "966cb532-886b-4eef-8b6b-1cdcb9bbe9c1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1607312863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebea954-f8", "ovs_interfaceid": "febea954-f895-4078-acd2-c9f87479a76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "350b119d-c27a-4783-9d95-04bc9e75e8f6", "address": "fa:16:3e:61:d4:d6", "network": {"id": "966cb532-886b-4eef-8b6b-1cdcb9bbe9c1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1607312863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350b119d-c2", "ovs_interfaceid": "350b119d-c27a-4783-9d95-04bc9e75e8f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6bd145-8a2b-450d-aa9c-a610b50f224a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-23a6b5a0-7802-4112-987f-9eb60daddb53 req-b0f8f230-a004-4583-a602-0989f3f19066 service nova] Releasing lock "refresh_cache-3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e5c633-1ea9-4147-8beb-4b0e39765a05]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebc5aee-43df-4984-8604-c0b2b205e427 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 (non-flash)
Aug 14 18:14:11 user nova-compute[73078]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:14:11 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:14:11 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:14:11 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebc5aee-43df-4984-8604-c0b2b205e427 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 (non-flash)
Aug 14 18:14:11 user nova-compute[73078]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:14:11 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:14:11 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:14:11 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebc5aee-43df-4984-8604-c0b2b205e427 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe97864b130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7'): ({'sdc'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-8ebc5aee-43df-4984-8604-c0b2b205e427 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Removing single pathed devices sdc {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9718a40-00a4-4fbc-bd47-cc60bb52d61b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1e283a-a0b8-4b53-bde9-1c6efa7093f1]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-8ebc5aee-43df-4984-8604-c0b2b205e427 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Flushing IO for device /dev/sdc {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1f4dfc-e0c9-4239-bf90-7b0ea51b8722]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-8ebc5aee-43df-4984-8604-c0b2b205e427 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e105a7b4-19cf-4395-8837-287a4b15d741]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-8ebc5aee-43df-4984-8604-c0b2b205e427 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-8ebc5aee-43df-4984-8604-c0b2b205e427 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] SCSI volumes sdc have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebc5aee-43df-4984-8604-c0b2b205e427 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b859ae99-0f0f-46d0-aa63-e39a10572b9a]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebc5aee-43df-4984-8604-c0b2b205e427 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a955f5-8dbb-471c-af4d-b84bbe37b651]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebc5aee-43df-4984-8604-c0b2b205e427 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7, portal: 172.16.0.220,3260]
Aug 14 18:14:11 user nova-compute[73078]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7, portal: 172.16.0.220,3260] successful.
Aug 14 18:14:11 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f1e39c8-a854-4ecb-bdf4-e974597b7db7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[747c47eb-4df7-409d-a093-1f637618c16c]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebc5aee-43df-4984-8604-c0b2b205e427 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-8ebc5aee-43df-4984-8604-c0b2b205e427 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebc5aee-43df-4984-8604-c0b2b205e427 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] <== disconnect_volume: return (303ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:14:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ebc5aee-43df-4984-8604-c0b2b205e427 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:14:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:12 user nova-compute[73078]: DEBUG nova.objects.instance [None req-8ebc5aee-43df-4984-8604-c0b2b205e427 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Lazy-loading 'flavor' on Instance uuid e8ad453e-67b1-4af2-b85b-a5e100c11446 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:14:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8ebc5aee-43df-4984-8604-c0b2b205e427 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Lock "e8ad453e-67b1-4af2-b85b-a5e100c11446" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.668s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Acquiring lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Acquiring lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:13 user nova-compute[73078]: INFO nova.compute.manager [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Terminating instance
Aug 14 18:14:13 user nova-compute[73078]: DEBUG nova.compute.manager [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:14:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:13 user nova-compute[73078]: DEBUG nova.compute.manager [req-33c54e82-5156-4a98-9cbe-b07ed66d845c req-69880407-a493-429f-8a7b-6bb17667bc5e service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-unplugged-be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:14:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-33c54e82-5156-4a98-9cbe-b07ed66d845c req-69880407-a493-429f-8a7b-6bb17667bc5e service nova] Acquiring lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-33c54e82-5156-4a98-9cbe-b07ed66d845c req-69880407-a493-429f-8a7b-6bb17667bc5e service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-33c54e82-5156-4a98-9cbe-b07ed66d845c req-69880407-a493-429f-8a7b-6bb17667bc5e service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:13 user nova-compute[73078]: DEBUG nova.compute.manager [req-33c54e82-5156-4a98-9cbe-b07ed66d845c req-69880407-a493-429f-8a7b-6bb17667bc5e service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] No waiting events found dispatching network-vif-unplugged-be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:14:13 user nova-compute[73078]: DEBUG nova.compute.manager [req-33c54e82-5156-4a98-9cbe-b07ed66d845c req-69880407-a493-429f-8a7b-6bb17667bc5e service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-unplugged-be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:14:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:14 user nova-compute[73078]: DEBUG nova.compute.manager [req-86e2522c-e489-4fd8-8529-b54b0eb67d3b req-50580c6e-027c-4730-9912-45bdcbbaa7ad service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-unplugged-d1547f0c-cfbd-481c-9657-a3ed79040d1e {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:14:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-86e2522c-e489-4fd8-8529-b54b0eb67d3b req-50580c6e-027c-4730-9912-45bdcbbaa7ad service nova] Acquiring lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-86e2522c-e489-4fd8-8529-b54b0eb67d3b req-50580c6e-027c-4730-9912-45bdcbbaa7ad service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-86e2522c-e489-4fd8-8529-b54b0eb67d3b req-50580c6e-027c-4730-9912-45bdcbbaa7ad service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:14 user nova-compute[73078]: DEBUG nova.compute.manager [req-86e2522c-e489-4fd8-8529-b54b0eb67d3b req-50580c6e-027c-4730-9912-45bdcbbaa7ad service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] No waiting events found dispatching network-vif-unplugged-d1547f0c-cfbd-481c-9657-a3ed79040d1e {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:14:14 user nova-compute[73078]: DEBUG nova.compute.manager [req-86e2522c-e489-4fd8-8529-b54b0eb67d3b req-50580c6e-027c-4730-9912-45bdcbbaa7ad service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-unplugged-d1547f0c-cfbd-481c-9657-a3ed79040d1e for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:14:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:14 user nova-compute[73078]: DEBUG nova.compute.manager [req-9c668f7e-0ff3-4e8a-9371-d09be5424bfc req-464958a1-d719-4b65-9c34-f23e8441ce57 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-unplugged-febea954-f895-4078-acd2-c9f87479a76b {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:14:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9c668f7e-0ff3-4e8a-9371-d09be5424bfc req-464958a1-d719-4b65-9c34-f23e8441ce57 service nova] Acquiring lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9c668f7e-0ff3-4e8a-9371-d09be5424bfc req-464958a1-d719-4b65-9c34-f23e8441ce57 service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9c668f7e-0ff3-4e8a-9371-d09be5424bfc req-464958a1-d719-4b65-9c34-f23e8441ce57 service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:14 user nova-compute[73078]: DEBUG nova.compute.manager [req-9c668f7e-0ff3-4e8a-9371-d09be5424bfc req-464958a1-d719-4b65-9c34-f23e8441ce57 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] No waiting events found dispatching network-vif-unplugged-febea954-f895-4078-acd2-c9f87479a76b {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:14:14 user nova-compute[73078]: DEBUG nova.compute.manager [req-9c668f7e-0ff3-4e8a-9371-d09be5424bfc req-464958a1-d719-4b65-9c34-f23e8441ce57 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-unplugged-febea954-f895-4078-acd2-c9f87479a76b for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:14:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:15 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Instance destroyed successfully.
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.objects.instance [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Lazy-loading 'resources' on Instance uuid 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:12:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942929011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942929011',id=13,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPEMynvkgK3D8wUwcv/n8OYQ1W8btAxcTUdDr+O//arZSNxfL73QYspdeKO7g4qkivuuHPX4nFtVqh3WBm6PhGbEDkt7rdYIfZn6k/tjOLMzedYNO0yL6edD9VtQvhxkA==',key_name='tempest-keypair-155161134',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:13:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7328e29579b44e5894abeb47e1fe16a8',ramdisk_id='',reservation_id='r-3lybo561',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2139073796',owner_user_name='tempest-TaggedBootDevicesTest-2139073796-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:13:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e155f911c3444d3baffb0eb5ee75b773',uuid=3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0", "address": "fa:16:3e:fd:5d:15", "network": {"id": "b3d5a7bd-ce61-46db-9a30-3da3cc663f58", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-779880358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe9ed0fb-59", "ovs_interfaceid": "be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converting VIF {"id": "be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0", "address": "fa:16:3e:fd:5d:15", "network": {"id": "b3d5a7bd-ce61-46db-9a30-3da3cc663f58", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-779880358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe9ed0fb-59", "ovs_interfaceid": "be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:5d:15,bridge_name='br-int',has_traffic_filtering=True,id=be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0,network=Network(b3d5a7bd-ce61-46db-9a30-3da3cc663f58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe9ed0fb-59') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG os_vif [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:5d:15,bridge_name='br-int',has_traffic_filtering=True,id=be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0,network=Network(b3d5a7bd-ce61-46db-9a30-3da3cc663f58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe9ed0fb-59') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe9ed0fb-59, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:15 user nova-compute[73078]: INFO os_vif [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:5d:15,bridge_name='br-int',has_traffic_filtering=True,id=be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0,network=Network(b3d5a7bd-ce61-46db-9a30-3da3cc663f58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe9ed0fb-59')
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:12:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942929011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942929011',id=13,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPEMynvkgK3D8wUwcv/n8OYQ1W8btAxcTUdDr+O//arZSNxfL73QYspdeKO7g4qkivuuHPX4nFtVqh3WBm6PhGbEDkt7rdYIfZn6k/tjOLMzedYNO0yL6edD9VtQvhxkA==',key_name='tempest-keypair-155161134',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:13:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7328e29579b44e5894abeb47e1fe16a8',ramdisk_id='',reservation_id='r-3lybo561',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2139073796',owner_user_name='tempest-TaggedBootDevicesTest-2139073796-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:13:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e155f911c3444d3baffb0eb5ee75b773',uuid=3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b845300e-603e-4702-a3cc-cecf5bfcf026", "address": "fa:16:3e:b5:e0:ae", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb845300e-60", "ovs_interfaceid": "b845300e-603e-4702-a3cc-cecf5bfcf026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converting VIF {"id": "b845300e-603e-4702-a3cc-cecf5bfcf026", "address": "fa:16:3e:b5:e0:ae", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb845300e-60", "ovs_interfaceid": "b845300e-603e-4702-a3cc-cecf5bfcf026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:e0:ae,bridge_name='br-int',has_traffic_filtering=True,id=b845300e-603e-4702-a3cc-cecf5bfcf026,network=Network(ca37b602-6d7b-4286-a4e2-fbdc544aecf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb845300e-60') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG os_vif [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:e0:ae,bridge_name='br-int',has_traffic_filtering=True,id=b845300e-603e-4702-a3cc-cecf5bfcf026,network=Network(ca37b602-6d7b-4286-a4e2-fbdc544aecf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb845300e-60') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb845300e-60, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:15 user nova-compute[73078]: INFO os_vif [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:e0:ae,bridge_name='br-int',has_traffic_filtering=True,id=b845300e-603e-4702-a3cc-cecf5bfcf026,network=Network(ca37b602-6d7b-4286-a4e2-fbdc544aecf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb845300e-60')
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:12:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942929011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942929011',id=13,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPEMynvkgK3D8wUwcv/n8OYQ1W8btAxcTUdDr+O//arZSNxfL73QYspdeKO7g4qkivuuHPX4nFtVqh3WBm6PhGbEDkt7rdYIfZn6k/tjOLMzedYNO0yL6edD9VtQvhxkA==',key_name='tempest-keypair-155161134',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:13:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7328e29579b44e5894abeb47e1fe16a8',ramdisk_id='',reservation_id='r-3lybo561',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2139073796',owner_user_name='tempest-TaggedBootDevicesTest-2139073796-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:13:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e155f911c3444d3baffb0eb5ee75b773',uuid=3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1547f0c-cfbd-481c-9657-a3ed79040d1e", "address": "fa:16:3e:70:aa:9c", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1547f0c-cf", "ovs_interfaceid": "d1547f0c-cfbd-481c-9657-a3ed79040d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converting VIF {"id": "d1547f0c-cfbd-481c-9657-a3ed79040d1e", "address": "fa:16:3e:70:aa:9c", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1547f0c-cf", "ovs_interfaceid": "d1547f0c-cfbd-481c-9657-a3ed79040d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:aa:9c,bridge_name='br-int',has_traffic_filtering=True,id=d1547f0c-cfbd-481c-9657-a3ed79040d1e,network=Network(ca37b602-6d7b-4286-a4e2-fbdc544aecf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd1547f0c-cf') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG os_vif [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:aa:9c,bridge_name='br-int',has_traffic_filtering=True,id=d1547f0c-cfbd-481c-9657-a3ed79040d1e,network=Network(ca37b602-6d7b-4286-a4e2-fbdc544aecf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd1547f0c-cf') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1547f0c-cf, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:15 user nova-compute[73078]: INFO os_vif [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:aa:9c,bridge_name='br-int',has_traffic_filtering=True,id=d1547f0c-cfbd-481c-9657-a3ed79040d1e,network=Network(ca37b602-6d7b-4286-a4e2-fbdc544aecf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd1547f0c-cf')
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:12:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942929011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942929011',id=13,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPEMynvkgK3D8wUwcv/n8OYQ1W8btAxcTUdDr+O//arZSNxfL73QYspdeKO7g4qkivuuHPX4nFtVqh3WBm6PhGbEDkt7rdYIfZn6k/tjOLMzedYNO0yL6edD9VtQvhxkA==',key_name='tempest-keypair-155161134',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:13:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7328e29579b44e5894abeb47e1fe16a8',ramdisk_id='',reservation_id='r-3lybo561',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2139073796',owner_user_name='tempest-TaggedBootDevicesTest-2139073796-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:13:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e155f911c3444d3baffb0eb5ee75b773',uuid=3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f725089c-89c9-447a-88e7-a427ad17f344", "address": "fa:16:3e:63:ea:ff", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf725089c-89", "ovs_interfaceid": "f725089c-89c9-447a-88e7-a427ad17f344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converting VIF {"id": "f725089c-89c9-447a-88e7-a427ad17f344", "address": "fa:16:3e:63:ea:ff", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf725089c-89", "ovs_interfaceid": "f725089c-89c9-447a-88e7-a427ad17f344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:ea:ff,bridge_name='br-int',has_traffic_filtering=True,id=f725089c-89c9-447a-88e7-a427ad17f344,network=Network(ca37b602-6d7b-4286-a4e2-fbdc544aecf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf725089c-89') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG os_vif [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:ea:ff,bridge_name='br-int',has_traffic_filtering=True,id=f725089c-89c9-447a-88e7-a427ad17f344,network=Network(ca37b602-6d7b-4286-a4e2-fbdc544aecf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf725089c-89') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf725089c-89, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:15 user nova-compute[73078]: INFO os_vif [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:ea:ff,bridge_name='br-int',has_traffic_filtering=True,id=f725089c-89c9-447a-88e7-a427ad17f344,network=Network(ca37b602-6d7b-4286-a4e2-fbdc544aecf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf725089c-89')
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:12:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942929011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942929011',id=13,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPEMynvkgK3D8wUwcv/n8OYQ1W8btAxcTUdDr+O//arZSNxfL73QYspdeKO7g4qkivuuHPX4nFtVqh3WBm6PhGbEDkt7rdYIfZn6k/tjOLMzedYNO0yL6edD9VtQvhxkA==',key_name='tempest-keypair-155161134',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:13:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7328e29579b44e5894abeb47e1fe16a8',ramdisk_id='',reservation_id='r-3lybo561',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2139073796',owner_user_name='tempest-TaggedBootDevicesTest-2139073796-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:13:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e155f911c3444d3baffb0eb5ee75b773',uuid=3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0da08486-8ca6-4ab9-8328-7073e9a8b0f3", "address": "fa:16:3e:b4:77:23", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da08486-8c", "ovs_interfaceid": "0da08486-8ca6-4ab9-8328-7073e9a8b0f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converting VIF {"id": "0da08486-8ca6-4ab9-8328-7073e9a8b0f3", "address": "fa:16:3e:b4:77:23", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da08486-8c", "ovs_interfaceid": "0da08486-8ca6-4ab9-8328-7073e9a8b0f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:77:23,bridge_name='br-int',has_traffic_filtering=True,id=0da08486-8ca6-4ab9-8328-7073e9a8b0f3,network=Network(ca37b602-6d7b-4286-a4e2-fbdc544aecf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0da08486-8c') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG os_vif [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:77:23,bridge_name='br-int',has_traffic_filtering=True,id=0da08486-8ca6-4ab9-8328-7073e9a8b0f3,network=Network(ca37b602-6d7b-4286-a4e2-fbdc544aecf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0da08486-8c') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0da08486-8c, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:15 user nova-compute[73078]: INFO os_vif [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:77:23,bridge_name='br-int',has_traffic_filtering=True,id=0da08486-8ca6-4ab9-8328-7073e9a8b0f3,network=Network(ca37b602-6d7b-4286-a4e2-fbdc544aecf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0da08486-8c')
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:12:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942929011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942929011',id=13,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPEMynvkgK3D8wUwcv/n8OYQ1W8btAxcTUdDr+O//arZSNxfL73QYspdeKO7g4qkivuuHPX4nFtVqh3WBm6PhGbEDkt7rdYIfZn6k/tjOLMzedYNO0yL6edD9VtQvhxkA==',key_name='tempest-keypair-155161134',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:13:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7328e29579b44e5894abeb47e1fe16a8',ramdisk_id='',reservation_id='r-3lybo561',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2139073796',owner_user_name='tempest-TaggedBootDevicesTest-2139073796-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:13:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e155f911c3444d3baffb0eb5ee75b773',uuid=3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "febea954-f895-4078-acd2-c9f87479a76b", "address": "fa:16:3e:ee:00:df", "network": {"id": "966cb532-886b-4eef-8b6b-1cdcb9bbe9c1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1607312863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebea954-f8", "ovs_interfaceid": "febea954-f895-4078-acd2-c9f87479a76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converting VIF {"id": "febea954-f895-4078-acd2-c9f87479a76b", "address": "fa:16:3e:ee:00:df", "network": {"id": "966cb532-886b-4eef-8b6b-1cdcb9bbe9c1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1607312863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebea954-f8", "ovs_interfaceid": "febea954-f895-4078-acd2-c9f87479a76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:00:df,bridge_name='br-int',has_traffic_filtering=True,id=febea954-f895-4078-acd2-c9f87479a76b,network=Network(966cb532-886b-4eef-8b6b-1cdcb9bbe9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebea954-f8') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG os_vif [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:00:df,bridge_name='br-int',has_traffic_filtering=True,id=febea954-f895-4078-acd2-c9f87479a76b,network=Network(966cb532-886b-4eef-8b6b-1cdcb9bbe9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebea954-f8') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfebea954-f8, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:15 user nova-compute[73078]: INFO os_vif [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:00:df,bridge_name='br-int',has_traffic_filtering=True,id=febea954-f895-4078-acd2-c9f87479a76b,network=Network(966cb532-886b-4eef-8b6b-1cdcb9bbe9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebea954-f8')
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:12:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1942929011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1942929011',id=13,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPEMynvkgK3D8wUwcv/n8OYQ1W8btAxcTUdDr+O//arZSNxfL73QYspdeKO7g4qkivuuHPX4nFtVqh3WBm6PhGbEDkt7rdYIfZn6k/tjOLMzedYNO0yL6edD9VtQvhxkA==',key_name='tempest-keypair-155161134',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:13:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7328e29579b44e5894abeb47e1fe16a8',ramdisk_id='',reservation_id='r-3lybo561',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2139073796',owner_user_name='tempest-TaggedBootDevicesTest-2139073796-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:13:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e155f911c3444d3baffb0eb5ee75b773',uuid=3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "350b119d-c27a-4783-9d95-04bc9e75e8f6", "address": "fa:16:3e:61:d4:d6", "network": {"id": "966cb532-886b-4eef-8b6b-1cdcb9bbe9c1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1607312863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350b119d-c2", "ovs_interfaceid": "350b119d-c27a-4783-9d95-04bc9e75e8f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converting VIF {"id": "350b119d-c27a-4783-9d95-04bc9e75e8f6", "address": "fa:16:3e:61:d4:d6", "network": {"id": "966cb532-886b-4eef-8b6b-1cdcb9bbe9c1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1607312863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350b119d-c2", "ovs_interfaceid": "350b119d-c27a-4783-9d95-04bc9e75e8f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:d4:d6,bridge_name='br-int',has_traffic_filtering=True,id=350b119d-c27a-4783-9d95-04bc9e75e8f6,network=Network(966cb532-886b-4eef-8b6b-1cdcb9bbe9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350b119d-c2') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG os_vif [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:d4:d6,bridge_name='br-int',has_traffic_filtering=True,id=350b119d-c27a-4783-9d95-04bc9e75e8f6,network=Network(966cb532-886b-4eef-8b6b-1cdcb9bbe9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350b119d-c2') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap350b119d-c2, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:15 user nova-compute[73078]: INFO os_vif [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:d4:d6,bridge_name='br-int',has_traffic_filtering=True,id=350b119d-c27a-4783-9d95-04bc9e75e8f6,network=Network(966cb532-886b-4eef-8b6b-1cdcb9bbe9c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350b119d-c2')
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pOBaPDVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:14:15 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:14:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[83183915-6bd8-4504-bd06-a134e4d1b353]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba032e99-42db-4e66-bd82-61542ccacbf8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:14:15 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:14:15 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:14:15 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f (non-flash)
Aug 14 18:14:15 user nova-compute[73078]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:14:15 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:14:15 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe978300a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f'): ({'sdb'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Removing single pathed devices sdb {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9ddc45-860c-4141-8ead-3e8d6eb20e1b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2224d53f-18e9-47bd-9a95-d04433ee22fe]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Flushing IO for device /dev/sdb {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[11765322-18e3-4fd6-8888-e499e2c085e8]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[50446d60-c095-4262-bf4b-77e4c9976a98]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] SCSI volumes sdb have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c961a0-383f-4eec-a9fc-b35f4d20d68a]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14a1924-a952-43a2-9ca3-b2ece5806863]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f, portal: 172.16.0.220,3260]
Aug 14 18:14:15 user nova-compute[73078]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f, portal: 172.16.0.220,3260] successful.
Aug 14 18:14:15 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.compute.manager [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-plugged-be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] Acquiring lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.compute.manager [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] No waiting events found dispatching network-vif-plugged-be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:14:15 user nova-compute[73078]: WARNING nova.compute.manager [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received unexpected event network-vif-plugged-be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0 for instance with vm_state active and task_state deleting.
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.compute.manager [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-unplugged-b845300e-603e-4702-a3cc-cecf5bfcf026 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] Acquiring lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.compute.manager [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] No waiting events found dispatching network-vif-unplugged-b845300e-603e-4702-a3cc-cecf5bfcf026 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.compute.manager [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-unplugged-b845300e-603e-4702-a3cc-cecf5bfcf026 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.compute.manager [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-plugged-b845300e-603e-4702-a3cc-cecf5bfcf026 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] Acquiring lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.compute.manager [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] No waiting events found dispatching network-vif-plugged-b845300e-603e-4702-a3cc-cecf5bfcf026 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:14:15 user nova-compute[73078]: WARNING nova.compute.manager [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received unexpected event network-vif-plugged-b845300e-603e-4702-a3cc-cecf5bfcf026 for instance with vm_state active and task_state deleting.
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.compute.manager [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-unplugged-f725089c-89c9-447a-88e7-a427ad17f344 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] Acquiring lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.compute.manager [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] No waiting events found dispatching network-vif-unplugged-f725089c-89c9-447a-88e7-a427ad17f344 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.compute.manager [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-unplugged-f725089c-89c9-447a-88e7-a427ad17f344 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.compute.manager [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-plugged-f725089c-89c9-447a-88e7-a427ad17f344 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] Acquiring lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.compute.manager [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] No waiting events found dispatching network-vif-plugged-f725089c-89c9-447a-88e7-a427ad17f344 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:14:15 user nova-compute[73078]: WARNING nova.compute.manager [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received unexpected event network-vif-plugged-f725089c-89c9-447a-88e7-a427ad17f344 for instance with vm_state active and task_state deleting.
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.compute.manager [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-unplugged-0da08486-8ca6-4ab9-8328-7073e9a8b0f3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] Acquiring lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.compute.manager [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] No waiting events found dispatching network-vif-unplugged-0da08486-8ca6-4ab9-8328-7073e9a8b0f3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.compute.manager [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-unplugged-0da08486-8ca6-4ab9-8328-7073e9a8b0f3 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.compute.manager [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-plugged-0da08486-8ca6-4ab9-8328-7073e9a8b0f3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] Acquiring lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.compute.manager [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] No waiting events found dispatching network-vif-plugged-0da08486-8ca6-4ab9-8328-7073e9a8b0f3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:14:15 user nova-compute[73078]: WARNING nova.compute.manager [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received unexpected event network-vif-plugged-0da08486-8ca6-4ab9-8328-7073e9a8b0f3 for instance with vm_state active and task_state deleting.
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.compute.manager [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-unplugged-350b119d-c27a-4783-9d95-04bc9e75e8f6 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] Acquiring lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.compute.manager [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] No waiting events found dispatching network-vif-unplugged-350b119d-c27a-4783-9d95-04bc9e75e8f6 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.compute.manager [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-unplugged-350b119d-c27a-4783-9d95-04bc9e75e8f6 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.compute.manager [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-plugged-350b119d-c27a-4783-9d95-04bc9e75e8f6 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] Acquiring lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.compute.manager [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] No waiting events found dispatching network-vif-plugged-350b119d-c27a-4783-9d95-04bc9e75e8f6 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:14:15 user nova-compute[73078]: WARNING nova.compute.manager [req-0f2ceb54-f4b2-4759-921b-6133d84dde56 req-afaab7f3-e96e-47c2-a94f-e21a8a64710b service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received unexpected event network-vif-plugged-350b119d-c27a-4783-9d95-04bc9e75e8f6 for instance with vm_state active and task_state deleting.
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63b60218-2eb0-4ccb-9d46-def6b4b3ce6f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[30206c18-a856-468f-9c42-cbeb31e2257a]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] <== disconnect_volume: return (326ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UsmfVtjk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:14:15 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:14:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc5ad43-7ce0-45fe-aea3-783cbea2a1ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbffff30-9803-423f-92ca-cc055190ea13]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:14:15 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:14:15 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:14:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d (non-flash)
Aug 14 18:14:15 user nova-compute[73078]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:14:15 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe97864ba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d'): ({'sdd'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Removing single pathed devices sdd {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab854f79-60ff-4fb5-beb8-9b0250e4eeee]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[92515b47-dbfc-4a7d-9aee-19c2eaa311ea]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Flushing IO for device /dev/sdd {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a3901d-2fb4-4d28-90f9-277575960046]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.033s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d35158-bca6-4c22-a3fd-131b6ed8d8fd]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] SCSI volumes sdd have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[895eecf8-6e55-402d-b9f6-3126a22eaa03]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd2c592-cc7e-4a53-9963-546880c47fc3]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d, portal: 172.16.0.220,3260]
Aug 14 18:14:16 user nova-compute[73078]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d, portal: 172.16.0.220,3260] successful.
Aug 14 18:14:16 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5761720f-50f3-4f26-8579-ab4b261dac6d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba062d0-fc08-4df9-af38-a65e30dcb7a1]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.252s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] <== disconnect_volume: return (253ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VzRknyKA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:14:16 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:14:16 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6fbcca-439f-46a3-b7fe-047724eb039c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df2afe1-991d-4d39-a7d8-8bb1ca902b21]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:14:16 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 (non-flash)
Aug 14 18:14:16 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe97864ba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246'): ({'sde'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Removing single pathed devices sde {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG nova.compute.manager [req-96a839f6-2c55-43c2-8ac3-1a3f258b7e18 req-c7726a76-8c30-4dc3-a15d-fb735a5558d8 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-plugged-d1547f0c-cfbd-481c-9657-a3ed79040d1e {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-96a839f6-2c55-43c2-8ac3-1a3f258b7e18 req-c7726a76-8c30-4dc3-a15d-fb735a5558d8 service nova] Acquiring lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-96a839f6-2c55-43c2-8ac3-1a3f258b7e18 req-c7726a76-8c30-4dc3-a15d-fb735a5558d8 service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-96a839f6-2c55-43c2-8ac3-1a3f258b7e18 req-c7726a76-8c30-4dc3-a15d-fb735a5558d8 service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG nova.compute.manager [req-96a839f6-2c55-43c2-8ac3-1a3f258b7e18 req-c7726a76-8c30-4dc3-a15d-fb735a5558d8 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] No waiting events found dispatching network-vif-plugged-d1547f0c-cfbd-481c-9657-a3ed79040d1e {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:14:16 user nova-compute[73078]: WARNING nova.compute.manager [req-96a839f6-2c55-43c2-8ac3-1a3f258b7e18 req-c7726a76-8c30-4dc3-a15d-fb735a5558d8 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received unexpected event network-vif-plugged-d1547f0c-cfbd-481c-9657-a3ed79040d1e for instance with vm_state active and task_state deleting.
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cdc6fa-e2b6-4209-ad0f-fc7f62ff9057]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce75b13-dbf2-4830-bbb4-fe2992ae3b62]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Flushing IO for device /dev/sde {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[00563d44-6abc-460c-a943-3db611d565e2]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f6dcfc-656d-4072-be4f-61933b04bd82]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] SCSI volumes sde have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[229a2e5c-cbf5-4f86-9438-46816986ab37]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f076746-1fde-47c5-89f0-a542dbeccfab]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246, portal: 172.16.0.220,3260]
Aug 14 18:14:16 user nova-compute[73078]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246, portal: 172.16.0.220,3260] successful.
Aug 14 18:14:16 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e6f49ae-37c7-45ef-a014-0769abee5246 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bac4ee2-2137-445d-a4ac-49d0065c9635]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] <== disconnect_volume: return (266ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:14:16 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Deleting instance files /opt/stack/data/nova/instances/3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223_del
Aug 14 18:14:16 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Deletion of /opt/stack/data/nova/instances/3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223_del complete
Aug 14 18:14:16 user nova-compute[73078]: INFO nova.compute.manager [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Took 2.98 seconds to destroy the instance on the hypervisor.
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG nova.compute.manager [req-5c6ec54a-e7ba-445b-8bdb-3bea600f5412 req-8a88e6c7-342f-40ac-bc24-343387b53789 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-plugged-febea954-f895-4078-acd2-c9f87479a76b {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5c6ec54a-e7ba-445b-8bdb-3bea600f5412 req-8a88e6c7-342f-40ac-bc24-343387b53789 service nova] Acquiring lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5c6ec54a-e7ba-445b-8bdb-3bea600f5412 req-8a88e6c7-342f-40ac-bc24-343387b53789 service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5c6ec54a-e7ba-445b-8bdb-3bea600f5412 req-8a88e6c7-342f-40ac-bc24-343387b53789 service nova] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:16 user nova-compute[73078]: DEBUG nova.compute.manager [req-5c6ec54a-e7ba-445b-8bdb-3bea600f5412 req-8a88e6c7-342f-40ac-bc24-343387b53789 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] No waiting events found dispatching network-vif-plugged-febea954-f895-4078-acd2-c9f87479a76b {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:14:16 user nova-compute[73078]: WARNING nova.compute.manager [req-5c6ec54a-e7ba-445b-8bdb-3bea600f5412 req-8a88e6c7-342f-40ac-bc24-343387b53789 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received unexpected event network-vif-plugged-febea954-f895-4078-acd2-c9f87479a76b for instance with vm_state active and task_state deleting.
Aug 14 18:14:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:18 user nova-compute[73078]: DEBUG nova.compute.manager [req-96d7abf1-1ddd-4e34-867a-93509d988ea6 req-224e591a-6f5d-482f-be95-fc7edad432d2 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-deleted-350b119d-c27a-4783-9d95-04bc9e75e8f6 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:14:18 user nova-compute[73078]: INFO nova.compute.manager [req-96d7abf1-1ddd-4e34-867a-93509d988ea6 req-224e591a-6f5d-482f-be95-fc7edad432d2 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Neutron deleted interface 350b119d-c27a-4783-9d95-04bc9e75e8f6; detaching it from the instance and deleting it from the info cache
Aug 14 18:14:18 user nova-compute[73078]: DEBUG nova.network.neutron [req-96d7abf1-1ddd-4e34-867a-93509d988ea6 req-224e591a-6f5d-482f-be95-fc7edad432d2 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Updating instance_info_cache with network_info: [{"id": "be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0", "address": "fa:16:3e:fd:5d:15", "network": {"id": "b3d5a7bd-ce61-46db-9a30-3da3cc663f58", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-779880358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe9ed0fb-59", "ovs_interfaceid": "be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b845300e-603e-4702-a3cc-cecf5bfcf026", "address": "fa:16:3e:b5:e0:ae", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb845300e-60", "ovs_interfaceid": "b845300e-603e-4702-a3cc-cecf5bfcf026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1547f0c-cfbd-481c-9657-a3ed79040d1e", "address": "fa:16:3e:70:aa:9c", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1547f0c-cf", "ovs_interfaceid": "d1547f0c-cfbd-481c-9657-a3ed79040d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f725089c-89c9-447a-88e7-a427ad17f344", "address": "fa:16:3e:63:ea:ff", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf725089c-89", "ovs_interfaceid": "f725089c-89c9-447a-88e7-a427ad17f344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0da08486-8ca6-4ab9-8328-7073e9a8b0f3", "address": "fa:16:3e:b4:77:23", "network": {"id": "ca37b602-6d7b-4286-a4e2-fbdc544aecf9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1773258777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da08486-8c", "ovs_interfaceid": "0da08486-8ca6-4ab9-8328-7073e9a8b0f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "febea954-f895-4078-acd2-c9f87479a76b", "address": "fa:16:3e:ee:00:df", "network": {"id": "966cb532-886b-4eef-8b6b-1cdcb9bbe9c1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1607312863", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7328e29579b44e5894abeb47e1fe16a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebea954-f8", "ovs_interfaceid": "febea954-f895-4078-acd2-c9f87479a76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:14:18 user nova-compute[73078]: DEBUG nova.compute.manager [req-96d7abf1-1ddd-4e34-867a-93509d988ea6 req-224e591a-6f5d-482f-be95-fc7edad432d2 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Detach interface failed, port_id=350b119d-c27a-4783-9d95-04bc9e75e8f6, reason: Instance 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223 could not be found. {{(pid=73078) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 18:14:20 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:14:20 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Took 3.50 seconds to deallocate network for instance.
Aug 14 18:14:20 user nova-compute[73078]: DEBUG nova.compute.manager [req-0abb58e3-8b34-4535-9eda-155118a9f2bc req-c9de77c8-c7e8-4958-ab89-53a3cd6fe337 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-deleted-0da08486-8ca6-4ab9-8328-7073e9a8b0f3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:14:20 user nova-compute[73078]: DEBUG nova.compute.manager [req-0abb58e3-8b34-4535-9eda-155118a9f2bc req-c9de77c8-c7e8-4958-ab89-53a3cd6fe337 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-deleted-be9ed0fb-59c2-4f62-9cb4-5c789e59e0c0 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:14:20 user nova-compute[73078]: DEBUG nova.compute.manager [req-0abb58e3-8b34-4535-9eda-155118a9f2bc req-c9de77c8-c7e8-4958-ab89-53a3cd6fe337 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-deleted-febea954-f895-4078-acd2-c9f87479a76b {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:14:20 user nova-compute[73078]: DEBUG nova.compute.manager [req-0abb58e3-8b34-4535-9eda-155118a9f2bc req-c9de77c8-c7e8-4958-ab89-53a3cd6fe337 service nova] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Received event network-vif-deleted-f725089c-89c9-447a-88e7-a427ad17f344 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:14:20 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Acquiring lock "16fe26a2-7fe8-409e-97ca-6c44ef2fbddd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "16fe26a2-7fe8-409e-97ca-6c44ef2fbddd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:22 user nova-compute[73078]: DEBUG nova.compute.manager [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:14:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:22 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:14:22 user nova-compute[73078]: INFO nova.compute.claims [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Claim successful on node user
Aug 14 18:14:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:22 user nova-compute[73078]: INFO nova.compute.manager [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Took 2.51 seconds to detach 3 volumes for instance.
Aug 14 18:14:22 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:14:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:22 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:14:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.385s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:22 user nova-compute[73078]: DEBUG nova.compute.manager [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:14:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.048s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:22 user nova-compute[73078]: DEBUG nova.compute.manager [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:14:22 user nova-compute[73078]: DEBUG nova.network.neutron [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:14:22 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:14:22 user nova-compute[73078]: DEBUG nova.compute.manager [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:14:22 user nova-compute[73078]: DEBUG nova.policy [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2a4b9a2ffd4947ce8fb65976b48b112d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0d923a445747d8a812c1b7b4510398', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:14:22 user nova-compute[73078]: DEBUG nova.compute.manager [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:14:22 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:14:22 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Creating image(s)
Aug 14 18:14:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Acquiring lock "/opt/stack/data/nova/instances/16fe26a2-7fe8-409e-97ca-6c44ef2fbddd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "/opt/stack/data/nova/instances/16fe26a2-7fe8-409e-97ca-6c44ef2fbddd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "/opt/stack/data/nova/instances/16fe26a2-7fe8-409e-97ca-6c44ef2fbddd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:23 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:14:23 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:14:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.409s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:23 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Deleted allocations for instance 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223
Aug 14 18:14:23 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.253s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:23 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a7b5a488-cda9-4d8f-ae49-5f4279a61277 tempest-TaggedBootDevicesTest-2139073796 tempest-TaggedBootDevicesTest-2139073796-project-member] Lock "3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.687s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:23 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.175s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:23 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/16fe26a2-7fe8-409e-97ca-6c44ef2fbddd/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:23 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/16fe26a2-7fe8-409e-97ca-6c44ef2fbddd/disk 1073741824" returned: 0 in 0.045s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:23 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:23 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.190s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:23 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16fe26a2-7fe8-409e-97ca-6c44ef2fbddd/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:14:23 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16fe26a2-7fe8-409e-97ca-6c44ef2fbddd/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:23 user nova-compute[73078]: DEBUG nova.network.neutron [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Successfully created port: f11c2409-22e3-48a1-a629-e9274caa39e3 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:14:23 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16fe26a2-7fe8-409e-97ca-6c44ef2fbddd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:23 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Cannot resize image /opt/stack/data/nova/instances/16fe26a2-7fe8-409e-97ca-6c44ef2fbddd/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:14:23 user nova-compute[73078]: DEBUG nova.objects.instance [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lazy-loading 'migration_context' on Instance uuid 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:14:23 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:14:23 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Ensure instance console log exists: /opt/stack/data/nova/instances/16fe26a2-7fe8-409e-97ca-6c44ef2fbddd/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:14:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG nova.network.neutron [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Successfully updated port: f11c2409-22e3-48a1-a629-e9274caa39e3 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Acquiring lock "refresh_cache-16fe26a2-7fe8-409e-97ca-6c44ef2fbddd" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Acquired lock "refresh_cache-16fe26a2-7fe8-409e-97ca-6c44ef2fbddd" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG nova.network.neutron [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG nova.compute.manager [req-d1aef7da-aebd-401f-8e74-b39dca5b27a5 req-db0ac85b-9f41-4a5d-a059-fa37e0caa6b3 service nova] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Received event network-changed-f11c2409-22e3-48a1-a629-e9274caa39e3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG nova.compute.manager [req-d1aef7da-aebd-401f-8e74-b39dca5b27a5 req-db0ac85b-9f41-4a5d-a059-fa37e0caa6b3 service nova] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Refreshing instance network info cache due to event network-changed-f11c2409-22e3-48a1-a629-e9274caa39e3. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d1aef7da-aebd-401f-8e74-b39dca5b27a5 req-db0ac85b-9f41-4a5d-a059-fa37e0caa6b3 service nova] Acquiring lock "refresh_cache-16fe26a2-7fe8-409e-97ca-6c44ef2fbddd" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG nova.network.neutron [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG nova.network.neutron [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Updating instance_info_cache with network_info: [{"id": "f11c2409-22e3-48a1-a629-e9274caa39e3", "address": "fa:16:3e:da:e9:95", "network": {"id": "bcbb9361-92bf-48f3-9d61-e5cdb5d21980", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1013223391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d0d923a445747d8a812c1b7b4510398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11c2409-22", "ovs_interfaceid": "f11c2409-22e3-48a1-a629-e9274caa39e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Releasing lock "refresh_cache-16fe26a2-7fe8-409e-97ca-6c44ef2fbddd" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG nova.compute.manager [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Instance network_info: |[{"id": "f11c2409-22e3-48a1-a629-e9274caa39e3", "address": "fa:16:3e:da:e9:95", "network": {"id": "bcbb9361-92bf-48f3-9d61-e5cdb5d21980", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1013223391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d0d923a445747d8a812c1b7b4510398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11c2409-22", "ovs_interfaceid": "f11c2409-22e3-48a1-a629-e9274caa39e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d1aef7da-aebd-401f-8e74-b39dca5b27a5 req-db0ac85b-9f41-4a5d-a059-fa37e0caa6b3 service nova] Acquired lock "refresh_cache-16fe26a2-7fe8-409e-97ca-6c44ef2fbddd" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG nova.network.neutron [req-d1aef7da-aebd-401f-8e74-b39dca5b27a5 req-db0ac85b-9f41-4a5d-a059-fa37e0caa6b3 service nova] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Refreshing network info cache for port f11c2409-22e3-48a1-a629-e9274caa39e3 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Start _get_guest_xml network_info=[{"id": "f11c2409-22e3-48a1-a629-e9274caa39e3", "address": "fa:16:3e:da:e9:95", "network": {"id": "bcbb9361-92bf-48f3-9d61-e5cdb5d21980", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1013223391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d0d923a445747d8a812c1b7b4510398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11c2409-22", "ovs_interfaceid": "f11c2409-22e3-48a1-a629-e9274caa39e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:14:24 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:14:24 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:14:24 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:14:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1352669969',display_name='tempest-VolumesAdminNegativeTest-server-1352669969',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1352669969',id=14,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d0d923a445747d8a812c1b7b4510398',ramdisk_id='',reservation_id='r-t1011g3d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1778130930',owner_user_name='tempest-VolumesAdminNegativeTest-1778130930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:14:23Z,user_data=None,user_id='2a4b9a2ffd4947ce8fb65976b48b112d',uuid=16fe26a2-7fe8-409e-97ca-6c44ef2fbddd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f11c2409-22e3-48a1-a629-e9274caa39e3", "address": "fa:16:3e:da:e9:95", "network": {"id": "bcbb9361-92bf-48f3-9d61-e5cdb5d21980", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1013223391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d0d923a445747d8a812c1b7b4510398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11c2409-22", "ovs_interfaceid": "f11c2409-22e3-48a1-a629-e9274caa39e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Converting VIF {"id": "f11c2409-22e3-48a1-a629-e9274caa39e3", "address": "fa:16:3e:da:e9:95", "network": {"id": "bcbb9361-92bf-48f3-9d61-e5cdb5d21980", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1013223391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d0d923a445747d8a812c1b7b4510398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11c2409-22", "ovs_interfaceid": "f11c2409-22e3-48a1-a629-e9274caa39e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:e9:95,bridge_name='br-int',has_traffic_filtering=True,id=f11c2409-22e3-48a1-a629-e9274caa39e3,network=Network(bcbb9361-92bf-48f3-9d61-e5cdb5d21980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf11c2409-22') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG nova.objects.instance [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lazy-loading 'pci_devices' on Instance uuid 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:14:24 user nova-compute[73078]:   <uuid>16fe26a2-7fe8-409e-97ca-6c44ef2fbddd</uuid>
Aug 14 18:14:24 user nova-compute[73078]:   <name>instance-0000000e</name>
Aug 14 18:14:24 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:14:24 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:14:24 user nova-compute[73078]:   <metadata>
Aug 14 18:14:24 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:14:24 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:14:24 user nova-compute[73078]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1352669969</nova:name>
Aug 14 18:14:24 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:14:24</nova:creationTime>
Aug 14 18:14:24 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:14:24 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:14:24 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:14:24 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:14:24 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:14:24 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:14:24 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:14:24 user nova-compute[73078]:       <nova:owner>
Aug 14 18:14:24 user nova-compute[73078]:         <nova:user uuid="2a4b9a2ffd4947ce8fb65976b48b112d">tempest-VolumesAdminNegativeTest-1778130930-project-member</nova:user>
Aug 14 18:14:24 user nova-compute[73078]:         <nova:project uuid="1d0d923a445747d8a812c1b7b4510398">tempest-VolumesAdminNegativeTest-1778130930</nova:project>
Aug 14 18:14:24 user nova-compute[73078]:       </nova:owner>
Aug 14 18:14:24 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:14:24 user nova-compute[73078]:       <nova:ports>
Aug 14 18:14:24 user nova-compute[73078]:         <nova:port uuid="f11c2409-22e3-48a1-a629-e9274caa39e3">
Aug 14 18:14:24 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 14 18:14:24 user nova-compute[73078]:         </nova:port>
Aug 14 18:14:24 user nova-compute[73078]:       </nova:ports>
Aug 14 18:14:24 user nova-compute[73078]:     </nova:instance>
Aug 14 18:14:24 user nova-compute[73078]:   </metadata>
Aug 14 18:14:24 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:14:24 user nova-compute[73078]:     <system>
Aug 14 18:14:24 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:14:24 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:14:24 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:14:24 user nova-compute[73078]:       <entry name="serial">16fe26a2-7fe8-409e-97ca-6c44ef2fbddd</entry>
Aug 14 18:14:24 user nova-compute[73078]:       <entry name="uuid">16fe26a2-7fe8-409e-97ca-6c44ef2fbddd</entry>
Aug 14 18:14:24 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:14:24 user nova-compute[73078]:     </system>
Aug 14 18:14:24 user nova-compute[73078]:   </sysinfo>
Aug 14 18:14:24 user nova-compute[73078]:   <os>
Aug 14 18:14:24 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:14:24 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:14:24 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:14:24 user nova-compute[73078]:   </os>
Aug 14 18:14:24 user nova-compute[73078]:   <features>
Aug 14 18:14:24 user nova-compute[73078]:     <acpi/>
Aug 14 18:14:24 user nova-compute[73078]:     <apic/>
Aug 14 18:14:24 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:14:24 user nova-compute[73078]:   </features>
Aug 14 18:14:24 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:14:24 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:14:24 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:14:24 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:14:24 user nova-compute[73078]:   </clock>
Aug 14 18:14:24 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:14:24 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:14:24 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:14:24 user nova-compute[73078]:   </cpu>
Aug 14 18:14:24 user nova-compute[73078]:   <devices>
Aug 14 18:14:24 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:14:24 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:14:24 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/16fe26a2-7fe8-409e-97ca-6c44ef2fbddd/disk"/>
Aug 14 18:14:24 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:14:24 user nova-compute[73078]:     </disk>
Aug 14 18:14:24 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:14:24 user nova-compute[73078]:       <mac address="fa:16:3e:da:e9:95"/>
Aug 14 18:14:24 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:14:24 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:14:24 user nova-compute[73078]:       <target dev="tapf11c2409-22"/>
Aug 14 18:14:24 user nova-compute[73078]:     </interface>
Aug 14 18:14:24 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:14:24 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/16fe26a2-7fe8-409e-97ca-6c44ef2fbddd/console.log" append="off"/>
Aug 14 18:14:24 user nova-compute[73078]:     </serial>
Aug 14 18:14:24 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:14:24 user nova-compute[73078]:     <video>
Aug 14 18:14:24 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:14:24 user nova-compute[73078]:     </video>
Aug 14 18:14:24 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:14:24 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:14:24 user nova-compute[73078]:     </rng>
Aug 14 18:14:24 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:14:24 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:14:24 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:14:24 user nova-compute[73078]:     </memballoon>
Aug 14 18:14:24 user nova-compute[73078]:   </devices>
Aug 14 18:14:24 user nova-compute[73078]: </domain>
Aug 14 18:14:24 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:14:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1352669969',display_name='tempest-VolumesAdminNegativeTest-server-1352669969',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1352669969',id=14,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d0d923a445747d8a812c1b7b4510398',ramdisk_id='',reservation_id='r-t1011g3d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1778130930',owner_user_name='tempest-VolumesAdminNegativeTest-1778130930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:14:23Z,user_data=None,user_id='2a4b9a2ffd4947ce8fb65976b48b112d',uuid=16fe26a2-7fe8-409e-97ca-6c44ef2fbddd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f11c2409-22e3-48a1-a629-e9274caa39e3", "address": "fa:16:3e:da:e9:95", "network": {"id": "bcbb9361-92bf-48f3-9d61-e5cdb5d21980", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1013223391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d0d923a445747d8a812c1b7b4510398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11c2409-22", "ovs_interfaceid": "f11c2409-22e3-48a1-a629-e9274caa39e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Converting VIF {"id": "f11c2409-22e3-48a1-a629-e9274caa39e3", "address": "fa:16:3e:da:e9:95", "network": {"id": "bcbb9361-92bf-48f3-9d61-e5cdb5d21980", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1013223391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d0d923a445747d8a812c1b7b4510398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11c2409-22", "ovs_interfaceid": "f11c2409-22e3-48a1-a629-e9274caa39e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:e9:95,bridge_name='br-int',has_traffic_filtering=True,id=f11c2409-22e3-48a1-a629-e9274caa39e3,network=Network(bcbb9361-92bf-48f3-9d61-e5cdb5d21980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf11c2409-22') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG os_vif [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:e9:95,bridge_name='br-int',has_traffic_filtering=True,id=f11c2409-22e3-48a1-a629-e9274caa39e3,network=Network(bcbb9361-92bf-48f3-9d61-e5cdb5d21980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf11c2409-22') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf11c2409-22, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf11c2409-22, col_values=(('external_ids', {'iface-id': 'f11c2409-22e3-48a1-a629-e9274caa39e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:e9:95', 'vm-uuid': '16fe26a2-7fe8-409e-97ca-6c44ef2fbddd'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:14:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:24 user nova-compute[73078]: INFO os_vif [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:e9:95,bridge_name='br-int',has_traffic_filtering=True,id=f11c2409-22e3-48a1-a629-e9274caa39e3,network=Network(bcbb9361-92bf-48f3-9d61-e5cdb5d21980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf11c2409-22')
Aug 14 18:14:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:14:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] No VIF found with MAC fa:16:3e:da:e9:95, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:14:25 user nova-compute[73078]: DEBUG nova.network.neutron [req-d1aef7da-aebd-401f-8e74-b39dca5b27a5 req-db0ac85b-9f41-4a5d-a059-fa37e0caa6b3 service nova] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Updated VIF entry in instance network info cache for port f11c2409-22e3-48a1-a629-e9274caa39e3. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:14:25 user nova-compute[73078]: DEBUG nova.network.neutron [req-d1aef7da-aebd-401f-8e74-b39dca5b27a5 req-db0ac85b-9f41-4a5d-a059-fa37e0caa6b3 service nova] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Updating instance_info_cache with network_info: [{"id": "f11c2409-22e3-48a1-a629-e9274caa39e3", "address": "fa:16:3e:da:e9:95", "network": {"id": "bcbb9361-92bf-48f3-9d61-e5cdb5d21980", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1013223391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d0d923a445747d8a812c1b7b4510398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11c2409-22", "ovs_interfaceid": "f11c2409-22e3-48a1-a629-e9274caa39e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:14:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d1aef7da-aebd-401f-8e74-b39dca5b27a5 req-db0ac85b-9f41-4a5d-a059-fa37e0caa6b3 service nova] Releasing lock "refresh_cache-16fe26a2-7fe8-409e-97ca-6c44ef2fbddd" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:14:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:26 user nova-compute[73078]: DEBUG nova.compute.manager [req-03278ff5-cc81-4be3-b345-719743c53779 req-3fecedea-741c-4b50-9218-37a03ca32f20 service nova] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Received event network-vif-plugged-f11c2409-22e3-48a1-a629-e9274caa39e3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:14:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-03278ff5-cc81-4be3-b345-719743c53779 req-3fecedea-741c-4b50-9218-37a03ca32f20 service nova] Acquiring lock "16fe26a2-7fe8-409e-97ca-6c44ef2fbddd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-03278ff5-cc81-4be3-b345-719743c53779 req-3fecedea-741c-4b50-9218-37a03ca32f20 service nova] Lock "16fe26a2-7fe8-409e-97ca-6c44ef2fbddd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-03278ff5-cc81-4be3-b345-719743c53779 req-3fecedea-741c-4b50-9218-37a03ca32f20 service nova] Lock "16fe26a2-7fe8-409e-97ca-6c44ef2fbddd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:26 user nova-compute[73078]: DEBUG nova.compute.manager [req-03278ff5-cc81-4be3-b345-719743c53779 req-3fecedea-741c-4b50-9218-37a03ca32f20 service nova] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] No waiting events found dispatching network-vif-plugged-f11c2409-22e3-48a1-a629-e9274caa39e3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:14:26 user nova-compute[73078]: WARNING nova.compute.manager [req-03278ff5-cc81-4be3-b345-719743c53779 req-3fecedea-741c-4b50-9218-37a03ca32f20 service nova] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Received unexpected event network-vif-plugged-f11c2409-22e3-48a1-a629-e9274caa39e3 for instance with vm_state building and task_state spawning.
Aug 14 18:14:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:28 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036868.4696019, 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:14:28 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] VM Resumed (Lifecycle Event)
Aug 14 18:14:28 user nova-compute[73078]: DEBUG nova.compute.manager [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:14:28 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:14:28 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Instance spawned successfully.
Aug 14 18:14:28 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:14:28 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:14:28 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:14:28 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:14:28 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:14:28 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:14:28 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:14:28 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:14:28 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:14:28 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:14:28 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036868.4750721, 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:14:28 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] VM Started (Lifecycle Event)
Aug 14 18:14:28 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:14:28 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:14:28 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:14:28 user nova-compute[73078]: INFO nova.compute.manager [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Took 5.76 seconds to spawn the instance on the hypervisor.
Aug 14 18:14:28 user nova-compute[73078]: DEBUG nova.compute.manager [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:14:28 user nova-compute[73078]: DEBUG nova.compute.manager [req-ac249b8b-6580-4093-8f87-76c97bb4db72 req-3acf9d07-acf6-4b6e-82dd-dde24537fecc service nova] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Received event network-vif-plugged-f11c2409-22e3-48a1-a629-e9274caa39e3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:14:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ac249b8b-6580-4093-8f87-76c97bb4db72 req-3acf9d07-acf6-4b6e-82dd-dde24537fecc service nova] Acquiring lock "16fe26a2-7fe8-409e-97ca-6c44ef2fbddd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ac249b8b-6580-4093-8f87-76c97bb4db72 req-3acf9d07-acf6-4b6e-82dd-dde24537fecc service nova] Lock "16fe26a2-7fe8-409e-97ca-6c44ef2fbddd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ac249b8b-6580-4093-8f87-76c97bb4db72 req-3acf9d07-acf6-4b6e-82dd-dde24537fecc service nova] Lock "16fe26a2-7fe8-409e-97ca-6c44ef2fbddd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:28 user nova-compute[73078]: DEBUG nova.compute.manager [req-ac249b8b-6580-4093-8f87-76c97bb4db72 req-3acf9d07-acf6-4b6e-82dd-dde24537fecc service nova] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] No waiting events found dispatching network-vif-plugged-f11c2409-22e3-48a1-a629-e9274caa39e3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:14:28 user nova-compute[73078]: WARNING nova.compute.manager [req-ac249b8b-6580-4093-8f87-76c97bb4db72 req-3acf9d07-acf6-4b6e-82dd-dde24537fecc service nova] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Received unexpected event network-vif-plugged-f11c2409-22e3-48a1-a629-e9274caa39e3 for instance with vm_state building and task_state spawning.
Aug 14 18:14:28 user nova-compute[73078]: INFO nova.compute.manager [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Took 6.48 seconds to build instance.
Aug 14 18:14:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4894dfcb-3362-4581-a489-c2fddce6ea9e tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "16fe26a2-7fe8-409e-97ca-6c44ef2fbddd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.590s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:30 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692036855.268898, 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:14:30 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] VM Stopped (Lifecycle Event)
Aug 14 18:14:30 user nova-compute[73078]: DEBUG nova.compute.manager [None req-fd74ce82-f297-407f-8d73-cea37e1af3d4 None None] [instance: 3a0b8f0b-7da1-4e4f-b8cb-b78e9561e223] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:14:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-75dc2b90-f9cd-49fc-bd7f-74a325cf04b3 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Acquiring lock "b97b330e-7a72-4d3c-8810-98a4f3a27ce7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-75dc2b90-f9cd-49fc-bd7f-74a325cf04b3 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Lock "b97b330e-7a72-4d3c-8810-98a4f3a27ce7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-75dc2b90-f9cd-49fc-bd7f-74a325cf04b3 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Acquiring lock "b97b330e-7a72-4d3c-8810-98a4f3a27ce7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-75dc2b90-f9cd-49fc-bd7f-74a325cf04b3 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Lock "b97b330e-7a72-4d3c-8810-98a4f3a27ce7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-75dc2b90-f9cd-49fc-bd7f-74a325cf04b3 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Lock "b97b330e-7a72-4d3c-8810-98a4f3a27ce7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:30 user nova-compute[73078]: INFO nova.compute.manager [None req-75dc2b90-f9cd-49fc-bd7f-74a325cf04b3 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Terminating instance
Aug 14 18:14:30 user nova-compute[73078]: DEBUG nova.compute.manager [None req-75dc2b90-f9cd-49fc-bd7f-74a325cf04b3 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:14:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:30 user nova-compute[73078]: DEBUG nova.compute.manager [req-97609f66-b6f7-43a8-af8c-6c0e0ddffd51 req-9552980e-de13-43a1-ac8b-1dd37f0fd290 service nova] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Received event network-vif-unplugged-a8a4ff9c-da83-430a-aa65-d8eaf189416e {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:14:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-97609f66-b6f7-43a8-af8c-6c0e0ddffd51 req-9552980e-de13-43a1-ac8b-1dd37f0fd290 service nova] Acquiring lock "b97b330e-7a72-4d3c-8810-98a4f3a27ce7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-97609f66-b6f7-43a8-af8c-6c0e0ddffd51 req-9552980e-de13-43a1-ac8b-1dd37f0fd290 service nova] Lock "b97b330e-7a72-4d3c-8810-98a4f3a27ce7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-97609f66-b6f7-43a8-af8c-6c0e0ddffd51 req-9552980e-de13-43a1-ac8b-1dd37f0fd290 service nova] Lock "b97b330e-7a72-4d3c-8810-98a4f3a27ce7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:30 user nova-compute[73078]: DEBUG nova.compute.manager [req-97609f66-b6f7-43a8-af8c-6c0e0ddffd51 req-9552980e-de13-43a1-ac8b-1dd37f0fd290 service nova] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] No waiting events found dispatching network-vif-unplugged-a8a4ff9c-da83-430a-aa65-d8eaf189416e {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:14:30 user nova-compute[73078]: DEBUG nova.compute.manager [req-97609f66-b6f7-43a8-af8c-6c0e0ddffd51 req-9552980e-de13-43a1-ac8b-1dd37f0fd290 service nova] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Received event network-vif-unplugged-a8a4ff9c-da83-430a-aa65-d8eaf189416e for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:14:31 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Instance destroyed successfully.
Aug 14 18:14:31 user nova-compute[73078]: DEBUG nova.objects.instance [None req-75dc2b90-f9cd-49fc-bd7f-74a325cf04b3 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Lazy-loading 'resources' on Instance uuid b97b330e-7a72-4d3c-8810-98a4f3a27ce7 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:14:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-75dc2b90-f9cd-49fc-bd7f-74a325cf04b3 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-78896495',display_name='tempest-VolumesAssistedSnapshotsTest-server-78896495',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-78896495',id=9,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEe8mU50QsNZLPpOcn+22HXSWa2eB13BOVxZVx1mvVZfzXrZAf8I6+uo0CmMNQgJoL3LeSR7L87RS2NAVRRLisJjA/3hQ+MklNctbas3n3I/N8H8R3zSS1AoFnl2k/2PGQ==',key_name='tempest-keypair-1806011428',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:11:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e318b0d535142f2989495f416995a1b',ramdisk_id='',reservation_id='r-rbe50gm7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-678819927',owner_user_name='tempest-VolumesAssistedSnapshotsTest-678819927-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:11:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f3e1886d42204be983df5b9b99cc3050',uuid=b97b330e-7a72-4d3c-8810-98a4f3a27ce7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8a4ff9c-da83-430a-aa65-d8eaf189416e", "address": "fa:16:3e:5b:79:d0", "network": {"id": "2a3295c2-a3cc-40eb-858f-32f664e73d8f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1030215120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e318b0d535142f2989495f416995a1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a4ff9c-da", "ovs_interfaceid": "a8a4ff9c-da83-430a-aa65-d8eaf189416e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:14:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-75dc2b90-f9cd-49fc-bd7f-74a325cf04b3 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Converting VIF {"id": "a8a4ff9c-da83-430a-aa65-d8eaf189416e", "address": "fa:16:3e:5b:79:d0", "network": {"id": "2a3295c2-a3cc-40eb-858f-32f664e73d8f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1030215120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e318b0d535142f2989495f416995a1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a4ff9c-da", "ovs_interfaceid": "a8a4ff9c-da83-430a-aa65-d8eaf189416e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:14:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-75dc2b90-f9cd-49fc-bd7f-74a325cf04b3 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:79:d0,bridge_name='br-int',has_traffic_filtering=True,id=a8a4ff9c-da83-430a-aa65-d8eaf189416e,network=Network(2a3295c2-a3cc-40eb-858f-32f664e73d8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8a4ff9c-da') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:14:31 user nova-compute[73078]: DEBUG os_vif [None req-75dc2b90-f9cd-49fc-bd7f-74a325cf04b3 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:79:d0,bridge_name='br-int',has_traffic_filtering=True,id=a8a4ff9c-da83-430a-aa65-d8eaf189416e,network=Network(2a3295c2-a3cc-40eb-858f-32f664e73d8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8a4ff9c-da') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:14:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8a4ff9c-da, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:14:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:14:31 user nova-compute[73078]: INFO os_vif [None req-75dc2b90-f9cd-49fc-bd7f-74a325cf04b3 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:79:d0,bridge_name='br-int',has_traffic_filtering=True,id=a8a4ff9c-da83-430a-aa65-d8eaf189416e,network=Network(2a3295c2-a3cc-40eb-858f-32f664e73d8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8a4ff9c-da')
Aug 14 18:14:31 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-75dc2b90-f9cd-49fc-bd7f-74a325cf04b3 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Deleting instance files /opt/stack/data/nova/instances/b97b330e-7a72-4d3c-8810-98a4f3a27ce7_del
Aug 14 18:14:31 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-75dc2b90-f9cd-49fc-bd7f-74a325cf04b3 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Deletion of /opt/stack/data/nova/instances/b97b330e-7a72-4d3c-8810-98a4f3a27ce7_del complete
Aug 14 18:14:31 user nova-compute[73078]: INFO nova.compute.manager [None req-75dc2b90-f9cd-49fc-bd7f-74a325cf04b3 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 14 18:14:31 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-75dc2b90-f9cd-49fc-bd7f-74a325cf04b3 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:14:31 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:14:31 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:14:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2df58d83-ccf4-4e1a-847d-c26a169c732f tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Acquiring lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2df58d83-ccf4-4e1a-847d-c26a169c732f tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2df58d83-ccf4-4e1a-847d-c26a169c732f tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Acquiring lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2df58d83-ccf4-4e1a-847d-c26a169c732f tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2df58d83-ccf4-4e1a-847d-c26a169c732f tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:32 user nova-compute[73078]: INFO nova.compute.manager [None req-2df58d83-ccf4-4e1a-847d-c26a169c732f tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Terminating instance
Aug 14 18:14:32 user nova-compute[73078]: DEBUG nova.compute.manager [None req-2df58d83-ccf4-4e1a-847d-c26a169c732f tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:14:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:32 user nova-compute[73078]: DEBUG nova.compute.manager [req-e6efe80f-0ee7-4c69-ae62-f8b837b5dec1 req-82fc25f8-85b3-4bc7-bc66-79fac7ac77b7 service nova] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Received event network-vif-plugged-a8a4ff9c-da83-430a-aa65-d8eaf189416e {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:14:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e6efe80f-0ee7-4c69-ae62-f8b837b5dec1 req-82fc25f8-85b3-4bc7-bc66-79fac7ac77b7 service nova] Acquiring lock "b97b330e-7a72-4d3c-8810-98a4f3a27ce7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e6efe80f-0ee7-4c69-ae62-f8b837b5dec1 req-82fc25f8-85b3-4bc7-bc66-79fac7ac77b7 service nova] Lock "b97b330e-7a72-4d3c-8810-98a4f3a27ce7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e6efe80f-0ee7-4c69-ae62-f8b837b5dec1 req-82fc25f8-85b3-4bc7-bc66-79fac7ac77b7 service nova] Lock "b97b330e-7a72-4d3c-8810-98a4f3a27ce7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:32 user nova-compute[73078]: DEBUG nova.compute.manager [req-e6efe80f-0ee7-4c69-ae62-f8b837b5dec1 req-82fc25f8-85b3-4bc7-bc66-79fac7ac77b7 service nova] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] No waiting events found dispatching network-vif-plugged-a8a4ff9c-da83-430a-aa65-d8eaf189416e {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:14:32 user nova-compute[73078]: WARNING nova.compute.manager [req-e6efe80f-0ee7-4c69-ae62-f8b837b5dec1 req-82fc25f8-85b3-4bc7-bc66-79fac7ac77b7 service nova] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Received unexpected event network-vif-plugged-a8a4ff9c-da83-430a-aa65-d8eaf189416e for instance with vm_state active and task_state deleting.
Aug 14 18:14:32 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:14:32 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Took 1.53 seconds to deallocate network for instance.
Aug 14 18:14:32 user nova-compute[73078]: DEBUG nova.compute.manager [req-bff0debe-c8a4-4df6-9366-c4d4a5e294b6 req-b33eed8d-945e-4b17-99bb-c506c6309bbb service nova] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Received event network-vif-deleted-a8a4ff9c-da83-430a-aa65-d8eaf189416e {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:14:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-75dc2b90-f9cd-49fc-bd7f-74a325cf04b3 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-75dc2b90-f9cd-49fc-bd7f-74a325cf04b3 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:33 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Instance destroyed successfully.
Aug 14 18:14:33 user nova-compute[73078]: DEBUG nova.objects.instance [None req-2df58d83-ccf4-4e1a-847d-c26a169c732f tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lazy-loading 'resources' on Instance uuid ad1d1145-1a70-4a9c-b563-6bda437dc0cc {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:14:33 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-2df58d83-ccf4-4e1a-847d-c26a169c732f tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:11:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-954582950',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-954582950',id=10,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoZf8Rqz7EiN0P+Qjv1ph9KYV+Un7MKTbl1dwK14KSEc1xx5BX1LfWxWzRq6aPqPl/92nhScUmx3GJQuV5xlN5gzpJdNxWJ8eHGLQ/HA+DwQ8SXejqjnnPB+yC1+OGwhQ==',key_name='tempest-keypair-1334960197',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:11:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a49a3016859146b4b30ae80e5fae6e31',ramdisk_id='',reservation_id='r-cn5ox3sk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1236088660',owner_user_name='tempest-TaggedAttachmentsTest-1236088660-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:11:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='218142bc464f4083b053a755d818afca',uuid=ad1d1145-1a70-4a9c-b563-6bda437dc0cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1c66b74-5403-4bfb-9826-7d95c1e92356", "address": "fa:16:3e:56:c1:dd", "network": {"id": "371d3de4-ece5-41b8-8adc-277ac218f7ee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1480740037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a49a3016859146b4b30ae80e5fae6e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c66b74-54", "ovs_interfaceid": "b1c66b74-5403-4bfb-9826-7d95c1e92356", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:14:33 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-2df58d83-ccf4-4e1a-847d-c26a169c732f tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Converting VIF {"id": "b1c66b74-5403-4bfb-9826-7d95c1e92356", "address": "fa:16:3e:56:c1:dd", "network": {"id": "371d3de4-ece5-41b8-8adc-277ac218f7ee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1480740037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a49a3016859146b4b30ae80e5fae6e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c66b74-54", "ovs_interfaceid": "b1c66b74-5403-4bfb-9826-7d95c1e92356", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:14:33 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-2df58d83-ccf4-4e1a-847d-c26a169c732f tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:c1:dd,bridge_name='br-int',has_traffic_filtering=True,id=b1c66b74-5403-4bfb-9826-7d95c1e92356,network=Network(371d3de4-ece5-41b8-8adc-277ac218f7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c66b74-54') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:14:33 user nova-compute[73078]: DEBUG os_vif [None req-2df58d83-ccf4-4e1a-847d-c26a169c732f tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:c1:dd,bridge_name='br-int',has_traffic_filtering=True,id=b1c66b74-5403-4bfb-9826-7d95c1e92356,network=Network(371d3de4-ece5-41b8-8adc-277ac218f7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c66b74-54') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:14:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1c66b74-54, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:14:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:14:33 user nova-compute[73078]: INFO os_vif [None req-2df58d83-ccf4-4e1a-847d-c26a169c732f tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:c1:dd,bridge_name='br-int',has_traffic_filtering=True,id=b1c66b74-5403-4bfb-9826-7d95c1e92356,network=Network(371d3de4-ece5-41b8-8adc-277ac218f7ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c66b74-54')
Aug 14 18:14:33 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-2df58d83-ccf4-4e1a-847d-c26a169c732f tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Deleting instance files /opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc_del
Aug 14 18:14:33 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-2df58d83-ccf4-4e1a-847d-c26a169c732f tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Deletion of /opt/stack/data/nova/instances/ad1d1145-1a70-4a9c-b563-6bda437dc0cc_del complete
Aug 14 18:14:33 user nova-compute[73078]: INFO nova.compute.manager [None req-2df58d83-ccf4-4e1a-847d-c26a169c732f tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 14 18:14:33 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-2df58d83-ccf4-4e1a-847d-c26a169c732f tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:14:33 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:14:33 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:14:33 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-75dc2b90-f9cd-49fc-bd7f-74a325cf04b3 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:14:33 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-75dc2b90-f9cd-49fc-bd7f-74a325cf04b3 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:14:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-75dc2b90-f9cd-49fc-bd7f-74a325cf04b3 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.406s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:33 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-75dc2b90-f9cd-49fc-bd7f-74a325cf04b3 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Deleted allocations for instance b97b330e-7a72-4d3c-8810-98a4f3a27ce7
Aug 14 18:14:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-75dc2b90-f9cd-49fc-bd7f-74a325cf04b3 tempest-VolumesAssistedSnapshotsTest-678819927 tempest-VolumesAssistedSnapshotsTest-678819927-project-member] Lock "b97b330e-7a72-4d3c-8810-98a4f3a27ce7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.070s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:34 user nova-compute[73078]: DEBUG nova.compute.manager [req-0228442e-1227-49f5-986b-1c653d0984e0 req-bb3cc1ce-7676-484c-8aa9-2312e26f36a2 service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Received event network-vif-unplugged-b1c66b74-5403-4bfb-9826-7d95c1e92356 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:14:34 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0228442e-1227-49f5-986b-1c653d0984e0 req-bb3cc1ce-7676-484c-8aa9-2312e26f36a2 service nova] Acquiring lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:34 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0228442e-1227-49f5-986b-1c653d0984e0 req-bb3cc1ce-7676-484c-8aa9-2312e26f36a2 service nova] Lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:34 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0228442e-1227-49f5-986b-1c653d0984e0 req-bb3cc1ce-7676-484c-8aa9-2312e26f36a2 service nova] Lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:34 user nova-compute[73078]: DEBUG nova.compute.manager [req-0228442e-1227-49f5-986b-1c653d0984e0 req-bb3cc1ce-7676-484c-8aa9-2312e26f36a2 service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] No waiting events found dispatching network-vif-unplugged-b1c66b74-5403-4bfb-9826-7d95c1e92356 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:14:34 user nova-compute[73078]: DEBUG nova.compute.manager [req-0228442e-1227-49f5-986b-1c653d0984e0 req-bb3cc1ce-7676-484c-8aa9-2312e26f36a2 service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Received event network-vif-unplugged-b1c66b74-5403-4bfb-9826-7d95c1e92356 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:14:34 user nova-compute[73078]: DEBUG nova.compute.manager [req-0228442e-1227-49f5-986b-1c653d0984e0 req-bb3cc1ce-7676-484c-8aa9-2312e26f36a2 service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Received event network-vif-plugged-b1c66b74-5403-4bfb-9826-7d95c1e92356 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:14:34 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0228442e-1227-49f5-986b-1c653d0984e0 req-bb3cc1ce-7676-484c-8aa9-2312e26f36a2 service nova] Acquiring lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:34 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0228442e-1227-49f5-986b-1c653d0984e0 req-bb3cc1ce-7676-484c-8aa9-2312e26f36a2 service nova] Lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:34 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0228442e-1227-49f5-986b-1c653d0984e0 req-bb3cc1ce-7676-484c-8aa9-2312e26f36a2 service nova] Lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:34 user nova-compute[73078]: DEBUG nova.compute.manager [req-0228442e-1227-49f5-986b-1c653d0984e0 req-bb3cc1ce-7676-484c-8aa9-2312e26f36a2 service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] No waiting events found dispatching network-vif-plugged-b1c66b74-5403-4bfb-9826-7d95c1e92356 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:14:34 user nova-compute[73078]: WARNING nova.compute.manager [req-0228442e-1227-49f5-986b-1c653d0984e0 req-bb3cc1ce-7676-484c-8aa9-2312e26f36a2 service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Received unexpected event network-vif-plugged-b1c66b74-5403-4bfb-9826-7d95c1e92356 for instance with vm_state active and task_state deleting.
Aug 14 18:14:35 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:14:35 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Took 1.84 seconds to deallocate network for instance.
Aug 14 18:14:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2df58d83-ccf4-4e1a-847d-c26a169c732f tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2df58d83-ccf4-4e1a-847d-c26a169c732f tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:35 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-2df58d83-ccf4-4e1a-847d-c26a169c732f tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:14:35 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-2df58d83-ccf4-4e1a-847d-c26a169c732f tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:14:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2df58d83-ccf4-4e1a-847d-c26a169c732f tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:35 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-2df58d83-ccf4-4e1a-847d-c26a169c732f tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Deleted allocations for instance ad1d1145-1a70-4a9c-b563-6bda437dc0cc
Aug 14 18:14:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2df58d83-ccf4-4e1a-847d-c26a169c732f tempest-TaggedAttachmentsTest-1236088660 tempest-TaggedAttachmentsTest-1236088660-project-member] Lock "ad1d1145-1a70-4a9c-b563-6bda437dc0cc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.313s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:37 user nova-compute[73078]: DEBUG nova.compute.manager [req-25e8f704-e237-4e8c-8b66-12c54c6b4835 req-cd586bbb-8221-4591-a397-d45b096e3c1e service nova] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Received event network-vif-deleted-b1c66b74-5403-4bfb-9826-7d95c1e92356 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:14:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:39 user nova-compute[73078]: DEBUG nova.compute.manager [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:14:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:39 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:14:39 user nova-compute[73078]: INFO nova.compute.claims [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Claim successful on node user
Aug 14 18:14:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Acquiring lock "ba60d2d2-656b-4471-aa79-ef95c566583e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lock "ba60d2d2-656b-4471-aa79-ef95c566583e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:39 user nova-compute[73078]: DEBUG nova.compute.manager [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:14:39 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:14:39 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:14:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.554s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:14:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:40 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:14:40 user nova-compute[73078]: INFO nova.compute.claims [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Claim successful on node user
Aug 14 18:14:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:14:40 user nova-compute[73078]: DEBUG nova.network.neutron [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:14:40 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:14:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:14:40 user nova-compute[73078]: DEBUG nova.policy [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0cca1112ab354f9fb31658e18c0d03b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993dd55f40454640824687ffb6a3c581', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:14:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:14:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:14:40 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Creating image(s)
Aug 14 18:14:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "/opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "/opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "/opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:40 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:14:40 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:14:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.204s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.503s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:14:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:14:40 user nova-compute[73078]: DEBUG nova.network.neutron [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:14:40 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:14:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:14:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.203s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk 1073741824" returned: 0 in 0.052s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:14:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:14:40 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Creating image(s)
Aug 14 18:14:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Acquiring lock "/opt/stack/data/nova/instances/ba60d2d2-656b-4471-aa79-ef95c566583e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lock "/opt/stack/data/nova/instances/ba60d2d2-656b-4471-aa79-ef95c566583e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lock "/opt/stack/data/nova/instances/ba60d2d2-656b-4471-aa79-ef95c566583e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:40 user nova-compute[73078]: DEBUG nova.policy [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31255ab4abf34860a048d6f74033c64c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed80f7f96d14ae490e428db42e1f6f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:14:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.182s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:40 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Checking if we can resize image /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:14:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.236s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:41 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Cannot resize image /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:14:41 user nova-compute[73078]: DEBUG nova.objects.instance [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lazy-loading 'migration_context' on Instance uuid 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:14:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:14:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Ensure instance console log exists: /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:14:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.223s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/ba60d2d2-656b-4471-aa79-ef95c566583e/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/ba60d2d2-656b-4471-aa79-ef95c566583e/disk 1073741824" returned: 0 in 0.061s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:41 user nova-compute[73078]: DEBUG nova.network.neutron [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Successfully created port: c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:14:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.184s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:41 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ba60d2d2-656b-4471-aa79-ef95c566583e/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:14:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba60d2d2-656b-4471-aa79-ef95c566583e/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba60d2d2-656b-4471-aa79-ef95c566583e/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:41 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Cannot resize image /opt/stack/data/nova/instances/ba60d2d2-656b-4471-aa79-ef95c566583e/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:14:41 user nova-compute[73078]: DEBUG nova.objects.instance [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lazy-loading 'migration_context' on Instance uuid ba60d2d2-656b-4471-aa79-ef95c566583e {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:14:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:14:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Ensure instance console log exists: /opt/stack/data/nova/instances/ba60d2d2-656b-4471-aa79-ef95c566583e/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:14:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:42 user nova-compute[73078]: DEBUG nova.network.neutron [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Successfully created port: 338f08c1-3cbf-4c3e-9c22-d911182e561a {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:14:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:43 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:14:43 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:14:43 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-3c840309-9884-4c8a-a6ee-1acd44f32c4c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:14:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-3c840309-9884-4c8a-a6ee-1acd44f32c4c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:14:43 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:14:43 user nova-compute[73078]: DEBUG nova.network.neutron [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Successfully updated port: c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:14:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "refresh_cache-72c1fcb2-7828-41b6-b9c7-bd12e7b35c47" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:14:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquired lock "refresh_cache-72c1fcb2-7828-41b6-b9c7-bd12e7b35c47" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:14:43 user nova-compute[73078]: DEBUG nova.network.neutron [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:14:43 user nova-compute[73078]: DEBUG nova.compute.manager [req-63b4afbf-252b-4395-b512-23bbf0bf4f8d req-1b816df8-1f0e-4db9-8794-7f4fe8f5659f service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Received event network-changed-c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:14:43 user nova-compute[73078]: DEBUG nova.compute.manager [req-63b4afbf-252b-4395-b512-23bbf0bf4f8d req-1b816df8-1f0e-4db9-8794-7f4fe8f5659f service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Refreshing instance network info cache due to event network-changed-c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:14:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-63b4afbf-252b-4395-b512-23bbf0bf4f8d req-1b816df8-1f0e-4db9-8794-7f4fe8f5659f service nova] Acquiring lock "refresh_cache-72c1fcb2-7828-41b6-b9c7-bd12e7b35c47" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:14:43 user nova-compute[73078]: DEBUG nova.network.neutron [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:14:43 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Updating instance_info_cache with network_info: [{"id": "03e9ece7-7612-4a4f-86ab-d85b0c97d723", "address": "fa:16:3e:70:6a:64", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e9ece7-76", "ovs_interfaceid": "03e9ece7-7612-4a4f-86ab-d85b0c97d723", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:14:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-3c840309-9884-4c8a-a6ee-1acd44f32c4c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:14:43 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:14:43 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.network.neutron [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Successfully updated port: 338f08c1-3cbf-4c3e-9c22-d911182e561a {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Acquiring lock "refresh_cache-ba60d2d2-656b-4471-aa79-ef95c566583e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Acquired lock "refresh_cache-ba60d2d2-656b-4471-aa79-ef95c566583e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.network.neutron [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.network.neutron [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Updating instance_info_cache with network_info: [{"id": "c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a", "address": "fa:16:3e:59:9d:f2", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93a3c8e-9e", "ovs_interfaceid": "c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Releasing lock "refresh_cache-72c1fcb2-7828-41b6-b9c7-bd12e7b35c47" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.compute.manager [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Instance network_info: |[{"id": "c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a", "address": "fa:16:3e:59:9d:f2", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93a3c8e-9e", "ovs_interfaceid": "c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-63b4afbf-252b-4395-b512-23bbf0bf4f8d req-1b816df8-1f0e-4db9-8794-7f4fe8f5659f service nova] Acquired lock "refresh_cache-72c1fcb2-7828-41b6-b9c7-bd12e7b35c47" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.network.neutron [req-63b4afbf-252b-4395-b512-23bbf0bf4f8d req-1b816df8-1f0e-4db9-8794-7f4fe8f5659f service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Refreshing network info cache for port c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Start _get_guest_xml network_info=[{"id": "c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a", "address": "fa:16:3e:59:9d:f2", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93a3c8e-9e", "ovs_interfaceid": "c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:14:44 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:14:44 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.network.neutron [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:14:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1747051739',display_name='tempest-tempest.common.compute-instance-1747051739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1747051739',id=15,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7MoxQfLpU8YABS9Pw20/hLN1B8HMClZxOewhbMQPCKdvwfAau43e4Qw7i1r0zeStVmZeOs2kcJHkp+76O4z0OTCmnK5xY5GG1VsFRZAQIs0+ge0mW06cadbyyO+FeOxg==',key_name='tempest-keypair-1384674648',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='993dd55f40454640824687ffb6a3c581',ramdisk_id='',reservation_id='r-yhnd265c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1876890021',owner_user_name='tempest-ServerActionsTestOtherA-1876890021-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:14:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cca1112ab354f9fb31658e18c0d03b1',uuid=72c1fcb2-7828-41b6-b9c7-bd12e7b35c47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a", "address": "fa:16:3e:59:9d:f2", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93a3c8e-9e", "ovs_interfaceid": "c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Converting VIF {"id": "c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a", "address": "fa:16:3e:59:9d:f2", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93a3c8e-9e", "ovs_interfaceid": "c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:9d:f2,bridge_name='br-int',has_traffic_filtering=True,id=c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a,network=Network(bfef9745-5a40-44b6-a6d5-2ef1e77fc5db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93a3c8e-9e') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.objects.instance [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lazy-loading 'pci_devices' on Instance uuid 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:14:44 user nova-compute[73078]:   <uuid>72c1fcb2-7828-41b6-b9c7-bd12e7b35c47</uuid>
Aug 14 18:14:44 user nova-compute[73078]:   <name>instance-0000000f</name>
Aug 14 18:14:44 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:14:44 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:14:44 user nova-compute[73078]:   <metadata>
Aug 14 18:14:44 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:14:44 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:14:44 user nova-compute[73078]:       <nova:name>tempest-tempest.common.compute-instance-1747051739</nova:name>
Aug 14 18:14:44 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:14:44</nova:creationTime>
Aug 14 18:14:44 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:14:44 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:14:44 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:14:44 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:14:44 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:14:44 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:14:44 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:14:44 user nova-compute[73078]:       <nova:owner>
Aug 14 18:14:44 user nova-compute[73078]:         <nova:user uuid="0cca1112ab354f9fb31658e18c0d03b1">tempest-ServerActionsTestOtherA-1876890021-project-member</nova:user>
Aug 14 18:14:44 user nova-compute[73078]:         <nova:project uuid="993dd55f40454640824687ffb6a3c581">tempest-ServerActionsTestOtherA-1876890021</nova:project>
Aug 14 18:14:44 user nova-compute[73078]:       </nova:owner>
Aug 14 18:14:44 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:14:44 user nova-compute[73078]:       <nova:ports>
Aug 14 18:14:44 user nova-compute[73078]:         <nova:port uuid="c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a">
Aug 14 18:14:44 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 18:14:44 user nova-compute[73078]:         </nova:port>
Aug 14 18:14:44 user nova-compute[73078]:       </nova:ports>
Aug 14 18:14:44 user nova-compute[73078]:     </nova:instance>
Aug 14 18:14:44 user nova-compute[73078]:   </metadata>
Aug 14 18:14:44 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:14:44 user nova-compute[73078]:     <system>
Aug 14 18:14:44 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:14:44 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:14:44 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:14:44 user nova-compute[73078]:       <entry name="serial">72c1fcb2-7828-41b6-b9c7-bd12e7b35c47</entry>
Aug 14 18:14:44 user nova-compute[73078]:       <entry name="uuid">72c1fcb2-7828-41b6-b9c7-bd12e7b35c47</entry>
Aug 14 18:14:44 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:14:44 user nova-compute[73078]:     </system>
Aug 14 18:14:44 user nova-compute[73078]:   </sysinfo>
Aug 14 18:14:44 user nova-compute[73078]:   <os>
Aug 14 18:14:44 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:14:44 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:14:44 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:14:44 user nova-compute[73078]:   </os>
Aug 14 18:14:44 user nova-compute[73078]:   <features>
Aug 14 18:14:44 user nova-compute[73078]:     <acpi/>
Aug 14 18:14:44 user nova-compute[73078]:     <apic/>
Aug 14 18:14:44 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:14:44 user nova-compute[73078]:   </features>
Aug 14 18:14:44 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:14:44 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:14:44 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:14:44 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:14:44 user nova-compute[73078]:   </clock>
Aug 14 18:14:44 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:14:44 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:14:44 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:14:44 user nova-compute[73078]:   </cpu>
Aug 14 18:14:44 user nova-compute[73078]:   <devices>
Aug 14 18:14:44 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:14:44 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:14:44 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk"/>
Aug 14 18:14:44 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:14:44 user nova-compute[73078]:     </disk>
Aug 14 18:14:44 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:14:44 user nova-compute[73078]:       <mac address="fa:16:3e:59:9d:f2"/>
Aug 14 18:14:44 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:14:44 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:14:44 user nova-compute[73078]:       <target dev="tapc93a3c8e-9e"/>
Aug 14 18:14:44 user nova-compute[73078]:     </interface>
Aug 14 18:14:44 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:14:44 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/console.log" append="off"/>
Aug 14 18:14:44 user nova-compute[73078]:     </serial>
Aug 14 18:14:44 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:14:44 user nova-compute[73078]:     <video>
Aug 14 18:14:44 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:14:44 user nova-compute[73078]:     </video>
Aug 14 18:14:44 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:14:44 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:14:44 user nova-compute[73078]:     </rng>
Aug 14 18:14:44 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:14:44 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:14:44 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:14:44 user nova-compute[73078]:     </memballoon>
Aug 14 18:14:44 user nova-compute[73078]:   </devices>
Aug 14 18:14:44 user nova-compute[73078]: </domain>
Aug 14 18:14:44 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:14:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1747051739',display_name='tempest-tempest.common.compute-instance-1747051739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1747051739',id=15,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7MoxQfLpU8YABS9Pw20/hLN1B8HMClZxOewhbMQPCKdvwfAau43e4Qw7i1r0zeStVmZeOs2kcJHkp+76O4z0OTCmnK5xY5GG1VsFRZAQIs0+ge0mW06cadbyyO+FeOxg==',key_name='tempest-keypair-1384674648',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='993dd55f40454640824687ffb6a3c581',ramdisk_id='',reservation_id='r-yhnd265c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1876890021',owner_user_name='tempest-ServerActionsTestOtherA-1876890021-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:14:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cca1112ab354f9fb31658e18c0d03b1',uuid=72c1fcb2-7828-41b6-b9c7-bd12e7b35c47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a", "address": "fa:16:3e:59:9d:f2", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93a3c8e-9e", "ovs_interfaceid": "c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Converting VIF {"id": "c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a", "address": "fa:16:3e:59:9d:f2", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93a3c8e-9e", "ovs_interfaceid": "c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:9d:f2,bridge_name='br-int',has_traffic_filtering=True,id=c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a,network=Network(bfef9745-5a40-44b6-a6d5-2ef1e77fc5db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93a3c8e-9e') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG os_vif [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:9d:f2,bridge_name='br-int',has_traffic_filtering=True,id=c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a,network=Network(bfef9745-5a40-44b6-a6d5-2ef1e77fc5db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93a3c8e-9e') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc93a3c8e-9e, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc93a3c8e-9e, col_values=(('external_ids', {'iface-id': 'c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:9d:f2', 'vm-uuid': '72c1fcb2-7828-41b6-b9c7-bd12e7b35c47'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:44 user nova-compute[73078]: INFO os_vif [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:9d:f2,bridge_name='br-int',has_traffic_filtering=True,id=c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a,network=Network(bfef9745-5a40-44b6-a6d5-2ef1e77fc5db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93a3c8e-9e')
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] No VIF found with MAC fa:16:3e:59:9d:f2, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.network.neutron [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Updating instance_info_cache with network_info: [{"id": "338f08c1-3cbf-4c3e-9c22-d911182e561a", "address": "fa:16:3e:11:4a:be", "network": {"id": "747446a8-4755-480b-a3b1-44648769bb00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1534750515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed80f7f96d14ae490e428db42e1f6f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap338f08c1-3c", "ovs_interfaceid": "338f08c1-3cbf-4c3e-9c22-d911182e561a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Releasing lock "refresh_cache-ba60d2d2-656b-4471-aa79-ef95c566583e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.compute.manager [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Instance network_info: |[{"id": "338f08c1-3cbf-4c3e-9c22-d911182e561a", "address": "fa:16:3e:11:4a:be", "network": {"id": "747446a8-4755-480b-a3b1-44648769bb00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1534750515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed80f7f96d14ae490e428db42e1f6f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap338f08c1-3c", "ovs_interfaceid": "338f08c1-3cbf-4c3e-9c22-d911182e561a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Start _get_guest_xml network_info=[{"id": "338f08c1-3cbf-4c3e-9c22-d911182e561a", "address": "fa:16:3e:11:4a:be", "network": {"id": "747446a8-4755-480b-a3b1-44648769bb00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1534750515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed80f7f96d14ae490e428db42e1f6f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap338f08c1-3c", "ovs_interfaceid": "338f08c1-3cbf-4c3e-9c22-d911182e561a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:14:44 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:14:44 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:14:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1500269285',display_name='tempest-VolumesActionsTest-instance-1500269285',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1500269285',id=16,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eed80f7f96d14ae490e428db42e1f6f3',ramdisk_id='',reservation_id='r-bnpl8fqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1155799078',owner_user_name='tempest-VolumesActionsTest-1155799078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:14:41Z,user_data=None,user_id='31255ab4abf34860a048d6f74033c64c',uuid=ba60d2d2-656b-4471-aa79-ef95c566583e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "338f08c1-3cbf-4c3e-9c22-d911182e561a", "address": "fa:16:3e:11:4a:be", "network": {"id": "747446a8-4755-480b-a3b1-44648769bb00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1534750515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed80f7f96d14ae490e428db42e1f6f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap338f08c1-3c", "ovs_interfaceid": "338f08c1-3cbf-4c3e-9c22-d911182e561a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Converting VIF {"id": "338f08c1-3cbf-4c3e-9c22-d911182e561a", "address": "fa:16:3e:11:4a:be", "network": {"id": "747446a8-4755-480b-a3b1-44648769bb00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1534750515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed80f7f96d14ae490e428db42e1f6f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap338f08c1-3c", "ovs_interfaceid": "338f08c1-3cbf-4c3e-9c22-d911182e561a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:4a:be,bridge_name='br-int',has_traffic_filtering=True,id=338f08c1-3cbf-4c3e-9c22-d911182e561a,network=Network(747446a8-4755-480b-a3b1-44648769bb00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap338f08c1-3c') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.objects.instance [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lazy-loading 'pci_devices' on Instance uuid ba60d2d2-656b-4471-aa79-ef95c566583e {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:14:44 user nova-compute[73078]:   <uuid>ba60d2d2-656b-4471-aa79-ef95c566583e</uuid>
Aug 14 18:14:44 user nova-compute[73078]:   <name>instance-00000010</name>
Aug 14 18:14:44 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:14:44 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:14:44 user nova-compute[73078]:   <metadata>
Aug 14 18:14:44 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:14:44 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:14:44 user nova-compute[73078]:       <nova:name>tempest-VolumesActionsTest-instance-1500269285</nova:name>
Aug 14 18:14:44 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:14:44</nova:creationTime>
Aug 14 18:14:44 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:14:44 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:14:44 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:14:44 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:14:44 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:14:44 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:14:44 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:14:44 user nova-compute[73078]:       <nova:owner>
Aug 14 18:14:44 user nova-compute[73078]:         <nova:user uuid="31255ab4abf34860a048d6f74033c64c">tempest-VolumesActionsTest-1155799078-project-member</nova:user>
Aug 14 18:14:44 user nova-compute[73078]:         <nova:project uuid="eed80f7f96d14ae490e428db42e1f6f3">tempest-VolumesActionsTest-1155799078</nova:project>
Aug 14 18:14:44 user nova-compute[73078]:       </nova:owner>
Aug 14 18:14:44 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:14:44 user nova-compute[73078]:       <nova:ports>
Aug 14 18:14:44 user nova-compute[73078]:         <nova:port uuid="338f08c1-3cbf-4c3e-9c22-d911182e561a">
Aug 14 18:14:44 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 18:14:44 user nova-compute[73078]:         </nova:port>
Aug 14 18:14:44 user nova-compute[73078]:       </nova:ports>
Aug 14 18:14:44 user nova-compute[73078]:     </nova:instance>
Aug 14 18:14:44 user nova-compute[73078]:   </metadata>
Aug 14 18:14:44 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:14:44 user nova-compute[73078]:     <system>
Aug 14 18:14:44 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:14:44 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:14:44 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:14:44 user nova-compute[73078]:       <entry name="serial">ba60d2d2-656b-4471-aa79-ef95c566583e</entry>
Aug 14 18:14:44 user nova-compute[73078]:       <entry name="uuid">ba60d2d2-656b-4471-aa79-ef95c566583e</entry>
Aug 14 18:14:44 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:14:44 user nova-compute[73078]:     </system>
Aug 14 18:14:44 user nova-compute[73078]:   </sysinfo>
Aug 14 18:14:44 user nova-compute[73078]:   <os>
Aug 14 18:14:44 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:14:44 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:14:44 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:14:44 user nova-compute[73078]:   </os>
Aug 14 18:14:44 user nova-compute[73078]:   <features>
Aug 14 18:14:44 user nova-compute[73078]:     <acpi/>
Aug 14 18:14:44 user nova-compute[73078]:     <apic/>
Aug 14 18:14:44 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:14:44 user nova-compute[73078]:   </features>
Aug 14 18:14:44 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:14:44 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:14:44 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:14:44 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:14:44 user nova-compute[73078]:   </clock>
Aug 14 18:14:44 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:14:44 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:14:44 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:14:44 user nova-compute[73078]:   </cpu>
Aug 14 18:14:44 user nova-compute[73078]:   <devices>
Aug 14 18:14:44 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:14:44 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:14:44 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/ba60d2d2-656b-4471-aa79-ef95c566583e/disk"/>
Aug 14 18:14:44 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:14:44 user nova-compute[73078]:     </disk>
Aug 14 18:14:44 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:14:44 user nova-compute[73078]:       <mac address="fa:16:3e:11:4a:be"/>
Aug 14 18:14:44 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:14:44 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:14:44 user nova-compute[73078]:       <target dev="tap338f08c1-3c"/>
Aug 14 18:14:44 user nova-compute[73078]:     </interface>
Aug 14 18:14:44 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:14:44 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/ba60d2d2-656b-4471-aa79-ef95c566583e/console.log" append="off"/>
Aug 14 18:14:44 user nova-compute[73078]:     </serial>
Aug 14 18:14:44 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:14:44 user nova-compute[73078]:     <video>
Aug 14 18:14:44 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:14:44 user nova-compute[73078]:     </video>
Aug 14 18:14:44 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:14:44 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:14:44 user nova-compute[73078]:     </rng>
Aug 14 18:14:44 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:14:44 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:14:44 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:14:44 user nova-compute[73078]:     </memballoon>
Aug 14 18:14:44 user nova-compute[73078]:   </devices>
Aug 14 18:14:44 user nova-compute[73078]: </domain>
Aug 14 18:14:44 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:14:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1500269285',display_name='tempest-VolumesActionsTest-instance-1500269285',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1500269285',id=16,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eed80f7f96d14ae490e428db42e1f6f3',ramdisk_id='',reservation_id='r-bnpl8fqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1155799078',owner_user_name='tempest-VolumesActionsTest-1155799078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:14:41Z,user_data=None,user_id='31255ab4abf34860a048d6f74033c64c',uuid=ba60d2d2-656b-4471-aa79-ef95c566583e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "338f08c1-3cbf-4c3e-9c22-d911182e561a", "address": "fa:16:3e:11:4a:be", "network": {"id": "747446a8-4755-480b-a3b1-44648769bb00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1534750515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed80f7f96d14ae490e428db42e1f6f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap338f08c1-3c", "ovs_interfaceid": "338f08c1-3cbf-4c3e-9c22-d911182e561a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Converting VIF {"id": "338f08c1-3cbf-4c3e-9c22-d911182e561a", "address": "fa:16:3e:11:4a:be", "network": {"id": "747446a8-4755-480b-a3b1-44648769bb00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1534750515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed80f7f96d14ae490e428db42e1f6f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap338f08c1-3c", "ovs_interfaceid": "338f08c1-3cbf-4c3e-9c22-d911182e561a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:4a:be,bridge_name='br-int',has_traffic_filtering=True,id=338f08c1-3cbf-4c3e-9c22-d911182e561a,network=Network(747446a8-4755-480b-a3b1-44648769bb00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap338f08c1-3c') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG os_vif [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:4a:be,bridge_name='br-int',has_traffic_filtering=True,id=338f08c1-3cbf-4c3e-9c22-d911182e561a,network=Network(747446a8-4755-480b-a3b1-44648769bb00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap338f08c1-3c') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap338f08c1-3c, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap338f08c1-3c, col_values=(('external_ids', {'iface-id': '338f08c1-3cbf-4c3e-9c22-d911182e561a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:4a:be', 'vm-uuid': 'ba60d2d2-656b-4471-aa79-ef95c566583e'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:14:45 user nova-compute[73078]: DEBUG nova.network.neutron [req-63b4afbf-252b-4395-b512-23bbf0bf4f8d req-1b816df8-1f0e-4db9-8794-7f4fe8f5659f service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Updated VIF entry in instance network info cache for port c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:14:45 user nova-compute[73078]: DEBUG nova.network.neutron [req-63b4afbf-252b-4395-b512-23bbf0bf4f8d req-1b816df8-1f0e-4db9-8794-7f4fe8f5659f service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Updating instance_info_cache with network_info: [{"id": "c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a", "address": "fa:16:3e:59:9d:f2", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93a3c8e-9e", "ovs_interfaceid": "c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:14:45 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:45 user nova-compute[73078]: INFO os_vif [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:4a:be,bridge_name='br-int',has_traffic_filtering=True,id=338f08c1-3cbf-4c3e-9c22-d911182e561a,network=Network(747446a8-4755-480b-a3b1-44648769bb00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap338f08c1-3c')
Aug 14 18:14:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-63b4afbf-252b-4395-b512-23bbf0bf4f8d req-1b816df8-1f0e-4db9-8794-7f4fe8f5659f service nova] Releasing lock "refresh_cache-72c1fcb2-7828-41b6-b9c7-bd12e7b35c47" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:14:45 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:14:45 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] No VIF found with MAC fa:16:3e:11:4a:be, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:14:45 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:14:45 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:14:45 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:14:45 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:14:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:45 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:14:45 user nova-compute[73078]: DEBUG nova.compute.manager [req-eb4309ba-ceb9-4cb8-be0e-ab6645a81b74 req-9438887a-7d20-4d68-90cc-79684b2f283e service nova] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Received event network-changed-338f08c1-3cbf-4c3e-9c22-d911182e561a {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:14:45 user nova-compute[73078]: DEBUG nova.compute.manager [req-eb4309ba-ceb9-4cb8-be0e-ab6645a81b74 req-9438887a-7d20-4d68-90cc-79684b2f283e service nova] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Refreshing instance network info cache due to event network-changed-338f08c1-3cbf-4c3e-9c22-d911182e561a. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:14:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-eb4309ba-ceb9-4cb8-be0e-ab6645a81b74 req-9438887a-7d20-4d68-90cc-79684b2f283e service nova] Acquiring lock "refresh_cache-ba60d2d2-656b-4471-aa79-ef95c566583e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:14:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-eb4309ba-ceb9-4cb8-be0e-ab6645a81b74 req-9438887a-7d20-4d68-90cc-79684b2f283e service nova] Acquired lock "refresh_cache-ba60d2d2-656b-4471-aa79-ef95c566583e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:14:45 user nova-compute[73078]: DEBUG nova.network.neutron [req-eb4309ba-ceb9-4cb8-be0e-ab6645a81b74 req-9438887a-7d20-4d68-90cc-79684b2f283e service nova] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Refreshing network info cache for port 338f08c1-3cbf-4c3e-9c22-d911182e561a {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692036871.2175896, b97b330e-7a72-4d3c-8810-98a4f3a27ce7 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:14:46 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] VM Stopped (Lifecycle Event)
Aug 14 18:14:46 user nova-compute[73078]: DEBUG nova.compute.manager [None req-a142dcd7-2dd4-4ee1-8a8d-73438c18f363 None None] [instance: b97b330e-7a72-4d3c-8810-98a4f3a27ce7] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG nova.network.neutron [req-eb4309ba-ceb9-4cb8-be0e-ab6645a81b74 req-9438887a-7d20-4d68-90cc-79684b2f283e service nova] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Updated VIF entry in instance network info cache for port 338f08c1-3cbf-4c3e-9c22-d911182e561a. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG nova.network.neutron [req-eb4309ba-ceb9-4cb8-be0e-ab6645a81b74 req-9438887a-7d20-4d68-90cc-79684b2f283e service nova] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Updating instance_info_cache with network_info: [{"id": "338f08c1-3cbf-4c3e-9c22-d911182e561a", "address": "fa:16:3e:11:4a:be", "network": {"id": "747446a8-4755-480b-a3b1-44648769bb00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1534750515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed80f7f96d14ae490e428db42e1f6f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap338f08c1-3c", "ovs_interfaceid": "338f08c1-3cbf-4c3e-9c22-d911182e561a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Acquiring lock "24c00db3-2457-443d-b5ab-7e6ecaa57515" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-eb4309ba-ceb9-4cb8-be0e-ab6645a81b74 req-9438887a-7d20-4d68-90cc-79684b2f283e service nova] Releasing lock "refresh_cache-ba60d2d2-656b-4471-aa79-ef95c566583e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG nova.objects.instance [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lazy-loading 'flavor' on Instance uuid 24c00db3-2457-443d-b5ab-7e6ecaa57515 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG nova.compute.manager [req-446d9db7-c8c9-45b3-8c50-0b3cd31faa26 req-8871c178-eedc-4b34-9d79-1ca4382961ec service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Received event network-vif-plugged-c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-446d9db7-c8c9-45b3-8c50-0b3cd31faa26 req-8871c178-eedc-4b34-9d79-1ca4382961ec service nova] Acquiring lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-446d9db7-c8c9-45b3-8c50-0b3cd31faa26 req-8871c178-eedc-4b34-9d79-1ca4382961ec service nova] Lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-446d9db7-c8c9-45b3-8c50-0b3cd31faa26 req-8871c178-eedc-4b34-9d79-1ca4382961ec service nova] Lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG nova.compute.manager [req-446d9db7-c8c9-45b3-8c50-0b3cd31faa26 req-8871c178-eedc-4b34-9d79-1ca4382961ec service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] No waiting events found dispatching network-vif-plugged-c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:14:46 user nova-compute[73078]: WARNING nova.compute.manager [req-446d9db7-c8c9-45b3-8c50-0b3cd31faa26 req-8871c178-eedc-4b34-9d79-1ca4382961ec service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Received unexpected event network-vif-plugged-c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a for instance with vm_state building and task_state spawning.
Aug 14 18:14:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Acquiring lock "24c00db3-2457-443d-b5ab-7e6ecaa57515" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:46 user nova-compute[73078]: INFO nova.compute.manager [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Attaching volume cd880623-a7e9-4e11-9490-b18345719272 to /dev/vdb
Aug 14 18:14:46 user nova-compute[73078]: DEBUG os_brick.utils [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90437c9-8555-4b1e-a3f8-34d5943ca690]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a083aac-3df2-42f9-a004-713caf60781b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[437a4782-3b8c-4265-8beb-59e23584ae77]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e47a644-f859-4b72-9b82-ef4304bc60bb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:14:46 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:14:46 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea4f40d-9c3a-4d22-bdcb-9a081156bcf3]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG os_brick.utils [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:14:46 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Updating existing volume attachment record: 8f9dc85b-902d-4d67-bc2b-9739a8a514e6 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:14:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:47 user nova-compute[73078]: DEBUG nova.compute.manager [req-0c4f419d-3d37-4db1-94c2-f8a0968dcb6d req-13fd5e8a-a72d-40c7-9920-7bc567934d8c service nova] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Received event network-vif-plugged-338f08c1-3cbf-4c3e-9c22-d911182e561a {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:14:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0c4f419d-3d37-4db1-94c2-f8a0968dcb6d req-13fd5e8a-a72d-40c7-9920-7bc567934d8c service nova] Acquiring lock "ba60d2d2-656b-4471-aa79-ef95c566583e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0c4f419d-3d37-4db1-94c2-f8a0968dcb6d req-13fd5e8a-a72d-40c7-9920-7bc567934d8c service nova] Lock "ba60d2d2-656b-4471-aa79-ef95c566583e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0c4f419d-3d37-4db1-94c2-f8a0968dcb6d req-13fd5e8a-a72d-40c7-9920-7bc567934d8c service nova] Lock "ba60d2d2-656b-4471-aa79-ef95c566583e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:47 user nova-compute[73078]: DEBUG nova.compute.manager [req-0c4f419d-3d37-4db1-94c2-f8a0968dcb6d req-13fd5e8a-a72d-40c7-9920-7bc567934d8c service nova] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] No waiting events found dispatching network-vif-plugged-338f08c1-3cbf-4c3e-9c22-d911182e561a {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:14:47 user nova-compute[73078]: WARNING nova.compute.manager [req-0c4f419d-3d37-4db1-94c2-f8a0968dcb6d req-13fd5e8a-a72d-40c7-9920-7bc567934d8c service nova] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Received unexpected event network-vif-plugged-338f08c1-3cbf-4c3e-9c22-d911182e561a for instance with vm_state building and task_state spawning.
Aug 14 18:14:48 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692036873.1425753, ad1d1145-1a70-4a9c-b563-6bda437dc0cc => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:14:48 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] VM Stopped (Lifecycle Event)
Aug 14 18:14:48 user nova-compute[73078]: DEBUG nova.compute.manager [None req-2f7c23f8-4943-481c-90a3-eb0474b99d7b None None] [instance: ad1d1145-1a70-4a9c-b563-6bda437dc0cc] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:14:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:48 user nova-compute[73078]: DEBUG nova.compute.manager [req-a3ae8895-7bbe-4a6c-8bdd-dc438dbb8a72 req-45bc403c-fa23-4e6b-82f7-a4f5bc36c7e7 service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Received event network-vif-plugged-c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:14:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a3ae8895-7bbe-4a6c-8bdd-dc438dbb8a72 req-45bc403c-fa23-4e6b-82f7-a4f5bc36c7e7 service nova] Acquiring lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a3ae8895-7bbe-4a6c-8bdd-dc438dbb8a72 req-45bc403c-fa23-4e6b-82f7-a4f5bc36c7e7 service nova] Lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a3ae8895-7bbe-4a6c-8bdd-dc438dbb8a72 req-45bc403c-fa23-4e6b-82f7-a4f5bc36c7e7 service nova] Lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:48 user nova-compute[73078]: DEBUG nova.compute.manager [req-a3ae8895-7bbe-4a6c-8bdd-dc438dbb8a72 req-45bc403c-fa23-4e6b-82f7-a4f5bc36c7e7 service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] No waiting events found dispatching network-vif-plugged-c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:14:48 user nova-compute[73078]: WARNING nova.compute.manager [req-a3ae8895-7bbe-4a6c-8bdd-dc438dbb8a72 req-45bc403c-fa23-4e6b-82f7-a4f5bc36c7e7 service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Received unexpected event network-vif-plugged-c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a for instance with vm_state building and task_state spawning.
Aug 14 18:14:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16fe26a2-7fe8-409e-97ca-6c44ef2fbddd/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "8d257202-d8ab-4161-9b67-045cf1e36772" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "8d257202-d8ab-4161-9b67-045cf1e36772" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.003s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:49 user nova-compute[73078]: INFO nova.compute.manager [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Unshelving
Aug 14 18:14:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16fe26a2-7fe8-409e-97ca-6c44ef2fbddd/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16fe26a2-7fe8-409e-97ca-6c44ef2fbddd/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:49 user nova-compute[73078]: INFO nova.virt.block_device [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Booting with volume 9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 at /dev/vdc
Aug 14 18:14:49 user nova-compute[73078]: DEBUG os_brick.utils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3b53ca-6770-4cbd-86f2-55580263cd8c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[37db0b69-8769-4fda-b041-1e19fd555ef7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16fe26a2-7fe8-409e-97ca-6c44ef2fbddd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bd1474-d04b-4f2a-8be9-b93a1a041f9d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[522a6ec2-cbc4-4c62-ac2a-b19381d5f61a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:14:49 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:14:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5016c6-869e-4069-90e7-d401dd3c4587]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG os_brick.utils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Updating existing volume attachment record: 51a9a200-04cb-439d-8162-115a7df383c0 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG nova.compute.manager [req-8dd44d1c-9c2f-4331-af44-ff25248cbd6e req-bcd43a28-c436-4c7d-8690-3c0787b4488a service nova] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Received event network-vif-plugged-338f08c1-3cbf-4c3e-9c22-d911182e561a {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-8dd44d1c-9c2f-4331-af44-ff25248cbd6e req-bcd43a28-c436-4c7d-8690-3c0787b4488a service nova] Acquiring lock "ba60d2d2-656b-4471-aa79-ef95c566583e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-8dd44d1c-9c2f-4331-af44-ff25248cbd6e req-bcd43a28-c436-4c7d-8690-3c0787b4488a service nova] Lock "ba60d2d2-656b-4471-aa79-ef95c566583e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-8dd44d1c-9c2f-4331-af44-ff25248cbd6e req-bcd43a28-c436-4c7d-8690-3c0787b4488a service nova] Lock "ba60d2d2-656b-4471-aa79-ef95c566583e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG nova.compute.manager [req-8dd44d1c-9c2f-4331-af44-ff25248cbd6e req-bcd43a28-c436-4c7d-8690-3c0787b4488a service nova] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] No waiting events found dispatching network-vif-plugged-338f08c1-3cbf-4c3e-9c22-d911182e561a {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:14:49 user nova-compute[73078]: WARNING nova.compute.manager [req-8dd44d1c-9c2f-4331-af44-ff25248cbd6e req-bcd43a28-c436-4c7d-8690-3c0787b4488a service nova] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Received unexpected event network-vif-plugged-338f08c1-3cbf-4c3e-9c22-d911182e561a for instance with vm_state building and task_state spawning.
Aug 14 18:14:49 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036889.8963695, 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:14:49 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] VM Resumed (Lifecycle Event)
Aug 14 18:14:49 user nova-compute[73078]: DEBUG nova.compute.manager [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG nova.compute.manager [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:14:49 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Instance spawned successfully.
Aug 14 18:14:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:14:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba60d2d2-656b-4471-aa79-ef95c566583e/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:50 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Instance spawned successfully.
Aug 14 18:14:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:14:50 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:14:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:14:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:14:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:14:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:14:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:14:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:14:50 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:14:50 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036889.8996744, 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:14:50 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] VM Started (Lifecycle Event)
Aug 14 18:14:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:14:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:14:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:14:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:14:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:14:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:14:50 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:14:50 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:14:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba60d2d2-656b-4471-aa79-ef95c566583e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba60d2d2-656b-4471-aa79-ef95c566583e/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:50 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:14:50 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036889.905218, ba60d2d2-656b-4471-aa79-ef95c566583e => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:14:50 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] VM Resumed (Lifecycle Event)
Aug 14 18:14:50 user nova-compute[73078]: INFO nova.compute.manager [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Took 9.36 seconds to spawn the instance on the hypervisor.
Aug 14 18:14:50 user nova-compute[73078]: DEBUG nova.compute.manager [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:14:50 user nova-compute[73078]: INFO nova.compute.manager [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Took 9.91 seconds to spawn the instance on the hypervisor.
Aug 14 18:14:50 user nova-compute[73078]: DEBUG nova.compute.manager [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:14:50 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:14:50 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:14:50 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:14:50 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036889.907252, ba60d2d2-656b-4471-aa79-ef95c566583e => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:14:50 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] VM Started (Lifecycle Event)
Aug 14 18:14:50 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:14:50 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:14:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba60d2d2-656b-4471-aa79-ef95c566583e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:50 user nova-compute[73078]: INFO nova.compute.manager [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Took 10.31 seconds to build instance.
Aug 14 18:14:50 user nova-compute[73078]: INFO nova.compute.manager [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Took 10.90 seconds to build instance.
Aug 14 18:14:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b039b8d9-0683-495a-ae4e-c9f65a0333e7 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lock "ba60d2d2-656b-4471-aa79-ef95c566583e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.601s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-53035dc1-accb-4ec6-89ce-965cec15c22d tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.064s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8ad453e-67b1-4af2-b85b-a5e100c11446/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8ad453e-67b1-4af2-b85b-a5e100c11446/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8ad453e-67b1-4af2-b85b-a5e100c11446/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8ad453e-67b1-4af2-b85b-a5e100c11446/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:53 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:14:53 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:14:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=7699MB free_disk=25.545330047607422GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:14:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance de80e188-9385-4613-8a6c-aa72b624ad55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:14:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 1f88cb97-4f22-439e-99f2-d7cb8d5aff36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:14:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 3c840309-9884-4c8a-a6ee-1acd44f32c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:14:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 24c00db3-2457-443d-b5ab-7e6ecaa57515 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:14:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:14:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance e8ad453e-67b1-4af2-b85b-a5e100c11446 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:14:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:14:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:14:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance ba60d2d2-656b-4471-aa79-ef95c566583e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:14:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 8d257202-d8ab-4161-9b67-045cf1e36772 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 14 18:14:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:14:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:14:53 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:14:53 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:14:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:14:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.645s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:54 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:14:54 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:14:54 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:14:54 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:14:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:56 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:14:56 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XefjBbVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:14:56 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:14:56 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:14:56 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:14:56 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:14:56 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:14:56 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:14:56 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:14:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f7ff29-9bd2-482e-9fe7-cdc2211be0b4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:14:57 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f96fbd8-21e7-4534-91f9-c068a5aff005]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272] added
Aug 14 18:14:57 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f98202b-4ccd-4a94-9f64-1d9e83171b9e]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[175bdc4b-b59b-4cff-9fe0-171fefe00c1a]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XefjBbVt {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XefjBbVt" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97e1706-ca34-46c0-83f4-34e969a287ce]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XefjBbVt'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f08d484-7178-4934-bf00-9f63123505c1]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e17706-eb71-4c69-9de3-a1cb0b3bf080]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 18:14:57 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 18:14:57 user nova-compute[73078]:  {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:14:57 user nova-compute[73078]: WARNING os_brick.initiator.connectors.iscsi [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 18:14:57 user nova-compute[73078]: 
Aug 14 18:14:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da654d8-f00e-47e0-8872-4e95da69c97f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272, portal: 172.16.0.220,3260]
Aug 14 18:14:57 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272, portal: 172.16.0.220,3260] successful.
Aug 14 18:14:57 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c24ee92-62b2-4171-8fe2-4e578969abbc]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4060fafe-8f89-4d32-9e88-f73ceb60f818]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:14:57 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:14:57 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6412808-ed6b-4655-92b9-6a429ea5fdd0]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XefjBbVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:14:57 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:14:58 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:14:58 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26263623536306532', 'path': '/dev/sdb'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:14:58 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263623536306532', 'path': '/dev/sdb'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:14:58 user nova-compute[73078]: DEBUG nova.objects.instance [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lazy-loading 'flavor' on Instance uuid 24c00db3-2457-443d-b5ab-7e6ecaa57515 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:14:58 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 18:14:58 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:14:58 user nova-compute[73078]:   <source dev="/dev/sdb"/>
Aug 14 18:14:58 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:14:58 user nova-compute[73078]:   <serial>cd880623-a7e9-4e11-9490-b18345719272</serial>
Aug 14 18:14:58 user nova-compute[73078]: </disk>
Aug 14 18:14:58 user nova-compute[73078]:  {{(pid=73078) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 18:14:58 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:14:58 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:14:58 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] No VIF found with MAC fa:16:3e:ce:cd:93, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:14:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-7a4a64e9-509a-4fb9-96ae-8cf89fb396dc tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.430s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:14:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:14:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:14:59 user nova-compute[73078]: DEBUG nova.objects.instance [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lazy-loading 'pci_requests' on Instance uuid 8d257202-d8ab-4161-9b67-045cf1e36772 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:14:59 user nova-compute[73078]: DEBUG nova.objects.instance [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lazy-loading 'numa_topology' on Instance uuid 8d257202-d8ab-4161-9b67-045cf1e36772 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:14:59 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:14:59 user nova-compute[73078]: INFO nova.compute.claims [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Claim successful on node user
Aug 14 18:14:59 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:14:59 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:14:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.527s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:15:00 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:00 user nova-compute[73078]: INFO nova.network.neutron [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Updating port 10688f4a-5919-4a48-9767-92e304a494be with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 14 18:15:00 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "refresh_cache-8d257202-d8ab-4161-9b67-045cf1e36772" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:15:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquired lock "refresh_cache-8d257202-d8ab-4161-9b67-045cf1e36772" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:15:00 user nova-compute[73078]: DEBUG nova.network.neutron [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:15:01 user nova-compute[73078]: DEBUG nova.compute.manager [req-d1046f53-7284-444d-8a3e-b03ae113c448 req-1ec23850-caa1-4645-b2f1-3a798e985dba service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Received event network-changed-10688f4a-5919-4a48-9767-92e304a494be {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:15:01 user nova-compute[73078]: DEBUG nova.compute.manager [req-d1046f53-7284-444d-8a3e-b03ae113c448 req-1ec23850-caa1-4645-b2f1-3a798e985dba service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Refreshing instance network info cache due to event network-changed-10688f4a-5919-4a48-9767-92e304a494be. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:15:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d1046f53-7284-444d-8a3e-b03ae113c448 req-1ec23850-caa1-4645-b2f1-3a798e985dba service nova] Acquiring lock "refresh_cache-8d257202-d8ab-4161-9b67-045cf1e36772" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:15:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-347b9496-c3d4-4c0f-9e8b-1285f5961b47 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Acquiring lock "e8ad453e-67b1-4af2-b85b-a5e100c11446" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:15:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-347b9496-c3d4-4c0f-9e8b-1285f5961b47 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Lock "e8ad453e-67b1-4af2-b85b-a5e100c11446" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:15:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-347b9496-c3d4-4c0f-9e8b-1285f5961b47 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Acquiring lock "e8ad453e-67b1-4af2-b85b-a5e100c11446-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:15:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-347b9496-c3d4-4c0f-9e8b-1285f5961b47 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Lock "e8ad453e-67b1-4af2-b85b-a5e100c11446-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:15:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-347b9496-c3d4-4c0f-9e8b-1285f5961b47 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Lock "e8ad453e-67b1-4af2-b85b-a5e100c11446-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:15:01 user nova-compute[73078]: DEBUG nova.compute.manager [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Stashing vm_state: active {{(pid=73078) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 14 18:15:01 user nova-compute[73078]: INFO nova.compute.manager [None req-347b9496-c3d4-4c0f-9e8b-1285f5961b47 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Terminating instance
Aug 14 18:15:01 user nova-compute[73078]: DEBUG nova.compute.manager [None req-347b9496-c3d4-4c0f-9e8b-1285f5961b47 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:15:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:01 user nova-compute[73078]: DEBUG nova.network.neutron [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Updating instance_info_cache with network_info: [{"id": "10688f4a-5919-4a48-9767-92e304a494be", "address": "fa:16:3e:a4:3b:fc", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10688f4a-59", "ovs_interfaceid": "10688f4a-5919-4a48-9767-92e304a494be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:15:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:15:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:15:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Releasing lock "refresh_cache-8d257202-d8ab-4161-9b67-045cf1e36772" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:15:01 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:15:01 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Creating image(s)
Aug 14 18:15:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:15:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "/opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:15:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "/opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:15:01 user nova-compute[73078]: DEBUG nova.objects.instance [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8d257202-d8ab-4161-9b67-045cf1e36772 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:15:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d1046f53-7284-444d-8a3e-b03ae113c448 req-1ec23850-caa1-4645-b2f1-3a798e985dba service nova] Acquired lock "refresh_cache-8d257202-d8ab-4161-9b67-045cf1e36772" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:15:01 user nova-compute[73078]: DEBUG nova.network.neutron [req-d1046f53-7284-444d-8a3e-b03ae113c448 req-1ec23850-caa1-4645-b2f1-3a798e985dba service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Refreshing network info cache for port 10688f4a-5919-4a48-9767-92e304a494be {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:15:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "568fabfab401eb06d37ca3f3d52e2452384ffc5e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:15:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "568fabfab401eb06d37ca3f3d52e2452384ffc5e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:15:01 user nova-compute[73078]: DEBUG nova.objects.instance [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lazy-loading 'pci_requests' on Instance uuid 24c00db3-2457-443d-b5ab-7e6ecaa57515 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:15:01 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:15:01 user nova-compute[73078]: INFO nova.compute.claims [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Claim successful on node user
Aug 14 18:15:01 user nova-compute[73078]: DEBUG nova.objects.instance [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lazy-loading 'resources' on Instance uuid 24c00db3-2457-443d-b5ab-7e6ecaa57515 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:15:01 user nova-compute[73078]: DEBUG nova.objects.instance [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lazy-loading 'pci_devices' on Instance uuid 24c00db3-2457-443d-b5ab-7e6ecaa57515 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:15:01 user nova-compute[73078]: DEBUG nova.compute.manager [req-65658b7f-b96f-40c8-9ff6-6616f3f682ab req-88d23f65-5ffb-44ab-a1a7-008c4ad18582 service nova] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Received event network-vif-unplugged-90186594-310a-4bfa-8593-6a6f54bb2b9b {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:15:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-65658b7f-b96f-40c8-9ff6-6616f3f682ab req-88d23f65-5ffb-44ab-a1a7-008c4ad18582 service nova] Acquiring lock "e8ad453e-67b1-4af2-b85b-a5e100c11446-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:15:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-65658b7f-b96f-40c8-9ff6-6616f3f682ab req-88d23f65-5ffb-44ab-a1a7-008c4ad18582 service nova] Lock "e8ad453e-67b1-4af2-b85b-a5e100c11446-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:15:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-65658b7f-b96f-40c8-9ff6-6616f3f682ab req-88d23f65-5ffb-44ab-a1a7-008c4ad18582 service nova] Lock "e8ad453e-67b1-4af2-b85b-a5e100c11446-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:15:01 user nova-compute[73078]: DEBUG nova.compute.manager [req-65658b7f-b96f-40c8-9ff6-6616f3f682ab req-88d23f65-5ffb-44ab-a1a7-008c4ad18582 service nova] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] No waiting events found dispatching network-vif-unplugged-90186594-310a-4bfa-8593-6a6f54bb2b9b {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:15:01 user nova-compute[73078]: DEBUG nova.compute.manager [req-65658b7f-b96f-40c8-9ff6-6616f3f682ab req-88d23f65-5ffb-44ab-a1a7-008c4ad18582 service nova] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Received event network-vif-unplugged-90186594-310a-4bfa-8593-6a6f54bb2b9b for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:15:01 user nova-compute[73078]: INFO nova.compute.resource_tracker [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Updating resource usage from migration bc0b08ea-7f2e-432b-800c-8d8bf1f62e7e
Aug 14 18:15:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/568fabfab401eb06d37ca3f3d52e2452384ffc5e.part --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:03 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Instance destroyed successfully.
Aug 14 18:15:03 user nova-compute[73078]: DEBUG nova.objects.instance [None req-347b9496-c3d4-4c0f-9e8b-1285f5961b47 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Lazy-loading 'resources' on Instance uuid e8ad453e-67b1-4af2-b85b-a5e100c11446 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:15:03 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-347b9496-c3d4-4c0f-9e8b-1285f5961b47 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:11:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1932067530',display_name='tempest-TestVolumeSwap-server-1932067530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1932067530',id=11,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1qD74k+0A+CGZH4FmLSk7pczeoOLYVT4w4voMOha8WcIJ0XkevKDGlOWb/p8s4XbdwrPYPr3ffaebu8wIFk0SP0izdJHS5i48ERdCP8s5M5lQ8m6wuzGM3RTuHiR96BA==',key_name='tempest-keypair-220951710',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:11:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3db9e1b022b443dda66d26e1bf57e984',ramdisk_id='',reservation_id='r-81nzjlca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-353943783',owner_user_name='tempest-TestVolumeSwap-353943783-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:11:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcd61cb2421c4613b2b13d1e03639f0c',uuid=e8ad453e-67b1-4af2-b85b-a5e100c11446,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90186594-310a-4bfa-8593-6a6f54bb2b9b", "address": "fa:16:3e:2d:b8:f6", "network": {"id": "da640f78-a5e9-4ca4-9daa-cbe9f39866a7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1049608594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3db9e1b022b443dda66d26e1bf57e984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90186594-31", "ovs_interfaceid": "90186594-310a-4bfa-8593-6a6f54bb2b9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:15:03 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-347b9496-c3d4-4c0f-9e8b-1285f5961b47 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Converting VIF {"id": "90186594-310a-4bfa-8593-6a6f54bb2b9b", "address": "fa:16:3e:2d:b8:f6", "network": {"id": "da640f78-a5e9-4ca4-9daa-cbe9f39866a7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1049608594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3db9e1b022b443dda66d26e1bf57e984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90186594-31", "ovs_interfaceid": "90186594-310a-4bfa-8593-6a6f54bb2b9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:15:03 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-347b9496-c3d4-4c0f-9e8b-1285f5961b47 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:b8:f6,bridge_name='br-int',has_traffic_filtering=True,id=90186594-310a-4bfa-8593-6a6f54bb2b9b,network=Network(da640f78-a5e9-4ca4-9daa-cbe9f39866a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90186594-31') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:15:03 user nova-compute[73078]: DEBUG os_vif [None req-347b9496-c3d4-4c0f-9e8b-1285f5961b47 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:b8:f6,bridge_name='br-int',has_traffic_filtering=True,id=90186594-310a-4bfa-8593-6a6f54bb2b9b,network=Network(da640f78-a5e9-4ca4-9daa-cbe9f39866a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90186594-31') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:15:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90186594-31, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:15:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:15:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:03 user nova-compute[73078]: INFO os_vif [None req-347b9496-c3d4-4c0f-9e8b-1285f5961b47 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:b8:f6,bridge_name='br-int',has_traffic_filtering=True,id=90186594-310a-4bfa-8593-6a6f54bb2b9b,network=Network(da640f78-a5e9-4ca4-9daa-cbe9f39866a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90186594-31')
Aug 14 18:15:03 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-347b9496-c3d4-4c0f-9e8b-1285f5961b47 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Deleting instance files /opt/stack/data/nova/instances/e8ad453e-67b1-4af2-b85b-a5e100c11446_del
Aug 14 18:15:03 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-347b9496-c3d4-4c0f-9e8b-1285f5961b47 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Deletion of /opt/stack/data/nova/instances/e8ad453e-67b1-4af2-b85b-a5e100c11446_del complete
Aug 14 18:15:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/568fabfab401eb06d37ca3f3d52e2452384ffc5e.part --force-share --output=json" returned: 0 in 0.216s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:03 user nova-compute[73078]: DEBUG nova.virt.images [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] 91f020a1-ab3f-4e4e-a06f-8c52ac45f099 was qcow2, converting to raw {{(pid=73078) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 18:15:03 user nova-compute[73078]: DEBUG nova.privsep.utils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73078) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 18:15:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/568fabfab401eb06d37ca3f3d52e2452384ffc5e.part /opt/stack/data/nova/instances/_base/568fabfab401eb06d37ca3f3d52e2452384ffc5e.converted {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:03 user nova-compute[73078]: INFO nova.compute.manager [None req-347b9496-c3d4-4c0f-9e8b-1285f5961b47 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Took 1.84 seconds to destroy the instance on the hypervisor.
Aug 14 18:15:03 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-347b9496-c3d4-4c0f-9e8b-1285f5961b47 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:15:03 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:15:03 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:15:03 user nova-compute[73078]: DEBUG nova.network.neutron [req-d1046f53-7284-444d-8a3e-b03ae113c448 req-1ec23850-caa1-4645-b2f1-3a798e985dba service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Updated VIF entry in instance network info cache for port 10688f4a-5919-4a48-9767-92e304a494be. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:15:03 user nova-compute[73078]: DEBUG nova.network.neutron [req-d1046f53-7284-444d-8a3e-b03ae113c448 req-1ec23850-caa1-4645-b2f1-3a798e985dba service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Updating instance_info_cache with network_info: [{"id": "10688f4a-5919-4a48-9767-92e304a494be", "address": "fa:16:3e:a4:3b:fc", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10688f4a-59", "ovs_interfaceid": "10688f4a-5919-4a48-9767-92e304a494be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:15:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d1046f53-7284-444d-8a3e-b03ae113c448 req-1ec23850-caa1-4645-b2f1-3a798e985dba service nova] Releasing lock "refresh_cache-8d257202-d8ab-4161-9b67-045cf1e36772" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:15:03 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:15:03 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:15:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.071s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:15:03 user nova-compute[73078]: INFO nova.compute.manager [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Migrating
Aug 14 18:15:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:15:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Acquired lock "compute-rpcapi-router" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:15:03 user nova-compute[73078]: INFO nova.compute.rpcapi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 14 18:15:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Releasing lock "compute-rpcapi-router" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:15:03 user nova-compute[73078]: DEBUG nova.compute.manager [req-df0958a0-9015-4504-8211-01852dad9ac4 req-a8d45d7b-a9fe-4696-9e3f-6c07cb98bf5b service nova] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Received event network-vif-plugged-90186594-310a-4bfa-8593-6a6f54bb2b9b {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:15:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-df0958a0-9015-4504-8211-01852dad9ac4 req-a8d45d7b-a9fe-4696-9e3f-6c07cb98bf5b service nova] Acquiring lock "e8ad453e-67b1-4af2-b85b-a5e100c11446-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:15:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-df0958a0-9015-4504-8211-01852dad9ac4 req-a8d45d7b-a9fe-4696-9e3f-6c07cb98bf5b service nova] Lock "e8ad453e-67b1-4af2-b85b-a5e100c11446-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:15:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-df0958a0-9015-4504-8211-01852dad9ac4 req-a8d45d7b-a9fe-4696-9e3f-6c07cb98bf5b service nova] Lock "e8ad453e-67b1-4af2-b85b-a5e100c11446-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:15:03 user nova-compute[73078]: DEBUG nova.compute.manager [req-df0958a0-9015-4504-8211-01852dad9ac4 req-a8d45d7b-a9fe-4696-9e3f-6c07cb98bf5b service nova] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] No waiting events found dispatching network-vif-plugged-90186594-310a-4bfa-8593-6a6f54bb2b9b {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:15:03 user nova-compute[73078]: WARNING nova.compute.manager [req-df0958a0-9015-4504-8211-01852dad9ac4 req-a8d45d7b-a9fe-4696-9e3f-6c07cb98bf5b service nova] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Received unexpected event network-vif-plugged-90186594-310a-4bfa-8593-6a6f54bb2b9b for instance with vm_state active and task_state deleting.
Aug 14 18:15:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Acquiring lock "refresh_cache-24c00db3-2457-443d-b5ab-7e6ecaa57515" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:15:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Acquired lock "refresh_cache-24c00db3-2457-443d-b5ab-7e6ecaa57515" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:15:03 user nova-compute[73078]: DEBUG nova.network.neutron [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:15:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/568fabfab401eb06d37ca3f3d52e2452384ffc5e.part /opt/stack/data/nova/instances/_base/568fabfab401eb06d37ca3f3d52e2452384ffc5e.converted" returned: 0 in 0.750s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/568fabfab401eb06d37ca3f3d52e2452384ffc5e.converted --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/568fabfab401eb06d37ca3f3d52e2452384ffc5e.converted --force-share --output=json" returned: 0 in 0.292s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "568fabfab401eb06d37ca3f3d52e2452384ffc5e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.652s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:15:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/568fabfab401eb06d37ca3f3d52e2452384ffc5e --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/568fabfab401eb06d37ca3f3d52e2452384ffc5e --force-share --output=json" returned: 0 in 0.341s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "568fabfab401eb06d37ca3f3d52e2452384ffc5e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:15:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "568fabfab401eb06d37ca3f3d52e2452384ffc5e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:15:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/568fabfab401eb06d37ca3f3d52e2452384ffc5e --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/568fabfab401eb06d37ca3f3d52e2452384ffc5e --force-share --output=json" returned: 0 in 0.224s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/568fabfab401eb06d37ca3f3d52e2452384ffc5e,backing_fmt=raw /opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:05 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/568fabfab401eb06d37ca3f3d52e2452384ffc5e,backing_fmt=raw /opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/disk 1073741824" returned: 0 in 0.075s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:05 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "568fabfab401eb06d37ca3f3d52e2452384ffc5e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:15:05 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/568fabfab401eb06d37ca3f3d52e2452384ffc5e --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:05 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/568fabfab401eb06d37ca3f3d52e2452384ffc5e --force-share --output=json" returned: 0 in 0.230s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:05 user nova-compute[73078]: DEBUG nova.objects.instance [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lazy-loading 'migration_context' on Instance uuid 8d257202-d8ab-4161-9b67-045cf1e36772 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:15:05 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Rebasing disk image.
Aug 14 18:15:05 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:05 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.209s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:05 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd -F raw /opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/disk {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:05 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:15:05 user nova-compute[73078]: DEBUG nova.network.neutron [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Updating instance_info_cache with network_info: [{"id": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "address": "fa:16:3e:ce:cd:93", "network": {"id": "1ec1577a-2943-44e6-9fd6-9d8308fcf09f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-135315381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09794ca2aebc4f50a4ab26cecefb4d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d8f3d6-2e", "ovs_interfaceid": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:15:05 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Took 2.41 seconds to deallocate network for instance.
Aug 14 18:15:05 user nova-compute[73078]: DEBUG nova.compute.manager [req-6905f9fa-05c4-4ddf-b7ee-074313b9f507 req-a69277ba-f351-4907-863b-fa37316167ba service nova] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Received event network-vif-deleted-90186594-310a-4bfa-8593-6a6f54bb2b9b {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:15:05 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Releasing lock "refresh_cache-24c00db3-2457-443d-b5ab-7e6ecaa57515" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:15:05 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-347b9496-c3d4-4c0f-9e8b-1285f5961b47 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:15:05 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-347b9496-c3d4-4c0f-9e8b-1285f5961b47 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Starting migrate_disk_and_power_off {{(pid=73078) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-347b9496-c3d4-4c0f-9e8b-1285f5961b47 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-347b9496-c3d4-4c0f-9e8b-1285f5961b47 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG nova.compute.manager [req-326db137-80c6-485d-98b3-d4f35853d65a req-93b1406e-9675-4c48-b8d0-c397a20fb672 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Received event network-vif-unplugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-326db137-80c6-485d-98b3-d4f35853d65a req-93b1406e-9675-4c48-b8d0-c397a20fb672 service nova] Acquiring lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-326db137-80c6-485d-98b3-d4f35853d65a req-93b1406e-9675-4c48-b8d0-c397a20fb672 service nova] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-326db137-80c6-485d-98b3-d4f35853d65a req-93b1406e-9675-4c48-b8d0-c397a20fb672 service nova] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG nova.compute.manager [req-326db137-80c6-485d-98b3-d4f35853d65a req-93b1406e-9675-4c48-b8d0-c397a20fb672 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] No waiting events found dispatching network-vif-unplugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:15:06 user nova-compute[73078]: WARNING nova.compute.manager [req-326db137-80c6-485d-98b3-d4f35853d65a req-93b1406e-9675-4c48-b8d0-c397a20fb672 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Received unexpected event network-vif-unplugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 for instance with vm_state active and task_state resize_migrating.
Aug 14 18:15:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-347b9496-c3d4-4c0f-9e8b-1285f5961b47 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.515s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:15:06 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-347b9496-c3d4-4c0f-9e8b-1285f5961b47 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Deleted allocations for instance e8ad453e-67b1-4af2-b85b-a5e100c11446
Aug 14 18:15:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-347b9496-c3d4-4c0f-9e8b-1285f5961b47 tempest-TestVolumeSwap-353943783 tempest-TestVolumeSwap-353943783-project-member] Lock "e8ad453e-67b1-4af2-b85b-a5e100c11446" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.045s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:06 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Instance destroyed successfully.
Aug 14 18:15:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-800184995',display_name='tempest-ServerActionsTestOtherB-server-800184995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-800184995',id=5,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbnc7U7feBP7majde5yxGnuBaGos4MxLqvnB0BjKphlc0UqHWP3CzhimKim+Kv31+0a1u5JyxtEQSRk/yFbj17pMkgZ6K1nerehXIw6QXdILWEOhFCV63jMfH8QM13ghA==',key_name='tempest-keypair-2079056104',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:11:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='09794ca2aebc4f50a4ab26cecefb4d0c',ramdisk_id='',reservation_id='r-ikq8fsl0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-727924132',owner_user_name='tempest-ServerActionsTestOtherB-727924132-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:15:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ad487c5160a4dd8b9a03d468edf4bef',uuid=24c00db3-2457-443d-b5ab-7e6ecaa57515,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "address": "fa:16:3e:ce:cd:93", "network": {"id": "1ec1577a-2943-44e6-9fd6-9d8308fcf09f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-135315381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-135315381-network", "vif_mac": "fa:16:3e:ce:cd:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09794ca2aebc4f50a4ab26cecefb4d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d8f3d6-2e", "ovs_interfaceid": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Converting VIF {"id": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "address": "fa:16:3e:ce:cd:93", "network": {"id": "1ec1577a-2943-44e6-9fd6-9d8308fcf09f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-135315381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-135315381-network", "vif_mac": "fa:16:3e:ce:cd:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09794ca2aebc4f50a4ab26cecefb4d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d8f3d6-2e", "ovs_interfaceid": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:cd:93,bridge_name='br-int',has_traffic_filtering=True,id=99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563,network=Network(1ec1577a-2943-44e6-9fd6-9d8308fcf09f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d8f3d6-2e') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG os_vif [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:cd:93,bridge_name='br-int',has_traffic_filtering=True,id=99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563,network=Network(1ec1577a-2943-44e6-9fd6-9d8308fcf09f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d8f3d6-2e') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99d8f3d6-2e, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:15:06 user nova-compute[73078]: INFO os_vif [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:cd:93,bridge_name='br-int',has_traffic_filtering=True,id=99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563,network=Network(1ec1577a-2943-44e6-9fd6-9d8308fcf09f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d8f3d6-2e')
Aug 14 18:15:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XefjBbVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:15:06 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:15:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9aa506f-67fe-4c86-b636-e97e6ac8f143]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad84c7d1-61a6-4745-a07d-a42ab01815b4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:15:06 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:15:06 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe97828f520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272'): ({'sdb'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Removing single pathed devices sdb {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:15:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.034s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bf2703-8eac-4875-8b69-cbab80bc63c8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.046s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede813f6-69cc-4a87-a33b-ad0cadb00a45]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Flushing IO for device /dev/sdb {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8958647-aa0d-4434-925b-4281a06e5413]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.109s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd97b0e0-e124-43b3-a1cb-278b3f763117]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] SCSI volumes sdb have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.076s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[201fda70-d9ce-492a-9028-9b90bf5ea102]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c467a073-3785-4620-a56d-855a06cf6b77]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272, portal: 172.16.0.220,3260]
Aug 14 18:15:07 user nova-compute[73078]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272, portal: 172.16.0.220,3260] successful.
Aug 14 18:15:07 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e11ed85-e4ce-4f10-8f6a-3ffa1f71c366]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.568s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] <== disconnect_volume: return (573ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:15:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515_resize/disk /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd -F raw /opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/disk" returned: 0 in 3.154s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Ensure instance console log exists: /opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Start _get_guest_xml network_info=[{"id": "10688f4a-5919-4a48-9767-92e304a494be", "address": "fa:16:3e:a4:3b:fc", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10688f4a-59", "ovs_interfaceid": "10688f4a-5919-4a48-9767-92e304a494be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='4e6494270fa4120daf5711af068c490b',container_format='bare',created_at=2023-08-14T18:12:56Z,direct_url=<?>,disk_format='qcow2',id=91f020a1-ab3f-4e4e-a06f-8c52ac45f099,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-371462966-shelved',owner='5f00de2496804d6eb570f93307f3f088',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-14T18:13:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'attachment_id': '51a9a200-04cb-439d-8162-115a7df383c0', 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXDlMzTO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '8d257202-d8ab-4161-9b67-045cf1e36772', 'attached_at': '', 'detached_at': '', 'volume_id': '9a7941bf-b1da-44d2-8c65-184a4ac9b3a0', 'serial': '9a7941bf-b1da-44d2-8c65-184a4ac9b3a0'}, 'volume_type': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:15:08 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:15:08 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:15:08 user nova-compute[73078]: DEBUG nova.compute.manager [req-db2a9942-032e-407f-a9f2-e0c90ec9fb1d req-daf2bb40-5baf-469d-b558-7d99f3627a92 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Received event network-vif-plugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-db2a9942-032e-407f-a9f2-e0c90ec9fb1d req-daf2bb40-5baf-469d-b558-7d99f3627a92 service nova] Acquiring lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-db2a9942-032e-407f-a9f2-e0c90ec9fb1d req-daf2bb40-5baf-469d-b558-7d99f3627a92 service nova] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-db2a9942-032e-407f-a9f2-e0c90ec9fb1d req-daf2bb40-5baf-469d-b558-7d99f3627a92 service nova] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG nova.compute.manager [req-db2a9942-032e-407f-a9f2-e0c90ec9fb1d req-daf2bb40-5baf-469d-b558-7d99f3627a92 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] No waiting events found dispatching network-vif-plugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:15:08 user nova-compute[73078]: WARNING nova.compute.manager [req-db2a9942-032e-407f-a9f2-e0c90ec9fb1d req-daf2bb40-5baf-469d-b558-7d99f3627a92 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Received unexpected event network-vif-plugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 for instance with vm_state active and task_state resize_migrating.
Aug 14 18:15:08 user nova-compute[73078]: DEBUG nova.compute.manager [req-db2a9942-032e-407f-a9f2-e0c90ec9fb1d req-daf2bb40-5baf-469d-b558-7d99f3627a92 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Received event network-vif-plugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-db2a9942-032e-407f-a9f2-e0c90ec9fb1d req-daf2bb40-5baf-469d-b558-7d99f3627a92 service nova] Acquiring lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-db2a9942-032e-407f-a9f2-e0c90ec9fb1d req-daf2bb40-5baf-469d-b558-7d99f3627a92 service nova] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-db2a9942-032e-407f-a9f2-e0c90ec9fb1d req-daf2bb40-5baf-469d-b558-7d99f3627a92 service nova] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG nova.compute.manager [req-db2a9942-032e-407f-a9f2-e0c90ec9fb1d req-daf2bb40-5baf-469d-b558-7d99f3627a92 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] No waiting events found dispatching network-vif-plugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:15:08 user nova-compute[73078]: WARNING nova.compute.manager [req-db2a9942-032e-407f-a9f2-e0c90ec9fb1d req-daf2bb40-5baf-469d-b558-7d99f3627a92 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Received unexpected event network-vif-plugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 for instance with vm_state active and task_state resize_migrating.
Aug 14 18:15:08 user nova-compute[73078]: DEBUG nova.compute.manager [req-db2a9942-032e-407f-a9f2-e0c90ec9fb1d req-daf2bb40-5baf-469d-b558-7d99f3627a92 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Received event network-vif-plugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-db2a9942-032e-407f-a9f2-e0c90ec9fb1d req-daf2bb40-5baf-469d-b558-7d99f3627a92 service nova] Acquiring lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-db2a9942-032e-407f-a9f2-e0c90ec9fb1d req-daf2bb40-5baf-469d-b558-7d99f3627a92 service nova] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-db2a9942-032e-407f-a9f2-e0c90ec9fb1d req-daf2bb40-5baf-469d-b558-7d99f3627a92 service nova] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG nova.compute.manager [req-db2a9942-032e-407f-a9f2-e0c90ec9fb1d req-daf2bb40-5baf-469d-b558-7d99f3627a92 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] No waiting events found dispatching network-vif-plugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:15:08 user nova-compute[73078]: WARNING nova.compute.manager [req-db2a9942-032e-407f-a9f2-e0c90ec9fb1d req-daf2bb40-5baf-469d-b558-7d99f3627a92 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Received unexpected event network-vif-plugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 for instance with vm_state active and task_state resize_migrating.
Aug 14 18:15:08 user nova-compute[73078]: DEBUG nova.compute.manager [req-db2a9942-032e-407f-a9f2-e0c90ec9fb1d req-daf2bb40-5baf-469d-b558-7d99f3627a92 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Received event network-vif-unplugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-db2a9942-032e-407f-a9f2-e0c90ec9fb1d req-daf2bb40-5baf-469d-b558-7d99f3627a92 service nova] Acquiring lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-db2a9942-032e-407f-a9f2-e0c90ec9fb1d req-daf2bb40-5baf-469d-b558-7d99f3627a92 service nova] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-db2a9942-032e-407f-a9f2-e0c90ec9fb1d req-daf2bb40-5baf-469d-b558-7d99f3627a92 service nova] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG nova.compute.manager [req-db2a9942-032e-407f-a9f2-e0c90ec9fb1d req-daf2bb40-5baf-469d-b558-7d99f3627a92 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] No waiting events found dispatching network-vif-unplugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:15:08 user nova-compute[73078]: WARNING nova.compute.manager [req-db2a9942-032e-407f-a9f2-e0c90ec9fb1d req-daf2bb40-5baf-469d-b558-7d99f3627a92 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Received unexpected event network-vif-unplugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 for instance with vm_state active and task_state resize_migrating.
Aug 14 18:15:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='4e6494270fa4120daf5711af068c490b',container_format='bare',created_at=2023-08-14T18:12:56Z,direct_url=<?>,disk_format='qcow2',id=91f020a1-ab3f-4e4e-a06f-8c52ac45f099,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-371462966-shelved',owner='5f00de2496804d6eb570f93307f3f088',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-14T18:13:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG nova.objects.instance [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8d257202-d8ab-4161-9b67-045cf1e36772 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXDlMzTO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:15:08 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:15:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:15:08 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:15:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:15:08 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:15:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a030c8a-8b86-4f95-96b1-ff5a6b7bb1e8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:15:08 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dea664a-d192-4fe0-bfa5-fd17aa869aa0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0] added
Aug 14 18:15:08 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2f6ac7-bc19-431b-a5e3-608e0df108af]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c9f112-c6d4-41ef-b39d-bfd8d79bf10f]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gXDlMzTO {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gXDlMzTO" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbac1b8-c94b-4030-b0ac-66b7030a7e18]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gXDlMzTO'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:15:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:09 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[128b0397-a020-48f1-9cee-21f4a104a4fa]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:15:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:09 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b99d061-679e-4a5b-b668-a4a6b7eb3ecb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 18:15:09 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:15:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 18:15:09 user nova-compute[73078]:  {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:15:09 user nova-compute[73078]: WARNING os_brick.initiator.connectors.iscsi [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 18:15:09 user nova-compute[73078]: 
Aug 14 18:15:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:09 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5360da4-ec89-46dc-b44f-8892214d2ab6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0, portal: 172.16.0.220,3260]
Aug 14 18:15:09 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0, portal: 172.16.0.220,3260] successful.
Aug 14 18:15:09 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:15:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:09 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[42aef118-a1b2-42ce-b91e-09750bcdf8cf]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:15:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] CMD "cp -r /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515_resize/disk /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk" returned: 0 in 1.221s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515_resize/disk.info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk.info {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:09 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bce15a-82cc-4fc9-a456-435d72f85b4b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 (non-flash)
Aug 14 18:15:09 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:15:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 (non-flash)
Aug 14 18:15:09 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:15:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:15:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:15:09 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:15:09 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:15:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] CMD "cp -r /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515_resize/disk.info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk.info" returned: 0 in 0.048s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:09 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28206fb-9e68-4cf0-9d34-9e9410d4fa1f]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:09 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:15:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXDlMzTO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:15:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:15:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23034306564353963', 'path': '/dev/sdb'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:15:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034306564353963', 'path': '/dev/sdb'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:15:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T18:10:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-371462966',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-371462966',id=6,image_ref='91f020a1-ab3f-4e4e-a06f-8c52ac45f099',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1699997067',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:11:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5f00de2496804d6eb570f93307f3f088',ramdisk_id='',reservation_id='r-m6qase30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1593185714',owner_user_name='tempest-AttachVolumeShelveTestJSON-1593185714-project-member',shelved_at='2023-08-14T18:13:01.912652',shelved_host='user',shelved_image_id='91f020a1-ab3f-4e4e-a06f-8c52ac45f099'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:14:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b07aecccb704835b6b765325b1d18bf',uuid=8d257202-d8ab-4161-9b67-045cf1e36772,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "10688f4a-5919-4a48-9767-92e304a494be", "address": "fa:16:3e:a4:3b:fc", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10688f4a-59", "ovs_interfaceid": "10688f4a-5919-4a48-9767-92e304a494be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:15:10 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Converting VIF {"id": "10688f4a-5919-4a48-9767-92e304a494be", "address": "fa:16:3e:a4:3b:fc", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10688f4a-59", "ovs_interfaceid": "10688f4a-5919-4a48-9767-92e304a494be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:15:10 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:3b:fc,bridge_name='br-int',has_traffic_filtering=True,id=10688f4a-5919-4a48-9767-92e304a494be,network=Network(a3adc062-ecf8-4c88-84ab-69425b236920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10688f4a-59') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:15:10 user nova-compute[73078]: DEBUG nova.objects.instance [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d257202-d8ab-4161-9b67-045cf1e36772 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:15:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:15:10 user nova-compute[73078]:   <uuid>8d257202-d8ab-4161-9b67-045cf1e36772</uuid>
Aug 14 18:15:10 user nova-compute[73078]:   <name>instance-00000006</name>
Aug 14 18:15:10 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:15:10 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:15:10 user nova-compute[73078]:   <metadata>
Aug 14 18:15:10 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:15:10 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:15:10 user nova-compute[73078]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-371462966</nova:name>
Aug 14 18:15:10 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:15:08</nova:creationTime>
Aug 14 18:15:10 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:15:10 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:15:10 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:15:10 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:15:10 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:15:10 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:15:10 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:15:10 user nova-compute[73078]:       <nova:owner>
Aug 14 18:15:10 user nova-compute[73078]:         <nova:user uuid="2b07aecccb704835b6b765325b1d18bf">tempest-AttachVolumeShelveTestJSON-1593185714-project-member</nova:user>
Aug 14 18:15:10 user nova-compute[73078]:         <nova:project uuid="5f00de2496804d6eb570f93307f3f088">tempest-AttachVolumeShelveTestJSON-1593185714</nova:project>
Aug 14 18:15:10 user nova-compute[73078]:       </nova:owner>
Aug 14 18:15:10 user nova-compute[73078]:       <nova:root type="image" uuid="91f020a1-ab3f-4e4e-a06f-8c52ac45f099"/>
Aug 14 18:15:10 user nova-compute[73078]:       <nova:ports>
Aug 14 18:15:10 user nova-compute[73078]:         <nova:port uuid="10688f4a-5919-4a48-9767-92e304a494be">
Aug 14 18:15:10 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 18:15:10 user nova-compute[73078]:         </nova:port>
Aug 14 18:15:10 user nova-compute[73078]:       </nova:ports>
Aug 14 18:15:10 user nova-compute[73078]:     </nova:instance>
Aug 14 18:15:10 user nova-compute[73078]:   </metadata>
Aug 14 18:15:10 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:15:10 user nova-compute[73078]:     <system>
Aug 14 18:15:10 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:15:10 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:15:10 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:15:10 user nova-compute[73078]:       <entry name="serial">8d257202-d8ab-4161-9b67-045cf1e36772</entry>
Aug 14 18:15:10 user nova-compute[73078]:       <entry name="uuid">8d257202-d8ab-4161-9b67-045cf1e36772</entry>
Aug 14 18:15:10 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:15:10 user nova-compute[73078]:     </system>
Aug 14 18:15:10 user nova-compute[73078]:   </sysinfo>
Aug 14 18:15:10 user nova-compute[73078]:   <os>
Aug 14 18:15:10 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:15:10 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:15:10 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:15:10 user nova-compute[73078]:   </os>
Aug 14 18:15:10 user nova-compute[73078]:   <features>
Aug 14 18:15:10 user nova-compute[73078]:     <acpi/>
Aug 14 18:15:10 user nova-compute[73078]:     <apic/>
Aug 14 18:15:10 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:15:10 user nova-compute[73078]:   </features>
Aug 14 18:15:10 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:15:10 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:15:10 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:15:10 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:15:10 user nova-compute[73078]:   </clock>
Aug 14 18:15:10 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:15:10 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:15:10 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:15:10 user nova-compute[73078]:   </cpu>
Aug 14 18:15:10 user nova-compute[73078]:   <devices>
Aug 14 18:15:10 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:15:10 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:15:10 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/disk"/>
Aug 14 18:15:10 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:15:10 user nova-compute[73078]:     </disk>
Aug 14 18:15:10 user nova-compute[73078]:     <disk type="block" device="disk">
Aug 14 18:15:10 user nova-compute[73078]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:15:10 user nova-compute[73078]:       <source dev="/dev/sdb"/>
Aug 14 18:15:10 user nova-compute[73078]:       <target dev="vdc" bus="virtio"/>
Aug 14 18:15:10 user nova-compute[73078]:       <serial>9a7941bf-b1da-44d2-8c65-184a4ac9b3a0</serial>
Aug 14 18:15:10 user nova-compute[73078]:     </disk>
Aug 14 18:15:10 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:15:10 user nova-compute[73078]:       <mac address="fa:16:3e:a4:3b:fc"/>
Aug 14 18:15:10 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:15:10 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:15:10 user nova-compute[73078]:       <target dev="tap10688f4a-59"/>
Aug 14 18:15:10 user nova-compute[73078]:     </interface>
Aug 14 18:15:10 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:15:10 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/console.log" append="off"/>
Aug 14 18:15:10 user nova-compute[73078]:     </serial>
Aug 14 18:15:10 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:15:10 user nova-compute[73078]:     <video>
Aug 14 18:15:10 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:15:10 user nova-compute[73078]:     </video>
Aug 14 18:15:10 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:15:10 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:15:10 user nova-compute[73078]:     </rng>
Aug 14 18:15:10 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:15:10 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:15:10 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:15:10 user nova-compute[73078]:     </memballoon>
Aug 14 18:15:10 user nova-compute[73078]:   </devices>
Aug 14 18:15:10 user nova-compute[73078]: </domain>
Aug 14 18:15:10 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:15:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T18:10:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-371462966',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-371462966',id=6,image_ref='91f020a1-ab3f-4e4e-a06f-8c52ac45f099',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1699997067',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:11:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5f00de2496804d6eb570f93307f3f088',ramdisk_id='',reservation_id='r-m6qase30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1593185714',owner_user_name='tempest-AttachVolumeShelveTestJSON-1593185714-project-member',shelved_at='2023-08-14T18:13:01.912652',shelved_host='user',shelved_image_id='91f020a1-ab3f-4e4e-a06f-8c52ac45f099'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:14:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b07aecccb704835b6b765325b1d18bf',uuid=8d257202-d8ab-4161-9b67-045cf1e36772,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "10688f4a-5919-4a48-9767-92e304a494be", "address": "fa:16:3e:a4:3b:fc", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10688f4a-59", "ovs_interfaceid": "10688f4a-5919-4a48-9767-92e304a494be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:15:10 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Converting VIF {"id": "10688f4a-5919-4a48-9767-92e304a494be", "address": "fa:16:3e:a4:3b:fc", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10688f4a-59", "ovs_interfaceid": "10688f4a-5919-4a48-9767-92e304a494be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:15:10 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:3b:fc,bridge_name='br-int',has_traffic_filtering=True,id=10688f4a-5919-4a48-9767-92e304a494be,network=Network(a3adc062-ecf8-4c88-84ab-69425b236920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10688f4a-59') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:15:10 user nova-compute[73078]: DEBUG os_vif [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:3b:fc,bridge_name='br-int',has_traffic_filtering=True,id=10688f4a-5919-4a48-9767-92e304a494be,network=Network(a3adc062-ecf8-4c88-84ab-69425b236920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10688f4a-59') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:15:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:15:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:15:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10688f4a-59, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:15:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap10688f4a-59, col_values=(('external_ids', {'iface-id': '10688f4a-5919-4a48-9767-92e304a494be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:3b:fc', 'vm-uuid': '8d257202-d8ab-4161-9b67-045cf1e36772'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:15:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:15:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:10 user nova-compute[73078]: INFO os_vif [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:3b:fc,bridge_name='br-int',has_traffic_filtering=True,id=10688f4a-5919-4a48-9767-92e304a494be,network=Network(a3adc062-ecf8-4c88-84ab-69425b236920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10688f4a-59')
Aug 14 18:15:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:15:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:15:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] No VIF found with MAC fa:16:3e:a4:3b:fc, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:15:10 user nova-compute[73078]: DEBUG nova.network.neutron [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Port 99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 binding to destination host user is already ACTIVE {{(pid=73078) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 14 18:15:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Acquiring lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:15:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:15:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:15:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Acquiring lock "refresh_cache-24c00db3-2457-443d-b5ab-7e6ecaa57515" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:15:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Acquired lock "refresh_cache-24c00db3-2457-443d-b5ab-7e6ecaa57515" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:15:10 user nova-compute[73078]: DEBUG nova.network.neutron [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:15:10 user nova-compute[73078]: DEBUG nova.compute.manager [req-14a955a7-98ab-422a-a010-bf43863f9167 req-4e42f431-66f0-4e0c-9bad-f1585e81106d service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Received event network-vif-plugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:15:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-14a955a7-98ab-422a-a010-bf43863f9167 req-4e42f431-66f0-4e0c-9bad-f1585e81106d service nova] Acquiring lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:15:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-14a955a7-98ab-422a-a010-bf43863f9167 req-4e42f431-66f0-4e0c-9bad-f1585e81106d service nova] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:15:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-14a955a7-98ab-422a-a010-bf43863f9167 req-4e42f431-66f0-4e0c-9bad-f1585e81106d service nova] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:15:10 user nova-compute[73078]: DEBUG nova.compute.manager [req-14a955a7-98ab-422a-a010-bf43863f9167 req-4e42f431-66f0-4e0c-9bad-f1585e81106d service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] No waiting events found dispatching network-vif-plugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:15:10 user nova-compute[73078]: WARNING nova.compute.manager [req-14a955a7-98ab-422a-a010-bf43863f9167 req-4e42f431-66f0-4e0c-9bad-f1585e81106d service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Received unexpected event network-vif-plugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 for instance with vm_state active and task_state resize_migrated.
Aug 14 18:15:11 user nova-compute[73078]: DEBUG nova.network.neutron [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Updating instance_info_cache with network_info: [{"id": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "address": "fa:16:3e:ce:cd:93", "network": {"id": "1ec1577a-2943-44e6-9fd6-9d8308fcf09f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-135315381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09794ca2aebc4f50a4ab26cecefb4d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d8f3d6-2e", "ovs_interfaceid": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:15:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Releasing lock "refresh_cache-24c00db3-2457-443d-b5ab-7e6ecaa57515" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:15:11 user nova-compute[73078]: DEBUG os_brick.utils [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:15:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ea0a4c-ac0c-44bc-bfbb-a2380035b0a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcedae2-89c0-47bf-8aba-73005331c629]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e513ff-8785-41bc-b841-2e8fee0aa1bc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[358b6a6e-aa32-4208-b28c-b918ca9f43be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:15:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:15:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:15:11 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:15:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[727deb7d-6692-4719-a6b1-e369014caf32]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:15:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:15:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:15:11 user nova-compute[73078]: DEBUG os_brick.utils [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:15:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:12 user nova-compute[73078]: DEBUG nova.compute.manager [req-4f6a9cf5-7a2e-4474-aee2-287aeec1171a req-c7d51997-a741-40e8-a6df-6905ee68e1f0 service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Received event network-vif-plugged-10688f4a-5919-4a48-9767-92e304a494be {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:15:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4f6a9cf5-7a2e-4474-aee2-287aeec1171a req-c7d51997-a741-40e8-a6df-6905ee68e1f0 service nova] Acquiring lock "8d257202-d8ab-4161-9b67-045cf1e36772-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:15:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4f6a9cf5-7a2e-4474-aee2-287aeec1171a req-c7d51997-a741-40e8-a6df-6905ee68e1f0 service nova] Lock "8d257202-d8ab-4161-9b67-045cf1e36772-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:15:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4f6a9cf5-7a2e-4474-aee2-287aeec1171a req-c7d51997-a741-40e8-a6df-6905ee68e1f0 service nova] Lock "8d257202-d8ab-4161-9b67-045cf1e36772-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:15:12 user nova-compute[73078]: DEBUG nova.compute.manager [req-4f6a9cf5-7a2e-4474-aee2-287aeec1171a req-c7d51997-a741-40e8-a6df-6905ee68e1f0 service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] No waiting events found dispatching network-vif-plugged-10688f4a-5919-4a48-9767-92e304a494be {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:15:12 user nova-compute[73078]: WARNING nova.compute.manager [req-4f6a9cf5-7a2e-4474-aee2-287aeec1171a req-c7d51997-a741-40e8-a6df-6905ee68e1f0 service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Received unexpected event network-vif-plugged-10688f4a-5919-4a48-9767-92e304a494be for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 18:15:14 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036914.731894, 8d257202-d8ab-4161-9b67-045cf1e36772 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:15:14 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] VM Resumed (Lifecycle Event)
Aug 14 18:15:14 user nova-compute[73078]: DEBUG nova.compute.manager [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:15:14 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:15:14 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Instance spawned successfully.
Aug 14 18:15:14 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:15:14 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:15:14 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:15:14 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036914.7428765, 8d257202-d8ab-4161-9b67-045cf1e36772 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:15:14 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] VM Started (Lifecycle Event)
Aug 14 18:15:14 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:15:14 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:15:14 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:15:14 user nova-compute[73078]: DEBUG nova.compute.manager [req-e44edaba-01a8-4d71-92f8-238cd40f16da req-acd66be0-09a7-47c6-bc25-1b8dc0487209 service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Received event network-vif-plugged-10688f4a-5919-4a48-9767-92e304a494be {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:15:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e44edaba-01a8-4d71-92f8-238cd40f16da req-acd66be0-09a7-47c6-bc25-1b8dc0487209 service nova] Acquiring lock "8d257202-d8ab-4161-9b67-045cf1e36772-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:15:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e44edaba-01a8-4d71-92f8-238cd40f16da req-acd66be0-09a7-47c6-bc25-1b8dc0487209 service nova] Lock "8d257202-d8ab-4161-9b67-045cf1e36772-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:15:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e44edaba-01a8-4d71-92f8-238cd40f16da req-acd66be0-09a7-47c6-bc25-1b8dc0487209 service nova] Lock "8d257202-d8ab-4161-9b67-045cf1e36772-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:15:14 user nova-compute[73078]: DEBUG nova.compute.manager [req-e44edaba-01a8-4d71-92f8-238cd40f16da req-acd66be0-09a7-47c6-bc25-1b8dc0487209 service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] No waiting events found dispatching network-vif-plugged-10688f4a-5919-4a48-9767-92e304a494be {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:15:14 user nova-compute[73078]: WARNING nova.compute.manager [req-e44edaba-01a8-4d71-92f8-238cd40f16da req-acd66be0-09a7-47c6-bc25-1b8dc0487209 service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Received unexpected event network-vif-plugged-10688f4a-5919-4a48-9767-92e304a494be for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 18:15:15 user nova-compute[73078]: DEBUG nova.compute.manager [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:15:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aa504cc0-f4d6-4ada-a978-b282aaa3fab4 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "8d257202-d8ab-4161-9b67-045cf1e36772" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 26.106s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:15:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:18 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692036902.3347433, e8ad453e-67b1-4af2-b85b-a5e100c11446 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:15:18 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] VM Stopped (Lifecycle Event)
Aug 14 18:15:18 user nova-compute[73078]: DEBUG nova.compute.manager [None req-fce94222-c4c2-4023-8503-5e9417c1255a None None] [instance: e8ad453e-67b1-4af2-b85b-a5e100c11446] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:15:20 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:21 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Starting finish_migration {{(pid=73078) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 14 18:15:21 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Instance directory exists: not creating {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 18:15:21 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Creating image(s)
Aug 14 18:15:21 user nova-compute[73078]: DEBUG nova.objects.instance [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lazy-loading 'trusted_certs' on Instance uuid 24c00db3-2457-443d-b5ab-7e6ecaa57515 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:15:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:21 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692036906.81316, 24c00db3-2457-443d-b5ab-7e6ecaa57515 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:15:21 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] VM Stopped (Lifecycle Event)
Aug 14 18:15:21 user nova-compute[73078]: DEBUG nova.compute.manager [None req-e362b05f-fbf4-4a33-ae13-cd40d120be38 None None] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:15:21 user nova-compute[73078]: DEBUG nova.compute.manager [None req-e362b05f-fbf4-4a33-ae13-cd40d120be38 None None] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:15:21 user nova-compute[73078]: INFO nova.compute.manager [None req-e362b05f-fbf4-4a33-ae13-cd40d120be38 None None] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.278s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Checking if we can resize image /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk. size=21474836480 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk 21474836480 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk 21474836480" returned: 0 in 0.052s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Did not create local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Ensure instance console log exists: /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Start _get_guest_xml network_info=[{"id": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "address": "fa:16:3e:ce:cd:93", "network": {"id": "1ec1577a-2943-44e6-9fd6-9d8308fcf09f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-135315381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-135315381-network", "vif_mac": "fa:16:3e:ce:cd:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09794ca2aebc4f50a4ab26cecefb4d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d8f3d6-2e", "ovs_interfaceid": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': 'c013bd7d-d40d-4dab-bb45-5296c34c3402', 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XefjBbVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '24c00db3-2457-443d-b5ab-7e6ecaa57515', 'attached_at': '2023-08-14T18:15:22.000000', 'detached_at': '', 'volume_id': 'cd880623-a7e9-4e11-9490-b18345719272', 'serial': 'cd880623-a7e9-4e11-9490-b18345719272'}, 'volume_type': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:15:22 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:15:22 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:15:22 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG nova.objects.instance [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lazy-loading 'vcpu_model' on Instance uuid 24c00db3-2457-443d-b5ab-7e6ecaa57515 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XefjBbVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:15:22 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:15:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:15:22 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:15:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:15:22 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09d40a4-001c-4ce5-b45f-30a05c47d29a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:15:22 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e5cfc3-72dd-415e-9ce8-135d44d57aa0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272] added
Aug 14 18:15:22 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0e8ab3-e8db-453e-9253-ef094bc91976]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c30095-b130-4ee2-9b90-8cb1939bb70d]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XefjBbVt {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XefjBbVt" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[055c4214-0792-4a35-bf68-80b75df7a959]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XefjBbVt'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cad9559-b209-4af6-bbda-d1a37a26dfd7]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cd5dac-7d0d-42f4-a85b-4fa8a596ad78]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 (non-flash)
Aug 14 18:15:22 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 (non-flash)
Aug 14 18:15:22 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[aecdbf27-5688-4782-b9e8-586836680369]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272, portal: 172.16.0.220,3260]
Aug 14 18:15:22 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272, portal: 172.16.0.220,3260] successful.
Aug 14 18:15:22 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[801a442b-3d18-4c8f-937b-fda4be89801e]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d3c46c-8b55-403a-bdc1-aa7e4bd6a1fc]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 (non-flash)
Aug 14 18:15:22 user nova-compute[73078]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:15:22 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 (non-flash)
Aug 14 18:15:22 user nova-compute[73078]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:15:22 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.038s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8092981-a5cc-47a6-959b-d83d8fd4ffe8]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:15:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XefjBbVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:15:23 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:15:23 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '26263623536306532', 'path': '/dev/sdc'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:15:23 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263623536306532', 'path': '/dev/sdc'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:15:23 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-800184995',display_name='tempest-ServerActionsTestOtherB-server-800184995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-800184995',id=5,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbnc7U7feBP7majde5yxGnuBaGos4MxLqvnB0BjKphlc0UqHWP3CzhimKim+Kv31+0a1u5JyxtEQSRk/yFbj17pMkgZ6K1nerehXIw6QXdILWEOhFCV63jMfH8QM13ghA==',key_name='tempest-keypair-2079056104',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:11:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='09794ca2aebc4f50a4ab26cecefb4d0c',ramdisk_id='',reservation_id='r-ikq8fsl0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-727924132',owner_user_name='tempest-ServerActionsTestOtherB-727924132-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:15:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ad487c5160a4dd8b9a03d468edf4bef',uuid=24c00db3-2457-443d-b5ab-7e6ecaa57515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "address": "fa:16:3e:ce:cd:93", "network": {"id": "1ec1577a-2943-44e6-9fd6-9d8308fcf09f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-135315381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-135315381-network", "vif_mac": "fa:16:3e:ce:cd:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09794ca2aebc4f50a4ab26cecefb4d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d8f3d6-2e", "ovs_interfaceid": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:15:23 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Converting VIF {"id": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "address": "fa:16:3e:ce:cd:93", "network": {"id": "1ec1577a-2943-44e6-9fd6-9d8308fcf09f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-135315381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-135315381-network", "vif_mac": "fa:16:3e:ce:cd:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09794ca2aebc4f50a4ab26cecefb4d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d8f3d6-2e", "ovs_interfaceid": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:15:23 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:cd:93,bridge_name='br-int',has_traffic_filtering=True,id=99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563,network=Network(1ec1577a-2943-44e6-9fd6-9d8308fcf09f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d8f3d6-2e') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:15:23 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:15:23 user nova-compute[73078]:   <uuid>24c00db3-2457-443d-b5ab-7e6ecaa57515</uuid>
Aug 14 18:15:23 user nova-compute[73078]:   <name>instance-00000005</name>
Aug 14 18:15:23 user nova-compute[73078]:   <memory>2097152</memory>
Aug 14 18:15:23 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:15:23 user nova-compute[73078]:   <metadata>
Aug 14 18:15:23 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:15:23 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:15:23 user nova-compute[73078]:       <nova:name>tempest-ServerActionsTestOtherB-server-800184995</nova:name>
Aug 14 18:15:23 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:15:22</nova:creationTime>
Aug 14 18:15:23 user nova-compute[73078]:       <nova:flavor name="m1.small">
Aug 14 18:15:23 user nova-compute[73078]:         <nova:memory>2048</nova:memory>
Aug 14 18:15:23 user nova-compute[73078]:         <nova:disk>20</nova:disk>
Aug 14 18:15:23 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:15:23 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:15:23 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:15:23 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:15:23 user nova-compute[73078]:       <nova:owner>
Aug 14 18:15:23 user nova-compute[73078]:         <nova:user uuid="0ad487c5160a4dd8b9a03d468edf4bef">tempest-ServerActionsTestOtherB-727924132-project-member</nova:user>
Aug 14 18:15:23 user nova-compute[73078]:         <nova:project uuid="09794ca2aebc4f50a4ab26cecefb4d0c">tempest-ServerActionsTestOtherB-727924132</nova:project>
Aug 14 18:15:23 user nova-compute[73078]:       </nova:owner>
Aug 14 18:15:23 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:15:23 user nova-compute[73078]:       <nova:ports>
Aug 14 18:15:23 user nova-compute[73078]:         <nova:port uuid="99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563">
Aug 14 18:15:23 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 14 18:15:23 user nova-compute[73078]:         </nova:port>
Aug 14 18:15:23 user nova-compute[73078]:       </nova:ports>
Aug 14 18:15:23 user nova-compute[73078]:     </nova:instance>
Aug 14 18:15:23 user nova-compute[73078]:   </metadata>
Aug 14 18:15:23 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:15:23 user nova-compute[73078]:     <system>
Aug 14 18:15:23 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:15:23 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:15:23 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:15:23 user nova-compute[73078]:       <entry name="serial">24c00db3-2457-443d-b5ab-7e6ecaa57515</entry>
Aug 14 18:15:23 user nova-compute[73078]:       <entry name="uuid">24c00db3-2457-443d-b5ab-7e6ecaa57515</entry>
Aug 14 18:15:23 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:15:23 user nova-compute[73078]:     </system>
Aug 14 18:15:23 user nova-compute[73078]:   </sysinfo>
Aug 14 18:15:23 user nova-compute[73078]:   <os>
Aug 14 18:15:23 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:15:23 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:15:23 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:15:23 user nova-compute[73078]:   </os>
Aug 14 18:15:23 user nova-compute[73078]:   <features>
Aug 14 18:15:23 user nova-compute[73078]:     <acpi/>
Aug 14 18:15:23 user nova-compute[73078]:     <apic/>
Aug 14 18:15:23 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:15:23 user nova-compute[73078]:   </features>
Aug 14 18:15:23 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:15:23 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:15:23 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:15:23 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:15:23 user nova-compute[73078]:   </clock>
Aug 14 18:15:23 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:15:23 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:15:23 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:15:23 user nova-compute[73078]:   </cpu>
Aug 14 18:15:23 user nova-compute[73078]:   <devices>
Aug 14 18:15:23 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:15:23 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:15:23 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk"/>
Aug 14 18:15:23 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:15:23 user nova-compute[73078]:     </disk>
Aug 14 18:15:23 user nova-compute[73078]:     <disk type="block" device="disk">
Aug 14 18:15:23 user nova-compute[73078]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:15:23 user nova-compute[73078]:       <source dev="/dev/sdc"/>
Aug 14 18:15:23 user nova-compute[73078]:       <target dev="vdb" bus="virtio"/>
Aug 14 18:15:23 user nova-compute[73078]:       <serial>cd880623-a7e9-4e11-9490-b18345719272</serial>
Aug 14 18:15:23 user nova-compute[73078]:     </disk>
Aug 14 18:15:23 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:15:23 user nova-compute[73078]:       <mac address="fa:16:3e:ce:cd:93"/>
Aug 14 18:15:23 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:15:23 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:15:23 user nova-compute[73078]:       <target dev="tap99d8f3d6-2e"/>
Aug 14 18:15:23 user nova-compute[73078]:     </interface>
Aug 14 18:15:23 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:15:23 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/console.log" append="off"/>
Aug 14 18:15:23 user nova-compute[73078]:     </serial>
Aug 14 18:15:23 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:15:23 user nova-compute[73078]:     <video>
Aug 14 18:15:23 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:15:23 user nova-compute[73078]:     </video>
Aug 14 18:15:23 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:15:23 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:15:23 user nova-compute[73078]:     </rng>
Aug 14 18:15:23 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:15:23 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:15:23 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:15:23 user nova-compute[73078]:     </memballoon>
Aug 14 18:15:23 user nova-compute[73078]:   </devices>
Aug 14 18:15:23 user nova-compute[73078]: </domain>
Aug 14 18:15:23 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:15:23 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-800184995',display_name='tempest-ServerActionsTestOtherB-server-800184995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-800184995',id=5,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbnc7U7feBP7majde5yxGnuBaGos4MxLqvnB0BjKphlc0UqHWP3CzhimKim+Kv31+0a1u5JyxtEQSRk/yFbj17pMkgZ6K1nerehXIw6QXdILWEOhFCV63jMfH8QM13ghA==',key_name='tempest-keypair-2079056104',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:11:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='09794ca2aebc4f50a4ab26cecefb4d0c',ramdisk_id='',reservation_id='r-ikq8fsl0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-727924132',owner_user_name='tempest-ServerActionsTestOtherB-727924132-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:15:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ad487c5160a4dd8b9a03d468edf4bef',uuid=24c00db3-2457-443d-b5ab-7e6ecaa57515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "address": "fa:16:3e:ce:cd:93", "network": {"id": "1ec1577a-2943-44e6-9fd6-9d8308fcf09f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-135315381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-135315381-network", "vif_mac": "fa:16:3e:ce:cd:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09794ca2aebc4f50a4ab26cecefb4d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d8f3d6-2e", "ovs_interfaceid": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:15:23 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Converting VIF {"id": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "address": "fa:16:3e:ce:cd:93", "network": {"id": "1ec1577a-2943-44e6-9fd6-9d8308fcf09f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-135315381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-135315381-network", "vif_mac": "fa:16:3e:ce:cd:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09794ca2aebc4f50a4ab26cecefb4d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d8f3d6-2e", "ovs_interfaceid": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:15:23 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:cd:93,bridge_name='br-int',has_traffic_filtering=True,id=99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563,network=Network(1ec1577a-2943-44e6-9fd6-9d8308fcf09f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d8f3d6-2e') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:15:23 user nova-compute[73078]: DEBUG os_vif [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:cd:93,bridge_name='br-int',has_traffic_filtering=True,id=99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563,network=Network(1ec1577a-2943-44e6-9fd6-9d8308fcf09f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d8f3d6-2e') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:15:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:15:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:15:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99d8f3d6-2e, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:15:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap99d8f3d6-2e, col_values=(('external_ids', {'iface-id': '99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:cd:93', 'vm-uuid': '24c00db3-2457-443d-b5ab-7e6ecaa57515'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:15:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:15:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:23 user nova-compute[73078]: INFO os_vif [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:cd:93,bridge_name='br-int',has_traffic_filtering=True,id=99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563,network=Network(1ec1577a-2943-44e6-9fd6-9d8308fcf09f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d8f3d6-2e')
Aug 14 18:15:24 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:15:24 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:15:24 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] No VIF found with MAC fa:16:3e:ce:cd:93, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:15:25 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:25 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:25 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:25 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:26 user nova-compute[73078]: DEBUG nova.compute.manager [req-b9f2eff2-8ab4-4469-9473-c47396f29e17 req-5d9d8929-1097-4c25-8221-d47b3a6aaa7d service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Received event network-vif-plugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:15:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b9f2eff2-8ab4-4469-9473-c47396f29e17 req-5d9d8929-1097-4c25-8221-d47b3a6aaa7d service nova] Acquiring lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:15:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b9f2eff2-8ab4-4469-9473-c47396f29e17 req-5d9d8929-1097-4c25-8221-d47b3a6aaa7d service nova] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:15:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b9f2eff2-8ab4-4469-9473-c47396f29e17 req-5d9d8929-1097-4c25-8221-d47b3a6aaa7d service nova] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:15:26 user nova-compute[73078]: DEBUG nova.compute.manager [req-b9f2eff2-8ab4-4469-9473-c47396f29e17 req-5d9d8929-1097-4c25-8221-d47b3a6aaa7d service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] No waiting events found dispatching network-vif-plugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:15:26 user nova-compute[73078]: WARNING nova.compute.manager [req-b9f2eff2-8ab4-4469-9473-c47396f29e17 req-5d9d8929-1097-4c25-8221-d47b3a6aaa7d service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Received unexpected event network-vif-plugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 for instance with vm_state active and task_state resize_finish.
Aug 14 18:15:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:28 user nova-compute[73078]: DEBUG nova.compute.manager [req-de7d0069-d8e7-485b-ab8b-eddef1d9e92a req-4f09f46f-9073-4ddb-a566-4e341d59e05e service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Received event network-vif-plugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:15:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-de7d0069-d8e7-485b-ab8b-eddef1d9e92a req-4f09f46f-9073-4ddb-a566-4e341d59e05e service nova] Acquiring lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:15:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-de7d0069-d8e7-485b-ab8b-eddef1d9e92a req-4f09f46f-9073-4ddb-a566-4e341d59e05e service nova] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:15:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-de7d0069-d8e7-485b-ab8b-eddef1d9e92a req-4f09f46f-9073-4ddb-a566-4e341d59e05e service nova] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:15:28 user nova-compute[73078]: DEBUG nova.compute.manager [req-de7d0069-d8e7-485b-ab8b-eddef1d9e92a req-4f09f46f-9073-4ddb-a566-4e341d59e05e service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] No waiting events found dispatching network-vif-plugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:15:28 user nova-compute[73078]: WARNING nova.compute.manager [req-de7d0069-d8e7-485b-ab8b-eddef1d9e92a req-4f09f46f-9073-4ddb-a566-4e341d59e05e service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Received unexpected event network-vif-plugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 for instance with vm_state active and task_state resize_finish.
Aug 14 18:15:28 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036928.2522802, 24c00db3-2457-443d-b5ab-7e6ecaa57515 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:15:28 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] VM Resumed (Lifecycle Event)
Aug 14 18:15:28 user nova-compute[73078]: DEBUG nova.compute.manager [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:15:28 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Instance running successfully.
Aug 14 18:15:28 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:15:28 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Failed to set time: agent not configured {{(pid=73078) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 14 18:15:28 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c3e2f284-c0d5-4b7e-ae40-1792e008b1cb tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] finish_migration finished successfully. {{(pid=73078) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 14 18:15:28 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:15:28 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 18:15:28 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036928.2582183, 24c00db3-2457-443d-b5ab-7e6ecaa57515 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:15:28 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] VM Started (Lifecycle Event)
Aug 14 18:15:28 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:15:28 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:15:28 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 18:15:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:40 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:40 user nova-compute[73078]: INFO nova.compute.manager [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Rescuing
Aug 14 18:15:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "refresh_cache-de80e188-9385-4613-8a6c-aa72b624ad55" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:15:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquired lock "refresh_cache-de80e188-9385-4613-8a6c-aa72b624ad55" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:15:40 user nova-compute[73078]: DEBUG nova.network.neutron [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:15:41 user nova-compute[73078]: DEBUG nova.network.neutron [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Updating instance_info_cache with network_info: [{"id": "2afe973c-46fa-4336-996f-b5dcd374c96e", "address": "fa:16:3e:5d:60:2f", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe973c-46", "ovs_interfaceid": "2afe973c-46fa-4336-996f-b5dcd374c96e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:15:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Releasing lock "refresh_cache-de80e188-9385-4613-8a6c-aa72b624ad55" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:15:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:41 user nova-compute[73078]: DEBUG nova.compute.manager [req-b453197f-8e0e-4d3d-834e-a14ebb25c3fa req-987280ad-f7f0-4e96-a0fc-135e8393c2cc service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Received event network-vif-unplugged-2afe973c-46fa-4336-996f-b5dcd374c96e {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:15:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b453197f-8e0e-4d3d-834e-a14ebb25c3fa req-987280ad-f7f0-4e96-a0fc-135e8393c2cc service nova] Acquiring lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:15:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b453197f-8e0e-4d3d-834e-a14ebb25c3fa req-987280ad-f7f0-4e96-a0fc-135e8393c2cc service nova] Lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:15:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b453197f-8e0e-4d3d-834e-a14ebb25c3fa req-987280ad-f7f0-4e96-a0fc-135e8393c2cc service nova] Lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:15:41 user nova-compute[73078]: DEBUG nova.compute.manager [req-b453197f-8e0e-4d3d-834e-a14ebb25c3fa req-987280ad-f7f0-4e96-a0fc-135e8393c2cc service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] No waiting events found dispatching network-vif-unplugged-2afe973c-46fa-4336-996f-b5dcd374c96e {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:15:41 user nova-compute[73078]: WARNING nova.compute.manager [req-b453197f-8e0e-4d3d-834e-a14ebb25c3fa req-987280ad-f7f0-4e96-a0fc-135e8393c2cc service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Received unexpected event network-vif-unplugged-2afe973c-46fa-4336-996f-b5dcd374c96e for instance with vm_state active and task_state rescuing.
Aug 14 18:15:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:42 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Instance destroyed successfully.
Aug 14 18:15:42 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Attempting rescue
Aug 14 18:15:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73078) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Instance directory exists: not creating {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 18:15:42 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Creating image(s)
Aug 14 18:15:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "/opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "/opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "/opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG nova.objects.instance [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lazy-loading 'trusted_certs' on Instance uuid de80e188-9385-4613-8a6c-aa72b624ad55 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.196s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk.rescue {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk.rescue" returned: 0 in 0.073s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG nova.objects.instance [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lazy-loading 'migration_context' on Instance uuid de80e188-9385-4613-8a6c-aa72b624ad55 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Start _get_guest_xml network_info=[{"id": "2afe973c-46fa-4336-996f-b5dcd374c96e", "address": "fa:16:3e:5d:60:2f", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "vif_mac": "fa:16:3e:5d:60:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe973c-46", "ovs_interfaceid": "2afe973c-46fa-4336-996f-b5dcd374c96e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG nova.objects.instance [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lazy-loading 'resources' on Instance uuid de80e188-9385-4613-8a6c-aa72b624ad55 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG nova.objects.instance [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lazy-loading 'numa_topology' on Instance uuid de80e188-9385-4613-8a6c-aa72b624ad55 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:15:42 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:15:42 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:15:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG nova.objects.instance [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lazy-loading 'vcpu_model' on Instance uuid de80e188-9385-4613-8a6c-aa72b624ad55 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:10:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2143110433',display_name='tempest-ServerRescueNegativeTestJSON-server-2143110433',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2143110433',id=2,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:11:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ec53c6018ee44b09ee31ba712a789aa',ramdisk_id='',reservation_id='r-omwxdblo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-38557121',owner_user_name='tempest-ServerRescueNegativeTestJSON-38557121-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:11:13Z,user_data=None,user_id='d25ecea70e9e481e8a1957a94d79edfc',uuid=de80e188-9385-4613-8a6c-aa72b624ad55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2afe973c-46fa-4336-996f-b5dcd374c96e", "address": "fa:16:3e:5d:60:2f", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "vif_mac": "fa:16:3e:5d:60:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe973c-46", "ovs_interfaceid": "2afe973c-46fa-4336-996f-b5dcd374c96e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Converting VIF {"id": "2afe973c-46fa-4336-996f-b5dcd374c96e", "address": "fa:16:3e:5d:60:2f", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "vif_mac": "fa:16:3e:5d:60:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe973c-46", "ovs_interfaceid": "2afe973c-46fa-4336-996f-b5dcd374c96e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:60:2f,bridge_name='br-int',has_traffic_filtering=True,id=2afe973c-46fa-4336-996f-b5dcd374c96e,network=Network(33518dc6-7963-4995-b4c7-86d60b44a22f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afe973c-46') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG nova.objects.instance [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lazy-loading 'pci_devices' on Instance uuid de80e188-9385-4613-8a6c-aa72b624ad55 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:15:42 user nova-compute[73078]:   <uuid>de80e188-9385-4613-8a6c-aa72b624ad55</uuid>
Aug 14 18:15:42 user nova-compute[73078]:   <name>instance-00000002</name>
Aug 14 18:15:42 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:15:42 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:15:42 user nova-compute[73078]:   <metadata>
Aug 14 18:15:42 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:15:42 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:15:42 user nova-compute[73078]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2143110433</nova:name>
Aug 14 18:15:42 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:15:42</nova:creationTime>
Aug 14 18:15:42 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:15:42 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:15:42 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:15:42 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:15:42 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:15:42 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:15:42 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:15:42 user nova-compute[73078]:       <nova:owner>
Aug 14 18:15:42 user nova-compute[73078]:         <nova:user uuid="d25ecea70e9e481e8a1957a94d79edfc">tempest-ServerRescueNegativeTestJSON-38557121-project-member</nova:user>
Aug 14 18:15:42 user nova-compute[73078]:         <nova:project uuid="4ec53c6018ee44b09ee31ba712a789aa">tempest-ServerRescueNegativeTestJSON-38557121</nova:project>
Aug 14 18:15:42 user nova-compute[73078]:       </nova:owner>
Aug 14 18:15:42 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:15:42 user nova-compute[73078]:       <nova:ports>
Aug 14 18:15:42 user nova-compute[73078]:         <nova:port uuid="2afe973c-46fa-4336-996f-b5dcd374c96e">
Aug 14 18:15:42 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 18:15:42 user nova-compute[73078]:         </nova:port>
Aug 14 18:15:42 user nova-compute[73078]:       </nova:ports>
Aug 14 18:15:42 user nova-compute[73078]:     </nova:instance>
Aug 14 18:15:42 user nova-compute[73078]:   </metadata>
Aug 14 18:15:42 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:15:42 user nova-compute[73078]:     <system>
Aug 14 18:15:42 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:15:42 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:15:42 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:15:42 user nova-compute[73078]:       <entry name="serial">de80e188-9385-4613-8a6c-aa72b624ad55</entry>
Aug 14 18:15:42 user nova-compute[73078]:       <entry name="uuid">de80e188-9385-4613-8a6c-aa72b624ad55</entry>
Aug 14 18:15:42 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:15:42 user nova-compute[73078]:     </system>
Aug 14 18:15:42 user nova-compute[73078]:   </sysinfo>
Aug 14 18:15:42 user nova-compute[73078]:   <os>
Aug 14 18:15:42 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:15:42 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:15:42 user nova-compute[73078]:   </os>
Aug 14 18:15:42 user nova-compute[73078]:   <features>
Aug 14 18:15:42 user nova-compute[73078]:     <acpi/>
Aug 14 18:15:42 user nova-compute[73078]:     <apic/>
Aug 14 18:15:42 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:15:42 user nova-compute[73078]:   </features>
Aug 14 18:15:42 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:15:42 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:15:42 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:15:42 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:15:42 user nova-compute[73078]:   </clock>
Aug 14 18:15:42 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:15:42 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:15:42 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:15:42 user nova-compute[73078]:   </cpu>
Aug 14 18:15:42 user nova-compute[73078]:   <devices>
Aug 14 18:15:42 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:15:42 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:15:42 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk.rescue"/>
Aug 14 18:15:42 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:15:42 user nova-compute[73078]:     </disk>
Aug 14 18:15:42 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:15:42 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:15:42 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk"/>
Aug 14 18:15:42 user nova-compute[73078]:       <target dev="vdb" bus="virtio"/>
Aug 14 18:15:42 user nova-compute[73078]:     </disk>
Aug 14 18:15:42 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:15:42 user nova-compute[73078]:       <mac address="fa:16:3e:5d:60:2f"/>
Aug 14 18:15:42 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:15:42 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:15:42 user nova-compute[73078]:       <target dev="tap2afe973c-46"/>
Aug 14 18:15:42 user nova-compute[73078]:     </interface>
Aug 14 18:15:42 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:15:42 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/console.log" append="off"/>
Aug 14 18:15:42 user nova-compute[73078]:     </serial>
Aug 14 18:15:42 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:15:42 user nova-compute[73078]:     <video>
Aug 14 18:15:42 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:15:42 user nova-compute[73078]:     </video>
Aug 14 18:15:42 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:15:42 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:15:42 user nova-compute[73078]:     </rng>
Aug 14 18:15:42 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:15:42 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:15:42 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:15:42 user nova-compute[73078]:     </memballoon>
Aug 14 18:15:42 user nova-compute[73078]:   </devices>
Aug 14 18:15:42 user nova-compute[73078]: </domain>
Aug 14 18:15:42 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:15:42 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Instance destroyed successfully.
Aug 14 18:15:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:15:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] No VIF found with MAC fa:16:3e:5d:60:2f, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:15:43 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:15:43 user nova-compute[73078]: DEBUG nova.compute.manager [req-b4992146-c06b-4533-b0c6-b58f6cf469d1 req-dd41be57-044c-4a8f-a5ec-805b8884f878 service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Received event network-vif-plugged-2afe973c-46fa-4336-996f-b5dcd374c96e {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:15:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b4992146-c06b-4533-b0c6-b58f6cf469d1 req-dd41be57-044c-4a8f-a5ec-805b8884f878 service nova] Acquiring lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:15:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b4992146-c06b-4533-b0c6-b58f6cf469d1 req-dd41be57-044c-4a8f-a5ec-805b8884f878 service nova] Lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:15:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b4992146-c06b-4533-b0c6-b58f6cf469d1 req-dd41be57-044c-4a8f-a5ec-805b8884f878 service nova] Lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:15:43 user nova-compute[73078]: DEBUG nova.compute.manager [req-b4992146-c06b-4533-b0c6-b58f6cf469d1 req-dd41be57-044c-4a8f-a5ec-805b8884f878 service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] No waiting events found dispatching network-vif-plugged-2afe973c-46fa-4336-996f-b5dcd374c96e {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:15:43 user nova-compute[73078]: WARNING nova.compute.manager [req-b4992146-c06b-4533-b0c6-b58f6cf469d1 req-dd41be57-044c-4a8f-a5ec-805b8884f878 service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Received unexpected event network-vif-plugged-2afe973c-46fa-4336-996f-b5dcd374c96e for instance with vm_state active and task_state rescuing.
Aug 14 18:15:43 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:44 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:15:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:45 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:15:45 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:15:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-24c00db3-2457-443d-b5ab-7e6ecaa57515" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:15:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-24c00db3-2457-443d-b5ab-7e6ecaa57515" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:15:45 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:15:45 user nova-compute[73078]: DEBUG nova.compute.manager [req-dfffd12d-09d1-42d2-ae60-84ad7eaa4322 req-ccdb2749-b0e2-451c-9be5-55a38d0844d6 service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Received event network-vif-plugged-2afe973c-46fa-4336-996f-b5dcd374c96e {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:15:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-dfffd12d-09d1-42d2-ae60-84ad7eaa4322 req-ccdb2749-b0e2-451c-9be5-55a38d0844d6 service nova] Acquiring lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:15:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-dfffd12d-09d1-42d2-ae60-84ad7eaa4322 req-ccdb2749-b0e2-451c-9be5-55a38d0844d6 service nova] Lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:15:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-dfffd12d-09d1-42d2-ae60-84ad7eaa4322 req-ccdb2749-b0e2-451c-9be5-55a38d0844d6 service nova] Lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:15:45 user nova-compute[73078]: DEBUG nova.compute.manager [req-dfffd12d-09d1-42d2-ae60-84ad7eaa4322 req-ccdb2749-b0e2-451c-9be5-55a38d0844d6 service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] No waiting events found dispatching network-vif-plugged-2afe973c-46fa-4336-996f-b5dcd374c96e {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:15:45 user nova-compute[73078]: WARNING nova.compute.manager [req-dfffd12d-09d1-42d2-ae60-84ad7eaa4322 req-ccdb2749-b0e2-451c-9be5-55a38d0844d6 service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Received unexpected event network-vif-plugged-2afe973c-46fa-4336-996f-b5dcd374c96e for instance with vm_state active and task_state rescuing.
Aug 14 18:15:45 user nova-compute[73078]: DEBUG nova.compute.manager [req-dfffd12d-09d1-42d2-ae60-84ad7eaa4322 req-ccdb2749-b0e2-451c-9be5-55a38d0844d6 service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Received event network-vif-plugged-2afe973c-46fa-4336-996f-b5dcd374c96e {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:15:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-dfffd12d-09d1-42d2-ae60-84ad7eaa4322 req-ccdb2749-b0e2-451c-9be5-55a38d0844d6 service nova] Acquiring lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:15:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-dfffd12d-09d1-42d2-ae60-84ad7eaa4322 req-ccdb2749-b0e2-451c-9be5-55a38d0844d6 service nova] Lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:15:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-dfffd12d-09d1-42d2-ae60-84ad7eaa4322 req-ccdb2749-b0e2-451c-9be5-55a38d0844d6 service nova] Lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:15:45 user nova-compute[73078]: DEBUG nova.compute.manager [req-dfffd12d-09d1-42d2-ae60-84ad7eaa4322 req-ccdb2749-b0e2-451c-9be5-55a38d0844d6 service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] No waiting events found dispatching network-vif-plugged-2afe973c-46fa-4336-996f-b5dcd374c96e {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:15:45 user nova-compute[73078]: WARNING nova.compute.manager [req-dfffd12d-09d1-42d2-ae60-84ad7eaa4322 req-ccdb2749-b0e2-451c-9be5-55a38d0844d6 service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Received unexpected event network-vif-plugged-2afe973c-46fa-4336-996f-b5dcd374c96e for instance with vm_state active and task_state rescuing.
Aug 14 18:15:45 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Updating instance_info_cache with network_info: [{"id": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "address": "fa:16:3e:ce:cd:93", "network": {"id": "1ec1577a-2943-44e6-9fd6-9d8308fcf09f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-135315381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09794ca2aebc4f50a4ab26cecefb4d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d8f3d6-2e", "ovs_interfaceid": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:15:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-24c00db3-2457-443d-b5ab-7e6ecaa57515" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:15:45 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:15:45 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:15:45 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:15:45 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:15:45 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:15:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:15:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:15:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:15:45 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:15:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Removed pending event for de80e188-9385-4613-8a6c-aa72b624ad55 due to event {{(pid=73078) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 18:15:46 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036946.7840474, de80e188-9385-4613-8a6c-aa72b624ad55 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:15:46 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] VM Resumed (Lifecycle Event)
Aug 14 18:15:46 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:15:46 user nova-compute[73078]: DEBUG nova.compute.manager [None req-a2bfe9fb-e166-4f19-845c-4b720b13bd90 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:15:46 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:15:46 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 18:15:46 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036946.7944484, de80e188-9385-4613-8a6c-aa72b624ad55 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:15:46 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] VM Started (Lifecycle Event)
Aug 14 18:15:46 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:15:46 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:15:46 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 18:15:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16fe26a2-7fe8-409e-97ca-6c44ef2fbddd/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16fe26a2-7fe8-409e-97ca-6c44ef2fbddd/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16fe26a2-7fe8-409e-97ca-6c44ef2fbddd/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16fe26a2-7fe8-409e-97ca-6c44ef2fbddd/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:47 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:15:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba60d2d2-656b-4471-aa79-ef95c566583e/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba60d2d2-656b-4471-aa79-ef95c566583e/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba60d2d2-656b-4471-aa79-ef95c566583e/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba60d2d2-656b-4471-aa79-ef95c566583e/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:15:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json" returned: 0 in 0.228s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json" returned: 0 in 0.257s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:51 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:15:51 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:15:51 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=7308MB free_disk=25.437946319580078GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:15:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:15:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:15:51 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Applying migration context for instance 24c00db3-2457-443d-b5ab-7e6ecaa57515 as it has an incoming, in-progress migration bc0b08ea-7f2e-432b-800c-8d8bf1f62e7e. Migration status is finished {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 14 18:15:51 user nova-compute[73078]: INFO nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Updating resource usage from migration bc0b08ea-7f2e-432b-800c-8d8bf1f62e7e
Aug 14 18:15:51 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance de80e188-9385-4613-8a6c-aa72b624ad55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:15:51 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 1f88cb97-4f22-439e-99f2-d7cb8d5aff36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:15:51 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 3c840309-9884-4c8a-a6ee-1acd44f32c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:15:51 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:15:51 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:15:51 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:15:51 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance ba60d2d2-656b-4471-aa79-ef95c566583e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:15:51 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 8d257202-d8ab-4161-9b67-045cf1e36772 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:15:51 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Migration bc0b08ea-7f2e-432b-800c-8d8bf1f62e7e is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 14 18:15:51 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 24c00db3-2457-443d-b5ab-7e6ecaa57515 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:15:51 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:15:51 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:15:52 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:15:52 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:15:52 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:15:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.578s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:15:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:52 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:15:52 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:15:52 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:15:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Acquiring lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:15:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:15:54 user nova-compute[73078]: DEBUG nova.compute.manager [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:15:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:15:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:15:54 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:15:54 user nova-compute[73078]: INFO nova.compute.claims [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Claim successful on node user
Aug 14 18:15:55 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:15:55 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:15:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.829s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:15:55 user nova-compute[73078]: DEBUG nova.compute.manager [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:15:55 user nova-compute[73078]: DEBUG nova.compute.manager [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:15:55 user nova-compute[73078]: DEBUG nova.network.neutron [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:15:55 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:15:55 user nova-compute[73078]: DEBUG nova.compute.manager [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:15:55 user nova-compute[73078]: INFO nova.virt.block_device [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Booting with volume d77e8c78-bb17-42b5-a3cd-19258651c57a at /dev/vda
Aug 14 18:15:56 user nova-compute[73078]: DEBUG nova.policy [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1a3800a849fa4c199373454d92aada0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b726267e2c49c69b843234bb761f06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:15:56 user nova-compute[73078]: DEBUG os_brick.utils [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:15:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:56 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03bde3b-45f4-445e-88d8-73b135f9c346]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:56 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b115b5d-d6cc-4764-97e6-fdbcb4448f40]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.034s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:15:56 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[880f56cb-a21f-4e6d-bb6b-64a04b9cacbf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:56 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeaf2f02-3e91-40ab-8372-b8675cd2c91f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:15:56 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:15:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:15:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:15:56 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:15:56 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc03ee1a-c993-47d3-8739-3452c9281a4f]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:15:56 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:15:56 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:15:56 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:15:56 user nova-compute[73078]: DEBUG os_brick.utils [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] <== get_connector_properties: return (221ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:15:56 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Updating existing volume attachment record: 8b61b70a-dd5a-4ef6-bb0e-fde4d59170fd {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:15:57 user nova-compute[73078]: DEBUG nova.network.neutron [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Successfully created port: 74bc6a0e-0628-4482-be86-c53122e1363c {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:15:57 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:58 user nova-compute[73078]: DEBUG nova.network.neutron [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Successfully updated port: 74bc6a0e-0628-4482-be86-c53122e1363c {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:15:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Acquiring lock "refresh_cache-90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:15:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Acquired lock "refresh_cache-90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:15:58 user nova-compute[73078]: DEBUG nova.network.neutron [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:15:58 user nova-compute[73078]: DEBUG nova.network.neutron [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:15:58 user nova-compute[73078]: DEBUG nova.compute.manager [req-05629057-eaed-447f-8a36-607944d99627 req-2d8285be-ec93-4be6-bf90-1e4f0072c7d9 service nova] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Received event network-changed-74bc6a0e-0628-4482-be86-c53122e1363c {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:15:58 user nova-compute[73078]: DEBUG nova.compute.manager [req-05629057-eaed-447f-8a36-607944d99627 req-2d8285be-ec93-4be6-bf90-1e4f0072c7d9 service nova] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Refreshing instance network info cache due to event network-changed-74bc6a0e-0628-4482-be86-c53122e1363c. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:15:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-05629057-eaed-447f-8a36-607944d99627 req-2d8285be-ec93-4be6-bf90-1e4f0072c7d9 service nova] Acquiring lock "refresh_cache-90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:15:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:15:59 user nova-compute[73078]: DEBUG nova.network.neutron [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Updating instance_info_cache with network_info: [{"id": "74bc6a0e-0628-4482-be86-c53122e1363c", "address": "fa:16:3e:f1:45:de", "network": {"id": "f600e59d-4edc-4daa-a017-629c89211580", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-604738940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b726267e2c49c69b843234bb761f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74bc6a0e-06", "ovs_interfaceid": "74bc6a0e-0628-4482-be86-c53122e1363c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:15:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Releasing lock "refresh_cache-90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:15:59 user nova-compute[73078]: DEBUG nova.compute.manager [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Instance network_info: |[{"id": "74bc6a0e-0628-4482-be86-c53122e1363c", "address": "fa:16:3e:f1:45:de", "network": {"id": "f600e59d-4edc-4daa-a017-629c89211580", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-604738940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b726267e2c49c69b843234bb761f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74bc6a0e-06", "ovs_interfaceid": "74bc6a0e-0628-4482-be86-c53122e1363c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:15:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-05629057-eaed-447f-8a36-607944d99627 req-2d8285be-ec93-4be6-bf90-1e4f0072c7d9 service nova] Acquired lock "refresh_cache-90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:15:59 user nova-compute[73078]: DEBUG nova.network.neutron [req-05629057-eaed-447f-8a36-607944d99627 req-2d8285be-ec93-4be6-bf90-1e4f0072c7d9 service nova] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Refreshing network info cache for port 74bc6a0e-0628-4482-be86-c53122e1363c {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:15:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Acquiring lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:15:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:15:59 user nova-compute[73078]: DEBUG nova.compute.manager [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:15:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:15:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:15:59 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:15:59 user nova-compute[73078]: INFO nova.compute.claims [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Claim successful on node user
Aug 14 18:16:00 user nova-compute[73078]: DEBUG nova.network.neutron [req-05629057-eaed-447f-8a36-607944d99627 req-2d8285be-ec93-4be6-bf90-1e4f0072c7d9 service nova] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Updated VIF entry in instance network info cache for port 74bc6a0e-0628-4482-be86-c53122e1363c. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:16:00 user nova-compute[73078]: DEBUG nova.network.neutron [req-05629057-eaed-447f-8a36-607944d99627 req-2d8285be-ec93-4be6-bf90-1e4f0072c7d9 service nova] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Updating instance_info_cache with network_info: [{"id": "74bc6a0e-0628-4482-be86-c53122e1363c", "address": "fa:16:3e:f1:45:de", "network": {"id": "f600e59d-4edc-4daa-a017-629c89211580", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-604738940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b726267e2c49c69b843234bb761f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74bc6a0e-06", "ovs_interfaceid": "74bc6a0e-0628-4482-be86-c53122e1363c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:16:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-05629057-eaed-447f-8a36-607944d99627 req-2d8285be-ec93-4be6-bf90-1e4f0072c7d9 service nova] Releasing lock "refresh_cache-90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:16:00 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:16:00 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:16:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.761s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:00 user nova-compute[73078]: DEBUG nova.compute.manager [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:16:00 user nova-compute[73078]: DEBUG nova.compute.manager [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:16:00 user nova-compute[73078]: DEBUG nova.network.neutron [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:16:00 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:16:00 user nova-compute[73078]: DEBUG nova.compute.manager [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:16:00 user nova-compute[73078]: DEBUG nova.policy [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc572af82fa544ab8d0af9dcc3470136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a739612a674c5c82fad631a64c57ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:16:00 user nova-compute[73078]: DEBUG nova.compute.manager [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:16:00 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:16:00 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Creating image(s)
Aug 14 18:16:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "/opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "/opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.240s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.194s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk 1073741824" returned: 0 in 0.061s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.223s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:01 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:16:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:01 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Cannot resize image /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:16:01 user nova-compute[73078]: DEBUG nova.objects.instance [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lazy-loading 'migration_context' on Instance uuid ea445c0c-e5a1-4e24-8008-2cd64a679f34 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:16:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:01 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:16:01 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Ensure instance console log exists: /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:16:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:02 user nova-compute[73078]: DEBUG nova.network.neutron [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Successfully created port: 3a008b18-c1c3-4656-9ada-f437888cdee6 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:16:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:03 user nova-compute[73078]: DEBUG nova.network.neutron [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Successfully updated port: 3a008b18-c1c3-4656-9ada-f437888cdee6 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:16:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Acquiring lock "refresh_cache-ea445c0c-e5a1-4e24-8008-2cd64a679f34" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:16:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Acquired lock "refresh_cache-ea445c0c-e5a1-4e24-8008-2cd64a679f34" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:16:03 user nova-compute[73078]: DEBUG nova.network.neutron [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:16:03 user nova-compute[73078]: DEBUG nova.compute.manager [req-8a3d1a0d-982a-46a5-86ec-50267e1ab54c req-548c9dcd-cbb2-43f8-945c-de1bc0bcc3ef service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Received event network-changed-3a008b18-c1c3-4656-9ada-f437888cdee6 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:16:03 user nova-compute[73078]: DEBUG nova.compute.manager [req-8a3d1a0d-982a-46a5-86ec-50267e1ab54c req-548c9dcd-cbb2-43f8-945c-de1bc0bcc3ef service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Refreshing instance network info cache due to event network-changed-3a008b18-c1c3-4656-9ada-f437888cdee6. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:16:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-8a3d1a0d-982a-46a5-86ec-50267e1ab54c req-548c9dcd-cbb2-43f8-945c-de1bc0bcc3ef service nova] Acquiring lock "refresh_cache-ea445c0c-e5a1-4e24-8008-2cd64a679f34" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:16:03 user nova-compute[73078]: DEBUG nova.network.neutron [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:16:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG nova.network.neutron [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Updating instance_info_cache with network_info: [{"id": "3a008b18-c1c3-4656-9ada-f437888cdee6", "address": "fa:16:3e:a3:fb:e1", "network": {"id": "45b49a52-f99e-437a-aa8d-440f4f6b1099", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1520302261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9a739612a674c5c82fad631a64c57ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a008b18-c1", "ovs_interfaceid": "3a008b18-c1c3-4656-9ada-f437888cdee6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Releasing lock "refresh_cache-ea445c0c-e5a1-4e24-8008-2cd64a679f34" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG nova.compute.manager [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Instance network_info: |[{"id": "3a008b18-c1c3-4656-9ada-f437888cdee6", "address": "fa:16:3e:a3:fb:e1", "network": {"id": "45b49a52-f99e-437a-aa8d-440f4f6b1099", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1520302261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9a739612a674c5c82fad631a64c57ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a008b18-c1", "ovs_interfaceid": "3a008b18-c1c3-4656-9ada-f437888cdee6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-8a3d1a0d-982a-46a5-86ec-50267e1ab54c req-548c9dcd-cbb2-43f8-945c-de1bc0bcc3ef service nova] Acquired lock "refresh_cache-ea445c0c-e5a1-4e24-8008-2cd64a679f34" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG nova.network.neutron [req-8a3d1a0d-982a-46a5-86ec-50267e1ab54c req-548c9dcd-cbb2-43f8-945c-de1bc0bcc3ef service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Refreshing network info cache for port 3a008b18-c1c3-4656-9ada-f437888cdee6 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Start _get_guest_xml network_info=[{"id": "3a008b18-c1c3-4656-9ada-f437888cdee6", "address": "fa:16:3e:a3:fb:e1", "network": {"id": "45b49a52-f99e-437a-aa8d-440f4f6b1099", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1520302261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9a739612a674c5c82fad631a64c57ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a008b18-c1", "ovs_interfaceid": "3a008b18-c1c3-4656-9ada-f437888cdee6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:16:04 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:16:04 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:16:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:15:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1491685202',display_name='tempest-ServerStableDeviceRescueTest-server-1491685202',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1491685202',id=18,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSTDg2a3FdDwHLS5eghJchIu9zBpTAzj/gcbB/c+1H/CD2nkhiGbofjc2p/swBhyY2DVBNVOfggutnqRrWuq96pedEA+ZYoofu9LuMUjdduc37Lprb2vTrGWcdyssj9AA==',key_name='tempest-keypair-113748248',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9a739612a674c5c82fad631a64c57ba',ramdisk_id='',reservation_id='r-lbnq00mr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-79994875',owner_user_name='tempest-ServerStableDeviceRescueTest-79994875-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:16:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc572af82fa544ab8d0af9dcc3470136',uuid=ea445c0c-e5a1-4e24-8008-2cd64a679f34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a008b18-c1c3-4656-9ada-f437888cdee6", "address": "fa:16:3e:a3:fb:e1", "network": {"id": "45b49a52-f99e-437a-aa8d-440f4f6b1099", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1520302261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9a739612a674c5c82fad631a64c57ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a008b18-c1", "ovs_interfaceid": "3a008b18-c1c3-4656-9ada-f437888cdee6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Converting VIF {"id": "3a008b18-c1c3-4656-9ada-f437888cdee6", "address": "fa:16:3e:a3:fb:e1", "network": {"id": "45b49a52-f99e-437a-aa8d-440f4f6b1099", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1520302261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9a739612a674c5c82fad631a64c57ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a008b18-c1", "ovs_interfaceid": "3a008b18-c1c3-4656-9ada-f437888cdee6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:fb:e1,bridge_name='br-int',has_traffic_filtering=True,id=3a008b18-c1c3-4656-9ada-f437888cdee6,network=Network(45b49a52-f99e-437a-aa8d-440f4f6b1099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a008b18-c1') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG nova.objects.instance [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lazy-loading 'pci_devices' on Instance uuid ea445c0c-e5a1-4e24-8008-2cd64a679f34 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:16:04 user nova-compute[73078]:   <uuid>ea445c0c-e5a1-4e24-8008-2cd64a679f34</uuid>
Aug 14 18:16:04 user nova-compute[73078]:   <name>instance-00000012</name>
Aug 14 18:16:04 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:16:04 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:16:04 user nova-compute[73078]:   <metadata>
Aug 14 18:16:04 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:16:04 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:16:04 user nova-compute[73078]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1491685202</nova:name>
Aug 14 18:16:04 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:16:04</nova:creationTime>
Aug 14 18:16:04 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:16:04 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:16:04 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:16:04 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:16:04 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:16:04 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:16:04 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:16:04 user nova-compute[73078]:       <nova:owner>
Aug 14 18:16:04 user nova-compute[73078]:         <nova:user uuid="fc572af82fa544ab8d0af9dcc3470136">tempest-ServerStableDeviceRescueTest-79994875-project-member</nova:user>
Aug 14 18:16:04 user nova-compute[73078]:         <nova:project uuid="f9a739612a674c5c82fad631a64c57ba">tempest-ServerStableDeviceRescueTest-79994875</nova:project>
Aug 14 18:16:04 user nova-compute[73078]:       </nova:owner>
Aug 14 18:16:04 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:16:04 user nova-compute[73078]:       <nova:ports>
Aug 14 18:16:04 user nova-compute[73078]:         <nova:port uuid="3a008b18-c1c3-4656-9ada-f437888cdee6">
Aug 14 18:16:04 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 18:16:04 user nova-compute[73078]:         </nova:port>
Aug 14 18:16:04 user nova-compute[73078]:       </nova:ports>
Aug 14 18:16:04 user nova-compute[73078]:     </nova:instance>
Aug 14 18:16:04 user nova-compute[73078]:   </metadata>
Aug 14 18:16:04 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:16:04 user nova-compute[73078]:     <system>
Aug 14 18:16:04 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:16:04 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:16:04 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:16:04 user nova-compute[73078]:       <entry name="serial">ea445c0c-e5a1-4e24-8008-2cd64a679f34</entry>
Aug 14 18:16:04 user nova-compute[73078]:       <entry name="uuid">ea445c0c-e5a1-4e24-8008-2cd64a679f34</entry>
Aug 14 18:16:04 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:16:04 user nova-compute[73078]:     </system>
Aug 14 18:16:04 user nova-compute[73078]:   </sysinfo>
Aug 14 18:16:04 user nova-compute[73078]:   <os>
Aug 14 18:16:04 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:16:04 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:16:04 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:16:04 user nova-compute[73078]:   </os>
Aug 14 18:16:04 user nova-compute[73078]:   <features>
Aug 14 18:16:04 user nova-compute[73078]:     <acpi/>
Aug 14 18:16:04 user nova-compute[73078]:     <apic/>
Aug 14 18:16:04 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:16:04 user nova-compute[73078]:   </features>
Aug 14 18:16:04 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:16:04 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:16:04 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:16:04 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:16:04 user nova-compute[73078]:   </clock>
Aug 14 18:16:04 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:16:04 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:16:04 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:16:04 user nova-compute[73078]:   </cpu>
Aug 14 18:16:04 user nova-compute[73078]:   <devices>
Aug 14 18:16:04 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:16:04 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:16:04 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk"/>
Aug 14 18:16:04 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:16:04 user nova-compute[73078]:     </disk>
Aug 14 18:16:04 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:16:04 user nova-compute[73078]:       <mac address="fa:16:3e:a3:fb:e1"/>
Aug 14 18:16:04 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:16:04 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:16:04 user nova-compute[73078]:       <target dev="tap3a008b18-c1"/>
Aug 14 18:16:04 user nova-compute[73078]:     </interface>
Aug 14 18:16:04 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:16:04 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/console.log" append="off"/>
Aug 14 18:16:04 user nova-compute[73078]:     </serial>
Aug 14 18:16:04 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:16:04 user nova-compute[73078]:     <video>
Aug 14 18:16:04 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:16:04 user nova-compute[73078]:     </video>
Aug 14 18:16:04 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:16:04 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:16:04 user nova-compute[73078]:     </rng>
Aug 14 18:16:04 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:16:04 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:16:04 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:16:04 user nova-compute[73078]:     </memballoon>
Aug 14 18:16:04 user nova-compute[73078]:   </devices>
Aug 14 18:16:04 user nova-compute[73078]: </domain>
Aug 14 18:16:04 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:15:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1491685202',display_name='tempest-ServerStableDeviceRescueTest-server-1491685202',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1491685202',id=18,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSTDg2a3FdDwHLS5eghJchIu9zBpTAzj/gcbB/c+1H/CD2nkhiGbofjc2p/swBhyY2DVBNVOfggutnqRrWuq96pedEA+ZYoofu9LuMUjdduc37Lprb2vTrGWcdyssj9AA==',key_name='tempest-keypair-113748248',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9a739612a674c5c82fad631a64c57ba',ramdisk_id='',reservation_id='r-lbnq00mr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-79994875',owner_user_name='tempest-ServerStableDeviceRescueTest-79994875-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:16:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc572af82fa544ab8d0af9dcc3470136',uuid=ea445c0c-e5a1-4e24-8008-2cd64a679f34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a008b18-c1c3-4656-9ada-f437888cdee6", "address": "fa:16:3e:a3:fb:e1", "network": {"id": "45b49a52-f99e-437a-aa8d-440f4f6b1099", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1520302261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9a739612a674c5c82fad631a64c57ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a008b18-c1", "ovs_interfaceid": "3a008b18-c1c3-4656-9ada-f437888cdee6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Converting VIF {"id": "3a008b18-c1c3-4656-9ada-f437888cdee6", "address": "fa:16:3e:a3:fb:e1", "network": {"id": "45b49a52-f99e-437a-aa8d-440f4f6b1099", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1520302261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9a739612a674c5c82fad631a64c57ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a008b18-c1", "ovs_interfaceid": "3a008b18-c1c3-4656-9ada-f437888cdee6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:fb:e1,bridge_name='br-int',has_traffic_filtering=True,id=3a008b18-c1c3-4656-9ada-f437888cdee6,network=Network(45b49a52-f99e-437a-aa8d-440f4f6b1099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a008b18-c1') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG os_vif [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:fb:e1,bridge_name='br-int',has_traffic_filtering=True,id=3a008b18-c1c3-4656-9ada-f437888cdee6,network=Network(45b49a52-f99e-437a-aa8d-440f4f6b1099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a008b18-c1') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a008b18-c1, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3a008b18-c1, col_values=(('external_ids', {'iface-id': '3a008b18-c1c3-4656-9ada-f437888cdee6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:fb:e1', 'vm-uuid': 'ea445c0c-e5a1-4e24-8008-2cd64a679f34'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:04 user nova-compute[73078]: INFO os_vif [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:fb:e1,bridge_name='br-int',has_traffic_filtering=True,id=3a008b18-c1c3-4656-9ada-f437888cdee6,network=Network(45b49a52-f99e-437a-aa8d-440f4f6b1099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a008b18-c1')
Aug 14 18:16:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:16:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] No VIF found with MAC fa:16:3e:a3:fb:e1, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:16:05 user nova-compute[73078]: DEBUG nova.network.neutron [req-8a3d1a0d-982a-46a5-86ec-50267e1ab54c req-548c9dcd-cbb2-43f8-945c-de1bc0bcc3ef service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Updated VIF entry in instance network info cache for port 3a008b18-c1c3-4656-9ada-f437888cdee6. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:16:05 user nova-compute[73078]: DEBUG nova.network.neutron [req-8a3d1a0d-982a-46a5-86ec-50267e1ab54c req-548c9dcd-cbb2-43f8-945c-de1bc0bcc3ef service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Updating instance_info_cache with network_info: [{"id": "3a008b18-c1c3-4656-9ada-f437888cdee6", "address": "fa:16:3e:a3:fb:e1", "network": {"id": "45b49a52-f99e-437a-aa8d-440f4f6b1099", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1520302261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9a739612a674c5c82fad631a64c57ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a008b18-c1", "ovs_interfaceid": "3a008b18-c1c3-4656-9ada-f437888cdee6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:16:05 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-8a3d1a0d-982a-46a5-86ec-50267e1ab54c req-548c9dcd-cbb2-43f8-945c-de1bc0bcc3ef service nova] Releasing lock "refresh_cache-ea445c0c-e5a1-4e24-8008-2cd64a679f34" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:16:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG nova.compute.manager [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:16:07 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Creating image(s)
Aug 14 18:16:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Did not create local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Ensure instance console log exists: /opt/stack/data/nova/instances/90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Start _get_guest_xml network_info=[{"id": "74bc6a0e-0628-4482-be86-c53122e1363c", "address": "fa:16:3e:f1:45:de", "network": {"id": "f600e59d-4edc-4daa-a017-629c89211580", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-604738940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b726267e2c49c69b843234bb761f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74bc6a0e-06", "ovs_interfaceid": "74bc6a0e-0628-4482-be86-c53122e1363c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '8b61b70a-dd5a-4ef6-bb0e-fde4d59170fd', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgcyazBh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c', 'attached_at': '', 'detached_at': '', 'volume_id': 'd77e8c78-bb17-42b5-a3cd-19258651c57a', 'serial': 'd77e8c78-bb17-42b5-a3cd-19258651c57a'}, 'volume_type': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:16:07 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:16:07 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:16:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgcyazBh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:16:07 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:16:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:16:07 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:16:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:16:07 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:16:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0978c4-b789-4b6c-93c3-5db03ce62b12]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:16:07 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0410cf9b-75bf-4451-9f82-ee3e48043f80]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a] added
Aug 14 18:16:07 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b815fe5-5b02-4781-ac5e-89a2c37745e5]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc27c9ed-b28e-481e-84d3-b339c6e013d4]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:16:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MgcyazBh {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MgcyazBh" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fe2661-0783-45c0-abba-205b41971dc9]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MgcyazBh'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccd5efc-059d-49dd-9e7b-c47a227c3f2f]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e2bd59-e2e1-4ebf-abce-04d05f8c931e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 (non-flash)
Aug 14 18:16:08 user nova-compute[73078]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:16:08 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 (non-flash)
Aug 14 18:16:08 user nova-compute[73078]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:16:08 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f29529-9972-4cc6-999b-e358e03eed8e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a, portal: 172.16.0.220,3260]
Aug 14 18:16:08 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a, portal: 172.16.0.220,3260] successful.
Aug 14 18:16:08 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc8e4be-926c-4392-b90d-ed48d9d07937]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b9f857-fe8a-4a68-9d73-c50ea3f1f9c4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 (non-flash)
Aug 14 18:16:08 user nova-compute[73078]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:16:08 user nova-compute[73078]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:16:08 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 (non-flash)
Aug 14 18:16:08 user nova-compute[73078]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:16:08 user nova-compute[73078]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:16:08 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cecd314-069a-43cf-8559-cfc4922de8cc]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgcyazBh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG nova.compute.manager [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036968.9269724, ea445c0c-e5a1-4e24-8008-2cd64a679f34 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:16:08 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] VM Resumed (Lifecycle Event)
Aug 14 18:16:08 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Instance spawned successfully.
Aug 14 18:16:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:16:08 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:16:09 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:16:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:16:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:16:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:16:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:16:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:16:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:16:09 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:16:09 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036968.940994, ea445c0c-e5a1-4e24-8008-2cd64a679f34 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:16:09 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] VM Started (Lifecycle Event)
Aug 14 18:16:09 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:16:09 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:16:09 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:16:09 user nova-compute[73078]: INFO nova.compute.manager [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Took 8.17 seconds to spawn the instance on the hypervisor.
Aug 14 18:16:09 user nova-compute[73078]: DEBUG nova.compute.manager [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:16:09 user nova-compute[73078]: INFO nova.compute.manager [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Took 9.34 seconds to build instance.
Aug 14 18:16:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:16:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23139643239353833', 'path': '/dev/sdd'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:16:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139643239353833', 'path': '/dev/sdd'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:16:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-aaee0af8-20de-43d6-912e-617244b27a25 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.464s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:15:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1497637679',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1497637679',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtJLJQBmgtrDyTBUJe8Q/tiHCzjGEVBxUbvCC7nYOmxztS2QanKQLBPdwFwQyvsPRy+jAfMiHcGMYRvHIAt2urg9izZdbJETz7dtqMJlhiy41t8tSflk18DOHtZARdHFg==',key_name='tempest-keypair-499236215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4b726267e2c49c69b843234bb761f06',ramdisk_id='',reservation_id='r-2u1e60fu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1368753977',owner_user_name='tempest-ServerActionsV293TestJSON-1368753977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:15:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a3800a849fa4c199373454d92aada0a',uuid=90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74bc6a0e-0628-4482-be86-c53122e1363c", "address": "fa:16:3e:f1:45:de", "network": {"id": "f600e59d-4edc-4daa-a017-629c89211580", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-604738940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b726267e2c49c69b843234bb761f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74bc6a0e-06", "ovs_interfaceid": "74bc6a0e-0628-4482-be86-c53122e1363c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:16:09 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Converting VIF {"id": "74bc6a0e-0628-4482-be86-c53122e1363c", "address": "fa:16:3e:f1:45:de", "network": {"id": "f600e59d-4edc-4daa-a017-629c89211580", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-604738940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b726267e2c49c69b843234bb761f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74bc6a0e-06", "ovs_interfaceid": "74bc6a0e-0628-4482-be86-c53122e1363c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:16:09 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:45:de,bridge_name='br-int',has_traffic_filtering=True,id=74bc6a0e-0628-4482-be86-c53122e1363c,network=Network(f600e59d-4edc-4daa-a017-629c89211580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74bc6a0e-06') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:16:09 user nova-compute[73078]: DEBUG nova.objects.instance [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lazy-loading 'pci_devices' on Instance uuid 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:16:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:16:09 user nova-compute[73078]:   <uuid>90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c</uuid>
Aug 14 18:16:09 user nova-compute[73078]:   <name>instance-00000011</name>
Aug 14 18:16:09 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:16:09 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:16:09 user nova-compute[73078]:   <metadata>
Aug 14 18:16:09 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:16:09 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:16:09 user nova-compute[73078]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1497637679</nova:name>
Aug 14 18:16:09 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:16:07</nova:creationTime>
Aug 14 18:16:09 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:16:09 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:16:09 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:16:09 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:16:09 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:16:09 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:16:09 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:16:09 user nova-compute[73078]:       <nova:owner>
Aug 14 18:16:09 user nova-compute[73078]:         <nova:user uuid="1a3800a849fa4c199373454d92aada0a">tempest-ServerActionsV293TestJSON-1368753977-project-member</nova:user>
Aug 14 18:16:09 user nova-compute[73078]:         <nova:project uuid="c4b726267e2c49c69b843234bb761f06">tempest-ServerActionsV293TestJSON-1368753977</nova:project>
Aug 14 18:16:09 user nova-compute[73078]:       </nova:owner>
Aug 14 18:16:09 user nova-compute[73078]:       <nova:ports>
Aug 14 18:16:09 user nova-compute[73078]:         <nova:port uuid="74bc6a0e-0628-4482-be86-c53122e1363c">
Aug 14 18:16:09 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 14 18:16:09 user nova-compute[73078]:         </nova:port>
Aug 14 18:16:09 user nova-compute[73078]:       </nova:ports>
Aug 14 18:16:09 user nova-compute[73078]:     </nova:instance>
Aug 14 18:16:09 user nova-compute[73078]:   </metadata>
Aug 14 18:16:09 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:16:09 user nova-compute[73078]:     <system>
Aug 14 18:16:09 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:16:09 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:16:09 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:16:09 user nova-compute[73078]:       <entry name="serial">90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c</entry>
Aug 14 18:16:09 user nova-compute[73078]:       <entry name="uuid">90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c</entry>
Aug 14 18:16:09 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:16:09 user nova-compute[73078]:     </system>
Aug 14 18:16:09 user nova-compute[73078]:   </sysinfo>
Aug 14 18:16:09 user nova-compute[73078]:   <os>
Aug 14 18:16:09 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:16:09 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:16:09 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:16:09 user nova-compute[73078]:   </os>
Aug 14 18:16:09 user nova-compute[73078]:   <features>
Aug 14 18:16:09 user nova-compute[73078]:     <acpi/>
Aug 14 18:16:09 user nova-compute[73078]:     <apic/>
Aug 14 18:16:09 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:16:09 user nova-compute[73078]:   </features>
Aug 14 18:16:09 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:16:09 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:16:09 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:16:09 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:16:09 user nova-compute[73078]:   </clock>
Aug 14 18:16:09 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:16:09 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:16:09 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:16:09 user nova-compute[73078]:   </cpu>
Aug 14 18:16:09 user nova-compute[73078]:   <devices>
Aug 14 18:16:09 user nova-compute[73078]:     <disk type="block" device="disk">
Aug 14 18:16:09 user nova-compute[73078]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:16:09 user nova-compute[73078]:       <source dev="/dev/sdd"/>
Aug 14 18:16:09 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:16:09 user nova-compute[73078]:       <serial>d77e8c78-bb17-42b5-a3cd-19258651c57a</serial>
Aug 14 18:16:09 user nova-compute[73078]:     </disk>
Aug 14 18:16:09 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:16:09 user nova-compute[73078]:       <mac address="fa:16:3e:f1:45:de"/>
Aug 14 18:16:09 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:16:09 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:16:09 user nova-compute[73078]:       <target dev="tap74bc6a0e-06"/>
Aug 14 18:16:09 user nova-compute[73078]:     </interface>
Aug 14 18:16:09 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:16:09 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c/console.log" append="off"/>
Aug 14 18:16:09 user nova-compute[73078]:     </serial>
Aug 14 18:16:09 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:16:09 user nova-compute[73078]:     <video>
Aug 14 18:16:09 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:16:09 user nova-compute[73078]:     </video>
Aug 14 18:16:09 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:16:09 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:16:09 user nova-compute[73078]:     </rng>
Aug 14 18:16:09 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:16:09 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:16:09 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:16:09 user nova-compute[73078]:     </memballoon>
Aug 14 18:16:09 user nova-compute[73078]:   </devices>
Aug 14 18:16:09 user nova-compute[73078]: </domain>
Aug 14 18:16:09 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:16:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:15:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1497637679',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1497637679',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtJLJQBmgtrDyTBUJe8Q/tiHCzjGEVBxUbvCC7nYOmxztS2QanKQLBPdwFwQyvsPRy+jAfMiHcGMYRvHIAt2urg9izZdbJETz7dtqMJlhiy41t8tSflk18DOHtZARdHFg==',key_name='tempest-keypair-499236215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4b726267e2c49c69b843234bb761f06',ramdisk_id='',reservation_id='r-2u1e60fu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1368753977',owner_user_name='tempest-ServerActionsV293TestJSON-1368753977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:15:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a3800a849fa4c199373454d92aada0a',uuid=90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74bc6a0e-0628-4482-be86-c53122e1363c", "address": "fa:16:3e:f1:45:de", "network": {"id": "f600e59d-4edc-4daa-a017-629c89211580", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-604738940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b726267e2c49c69b843234bb761f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74bc6a0e-06", "ovs_interfaceid": "74bc6a0e-0628-4482-be86-c53122e1363c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:16:09 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Converting VIF {"id": "74bc6a0e-0628-4482-be86-c53122e1363c", "address": "fa:16:3e:f1:45:de", "network": {"id": "f600e59d-4edc-4daa-a017-629c89211580", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-604738940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b726267e2c49c69b843234bb761f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74bc6a0e-06", "ovs_interfaceid": "74bc6a0e-0628-4482-be86-c53122e1363c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:16:09 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:45:de,bridge_name='br-int',has_traffic_filtering=True,id=74bc6a0e-0628-4482-be86-c53122e1363c,network=Network(f600e59d-4edc-4daa-a017-629c89211580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74bc6a0e-06') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:16:09 user nova-compute[73078]: DEBUG os_vif [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:45:de,bridge_name='br-int',has_traffic_filtering=True,id=74bc6a0e-0628-4482-be86-c53122e1363c,network=Network(f600e59d-4edc-4daa-a017-629c89211580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74bc6a0e-06') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:16:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:16:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:16:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74bc6a0e-06, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:16:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap74bc6a0e-06, col_values=(('external_ids', {'iface-id': '74bc6a0e-0628-4482-be86-c53122e1363c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:45:de', 'vm-uuid': '90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:16:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:16:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:09 user nova-compute[73078]: INFO os_vif [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:45:de,bridge_name='br-int',has_traffic_filtering=True,id=74bc6a0e-0628-4482-be86-c53122e1363c,network=Network(f600e59d-4edc-4daa-a017-629c89211580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74bc6a0e-06')
Aug 14 18:16:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:16:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] No VIF found with MAC fa:16:3e:f1:45:de, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:16:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:13 user nova-compute[73078]: DEBUG nova.compute.manager [req-84a4d8bf-7119-4c46-b7d6-84b8fa51eeb8 req-9ab9322e-91ba-4d50-8bdd-79972e19e232 service nova] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Received event network-vif-plugged-74bc6a0e-0628-4482-be86-c53122e1363c {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:16:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-84a4d8bf-7119-4c46-b7d6-84b8fa51eeb8 req-9ab9322e-91ba-4d50-8bdd-79972e19e232 service nova] Acquiring lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-84a4d8bf-7119-4c46-b7d6-84b8fa51eeb8 req-9ab9322e-91ba-4d50-8bdd-79972e19e232 service nova] Lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-84a4d8bf-7119-4c46-b7d6-84b8fa51eeb8 req-9ab9322e-91ba-4d50-8bdd-79972e19e232 service nova] Lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:13 user nova-compute[73078]: DEBUG nova.compute.manager [req-84a4d8bf-7119-4c46-b7d6-84b8fa51eeb8 req-9ab9322e-91ba-4d50-8bdd-79972e19e232 service nova] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] No waiting events found dispatching network-vif-plugged-74bc6a0e-0628-4482-be86-c53122e1363c {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:16:13 user nova-compute[73078]: WARNING nova.compute.manager [req-84a4d8bf-7119-4c46-b7d6-84b8fa51eeb8 req-9ab9322e-91ba-4d50-8bdd-79972e19e232 service nova] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Received unexpected event network-vif-plugged-74bc6a0e-0628-4482-be86-c53122e1363c for instance with vm_state building and task_state spawning.
Aug 14 18:16:13 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036973.3327682, 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:16:13 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] VM Resumed (Lifecycle Event)
Aug 14 18:16:13 user nova-compute[73078]: DEBUG nova.compute.manager [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:16:13 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:16:13 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Instance spawned successfully.
Aug 14 18:16:13 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:16:13 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:16:13 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:16:13 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:16:13 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:16:13 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:16:13 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:16:13 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:16:13 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:16:13 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:16:13 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036973.333836, 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:16:13 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] VM Started (Lifecycle Event)
Aug 14 18:16:13 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:16:13 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:16:13 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:16:13 user nova-compute[73078]: INFO nova.compute.manager [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Took 5.71 seconds to spawn the instance on the hypervisor.
Aug 14 18:16:13 user nova-compute[73078]: DEBUG nova.compute.manager [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:16:13 user nova-compute[73078]: INFO nova.compute.manager [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Took 18.86 seconds to build instance.
Aug 14 18:16:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-afdcf89e-3743-446c-8b6e-4efc88646b70 tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.989s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:14 user nova-compute[73078]: DEBUG nova.compute.manager [req-9e1a6f28-d3d8-4871-8438-6904271452a3 req-11d19101-8182-4041-b100-ae3732659693 service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Received event network-vif-plugged-3a008b18-c1c3-4656-9ada-f437888cdee6 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:16:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9e1a6f28-d3d8-4871-8438-6904271452a3 req-11d19101-8182-4041-b100-ae3732659693 service nova] Acquiring lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9e1a6f28-d3d8-4871-8438-6904271452a3 req-11d19101-8182-4041-b100-ae3732659693 service nova] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9e1a6f28-d3d8-4871-8438-6904271452a3 req-11d19101-8182-4041-b100-ae3732659693 service nova] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:14 user nova-compute[73078]: DEBUG nova.compute.manager [req-9e1a6f28-d3d8-4871-8438-6904271452a3 req-11d19101-8182-4041-b100-ae3732659693 service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] No waiting events found dispatching network-vif-plugged-3a008b18-c1c3-4656-9ada-f437888cdee6 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:16:14 user nova-compute[73078]: WARNING nova.compute.manager [req-9e1a6f28-d3d8-4871-8438-6904271452a3 req-11d19101-8182-4041-b100-ae3732659693 service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Received unexpected event network-vif-plugged-3a008b18-c1c3-4656-9ada-f437888cdee6 for instance with vm_state active and task_state None.
Aug 14 18:16:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:15 user nova-compute[73078]: DEBUG nova.compute.manager [req-696fb56b-5b36-481d-bdc7-915967df226b req-4cc251f9-d467-4f60-aab4-f9c5202cb0bc service nova] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Received event network-vif-plugged-74bc6a0e-0628-4482-be86-c53122e1363c {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:16:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-696fb56b-5b36-481d-bdc7-915967df226b req-4cc251f9-d467-4f60-aab4-f9c5202cb0bc service nova] Acquiring lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-696fb56b-5b36-481d-bdc7-915967df226b req-4cc251f9-d467-4f60-aab4-f9c5202cb0bc service nova] Lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-696fb56b-5b36-481d-bdc7-915967df226b req-4cc251f9-d467-4f60-aab4-f9c5202cb0bc service nova] Lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:15 user nova-compute[73078]: DEBUG nova.compute.manager [req-696fb56b-5b36-481d-bdc7-915967df226b req-4cc251f9-d467-4f60-aab4-f9c5202cb0bc service nova] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] No waiting events found dispatching network-vif-plugged-74bc6a0e-0628-4482-be86-c53122e1363c {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:16:15 user nova-compute[73078]: WARNING nova.compute.manager [req-696fb56b-5b36-481d-bdc7-915967df226b req-4cc251f9-d467-4f60-aab4-f9c5202cb0bc service nova] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Received unexpected event network-vif-plugged-74bc6a0e-0628-4482-be86-c53122e1363c for instance with vm_state active and task_state None.
Aug 14 18:16:16 user nova-compute[73078]: DEBUG nova.compute.manager [req-4a8cc9f3-00d7-4e0f-8105-1f76b6527f79 req-857d43e0-b545-449a-b73f-f5d34c107265 service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Received event network-vif-plugged-3a008b18-c1c3-4656-9ada-f437888cdee6 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:16:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4a8cc9f3-00d7-4e0f-8105-1f76b6527f79 req-857d43e0-b545-449a-b73f-f5d34c107265 service nova] Acquiring lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4a8cc9f3-00d7-4e0f-8105-1f76b6527f79 req-857d43e0-b545-449a-b73f-f5d34c107265 service nova] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4a8cc9f3-00d7-4e0f-8105-1f76b6527f79 req-857d43e0-b545-449a-b73f-f5d34c107265 service nova] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:16 user nova-compute[73078]: DEBUG nova.compute.manager [req-4a8cc9f3-00d7-4e0f-8105-1f76b6527f79 req-857d43e0-b545-449a-b73f-f5d34c107265 service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] No waiting events found dispatching network-vif-plugged-3a008b18-c1c3-4656-9ada-f437888cdee6 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:16:16 user nova-compute[73078]: WARNING nova.compute.manager [req-4a8cc9f3-00d7-4e0f-8105-1f76b6527f79 req-857d43e0-b545-449a-b73f-f5d34c107265 service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Received unexpected event network-vif-plugged-3a008b18-c1c3-4656-9ada-f437888cdee6 for instance with vm_state active and task_state None.
Aug 14 18:16:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Acquiring lock "7783c26e-ec61-4375-b191-0ce5caf766c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "7783c26e-ec61-4375-b191-0ce5caf766c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:23 user nova-compute[73078]: DEBUG nova.compute.manager [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:16:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:23 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:16:23 user nova-compute[73078]: INFO nova.compute.claims [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Claim successful on node user
Aug 14 18:16:24 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:16:24 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:16:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.662s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:24 user nova-compute[73078]: DEBUG nova.compute.manager [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:16:24 user nova-compute[73078]: DEBUG nova.compute.manager [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:16:24 user nova-compute[73078]: DEBUG nova.network.neutron [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:16:24 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:16:24 user nova-compute[73078]: DEBUG nova.compute.manager [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:16:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:24 user nova-compute[73078]: DEBUG nova.policy [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'baa21850755541ab953640640d175ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723522b7563c4ab79e178b31052e2b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:16:24 user nova-compute[73078]: DEBUG nova.compute.manager [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:16:24 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:16:24 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Creating image(s)
Aug 14 18:16:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Acquiring lock "/opt/stack/data/nova/instances/7783c26e-ec61-4375-b191-0ce5caf766c7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "/opt/stack/data/nova/instances/7783c26e-ec61-4375-b191-0ce5caf766c7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "/opt/stack/data/nova/instances/7783c26e-ec61-4375-b191-0ce5caf766c7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.210s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e0822d2a-559f-4cb4-b64c-963dd30825d9 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Acquiring lock "16fe26a2-7fe8-409e-97ca-6c44ef2fbddd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e0822d2a-559f-4cb4-b64c-963dd30825d9 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "16fe26a2-7fe8-409e-97ca-6c44ef2fbddd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e0822d2a-559f-4cb4-b64c-963dd30825d9 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Acquiring lock "16fe26a2-7fe8-409e-97ca-6c44ef2fbddd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e0822d2a-559f-4cb4-b64c-963dd30825d9 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "16fe26a2-7fe8-409e-97ca-6c44ef2fbddd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e0822d2a-559f-4cb4-b64c-963dd30825d9 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "16fe26a2-7fe8-409e-97ca-6c44ef2fbddd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:24 user nova-compute[73078]: INFO nova.compute.manager [None req-e0822d2a-559f-4cb4-b64c-963dd30825d9 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Terminating instance
Aug 14 18:16:24 user nova-compute[73078]: DEBUG nova.compute.manager [None req-e0822d2a-559f-4cb4-b64c-963dd30825d9 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:16:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.213s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/7783c26e-ec61-4375-b191-0ce5caf766c7/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/7783c26e-ec61-4375-b191-0ce5caf766c7/disk 1073741824" returned: 0 in 0.072s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.300s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:25 user nova-compute[73078]: DEBUG nova.network.neutron [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Successfully created port: ed5a7452-e05e-4923-b8f3-23a67b426ecd {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:16:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.226s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:25 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7783c26e-ec61-4375-b191-0ce5caf766c7/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:16:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7783c26e-ec61-4375-b191-0ce5caf766c7/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:25 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:25 user nova-compute[73078]: DEBUG nova.compute.manager [req-54f64a74-d4e9-4828-9ebe-28cd7deba3b7 req-43073878-7a1f-4c90-b69f-2c941764e4b6 service nova] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Received event network-vif-unplugged-f11c2409-22e3-48a1-a629-e9274caa39e3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:16:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-54f64a74-d4e9-4828-9ebe-28cd7deba3b7 req-43073878-7a1f-4c90-b69f-2c941764e4b6 service nova] Acquiring lock "16fe26a2-7fe8-409e-97ca-6c44ef2fbddd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-54f64a74-d4e9-4828-9ebe-28cd7deba3b7 req-43073878-7a1f-4c90-b69f-2c941764e4b6 service nova] Lock "16fe26a2-7fe8-409e-97ca-6c44ef2fbddd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-54f64a74-d4e9-4828-9ebe-28cd7deba3b7 req-43073878-7a1f-4c90-b69f-2c941764e4b6 service nova] Lock "16fe26a2-7fe8-409e-97ca-6c44ef2fbddd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:25 user nova-compute[73078]: DEBUG nova.compute.manager [req-54f64a74-d4e9-4828-9ebe-28cd7deba3b7 req-43073878-7a1f-4c90-b69f-2c941764e4b6 service nova] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] No waiting events found dispatching network-vif-unplugged-f11c2409-22e3-48a1-a629-e9274caa39e3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:16:25 user nova-compute[73078]: DEBUG nova.compute.manager [req-54f64a74-d4e9-4828-9ebe-28cd7deba3b7 req-43073878-7a1f-4c90-b69f-2c941764e4b6 service nova] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Received event network-vif-unplugged-f11c2409-22e3-48a1-a629-e9274caa39e3 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:16:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7783c26e-ec61-4375-b191-0ce5caf766c7/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:25 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Cannot resize image /opt/stack/data/nova/instances/7783c26e-ec61-4375-b191-0ce5caf766c7/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:16:25 user nova-compute[73078]: DEBUG nova.objects.instance [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lazy-loading 'migration_context' on Instance uuid 7783c26e-ec61-4375-b191-0ce5caf766c7 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:16:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:16:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Ensure instance console log exists: /opt/stack/data/nova/instances/7783c26e-ec61-4375-b191-0ce5caf766c7/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:16:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:25 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:25 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:25 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:25 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Instance destroyed successfully.
Aug 14 18:16:25 user nova-compute[73078]: DEBUG nova.objects.instance [None req-e0822d2a-559f-4cb4-b64c-963dd30825d9 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lazy-loading 'resources' on Instance uuid 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:16:25 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-e0822d2a-559f-4cb4-b64c-963dd30825d9 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:14:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1352669969',display_name='tempest-VolumesAdminNegativeTest-server-1352669969',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1352669969',id=14,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:14:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d0d923a445747d8a812c1b7b4510398',ramdisk_id='',reservation_id='r-t1011g3d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1778130930',owner_user_name='tempest-VolumesAdminNegativeTest-1778130930-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:14:29Z,user_data=None,user_id='2a4b9a2ffd4947ce8fb65976b48b112d',uuid=16fe26a2-7fe8-409e-97ca-6c44ef2fbddd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f11c2409-22e3-48a1-a629-e9274caa39e3", "address": "fa:16:3e:da:e9:95", "network": {"id": "bcbb9361-92bf-48f3-9d61-e5cdb5d21980", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1013223391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d0d923a445747d8a812c1b7b4510398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11c2409-22", "ovs_interfaceid": "f11c2409-22e3-48a1-a629-e9274caa39e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:16:25 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-e0822d2a-559f-4cb4-b64c-963dd30825d9 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Converting VIF {"id": "f11c2409-22e3-48a1-a629-e9274caa39e3", "address": "fa:16:3e:da:e9:95", "network": {"id": "bcbb9361-92bf-48f3-9d61-e5cdb5d21980", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1013223391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d0d923a445747d8a812c1b7b4510398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf11c2409-22", "ovs_interfaceid": "f11c2409-22e3-48a1-a629-e9274caa39e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:16:25 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-e0822d2a-559f-4cb4-b64c-963dd30825d9 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:e9:95,bridge_name='br-int',has_traffic_filtering=True,id=f11c2409-22e3-48a1-a629-e9274caa39e3,network=Network(bcbb9361-92bf-48f3-9d61-e5cdb5d21980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf11c2409-22') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:16:25 user nova-compute[73078]: DEBUG os_vif [None req-e0822d2a-559f-4cb4-b64c-963dd30825d9 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:e9:95,bridge_name='br-int',has_traffic_filtering=True,id=f11c2409-22e3-48a1-a629-e9274caa39e3,network=Network(bcbb9361-92bf-48f3-9d61-e5cdb5d21980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf11c2409-22') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:16:25 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:25 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf11c2409-22, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:16:25 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:25 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:16:25 user nova-compute[73078]: INFO os_vif [None req-e0822d2a-559f-4cb4-b64c-963dd30825d9 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:e9:95,bridge_name='br-int',has_traffic_filtering=True,id=f11c2409-22e3-48a1-a629-e9274caa39e3,network=Network(bcbb9361-92bf-48f3-9d61-e5cdb5d21980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf11c2409-22')
Aug 14 18:16:25 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-e0822d2a-559f-4cb4-b64c-963dd30825d9 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Deleting instance files /opt/stack/data/nova/instances/16fe26a2-7fe8-409e-97ca-6c44ef2fbddd_del
Aug 14 18:16:25 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-e0822d2a-559f-4cb4-b64c-963dd30825d9 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Deletion of /opt/stack/data/nova/instances/16fe26a2-7fe8-409e-97ca-6c44ef2fbddd_del complete
Aug 14 18:16:25 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:25 user nova-compute[73078]: INFO nova.compute.manager [None req-e0822d2a-559f-4cb4-b64c-963dd30825d9 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 14 18:16:25 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-e0822d2a-559f-4cb4-b64c-963dd30825d9 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:16:25 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:16:25 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:16:25 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:25 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:26 user nova-compute[73078]: DEBUG nova.network.neutron [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Successfully updated port: ed5a7452-e05e-4923-b8f3-23a67b426ecd {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:16:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Acquiring lock "refresh_cache-7783c26e-ec61-4375-b191-0ce5caf766c7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:16:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Acquired lock "refresh_cache-7783c26e-ec61-4375-b191-0ce5caf766c7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:16:26 user nova-compute[73078]: DEBUG nova.network.neutron [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:16:26 user nova-compute[73078]: DEBUG nova.compute.manager [req-54d33004-ae18-4ca5-826d-1df3b74dea7c req-424eb8b0-b2d3-4d85-a1f0-58cfe86ba9d3 service nova] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Received event network-changed-ed5a7452-e05e-4923-b8f3-23a67b426ecd {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:16:26 user nova-compute[73078]: DEBUG nova.compute.manager [req-54d33004-ae18-4ca5-826d-1df3b74dea7c req-424eb8b0-b2d3-4d85-a1f0-58cfe86ba9d3 service nova] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Refreshing instance network info cache due to event network-changed-ed5a7452-e05e-4923-b8f3-23a67b426ecd. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:16:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-54d33004-ae18-4ca5-826d-1df3b74dea7c req-424eb8b0-b2d3-4d85-a1f0-58cfe86ba9d3 service nova] Acquiring lock "refresh_cache-7783c26e-ec61-4375-b191-0ce5caf766c7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:16:26 user nova-compute[73078]: DEBUG nova.network.neutron [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:16:26 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:16:26 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Took 0.89 seconds to deallocate network for instance.
Aug 14 18:16:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e0822d2a-559f-4cb4-b64c-963dd30825d9 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e0822d2a-559f-4cb4-b64c-963dd30825d9 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:26 user nova-compute[73078]: DEBUG nova.network.neutron [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Updating instance_info_cache with network_info: [{"id": "ed5a7452-e05e-4923-b8f3-23a67b426ecd", "address": "fa:16:3e:f7:07:98", "network": {"id": "d8856523-a980-4d8a-a541-72e9b88add3e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2086630095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "723522b7563c4ab79e178b31052e2b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped5a7452-e0", "ovs_interfaceid": "ed5a7452-e05e-4923-b8f3-23a67b426ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Releasing lock "refresh_cache-7783c26e-ec61-4375-b191-0ce5caf766c7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.compute.manager [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Instance network_info: |[{"id": "ed5a7452-e05e-4923-b8f3-23a67b426ecd", "address": "fa:16:3e:f7:07:98", "network": {"id": "d8856523-a980-4d8a-a541-72e9b88add3e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2086630095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "723522b7563c4ab79e178b31052e2b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped5a7452-e0", "ovs_interfaceid": "ed5a7452-e05e-4923-b8f3-23a67b426ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-54d33004-ae18-4ca5-826d-1df3b74dea7c req-424eb8b0-b2d3-4d85-a1f0-58cfe86ba9d3 service nova] Acquired lock "refresh_cache-7783c26e-ec61-4375-b191-0ce5caf766c7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.network.neutron [req-54d33004-ae18-4ca5-826d-1df3b74dea7c req-424eb8b0-b2d3-4d85-a1f0-58cfe86ba9d3 service nova] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Refreshing network info cache for port ed5a7452-e05e-4923-b8f3-23a67b426ecd {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Start _get_guest_xml network_info=[{"id": "ed5a7452-e05e-4923-b8f3-23a67b426ecd", "address": "fa:16:3e:f7:07:98", "network": {"id": "d8856523-a980-4d8a-a541-72e9b88add3e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2086630095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "723522b7563c4ab79e178b31052e2b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped5a7452-e0", "ovs_interfaceid": "ed5a7452-e05e-4923-b8f3-23a67b426ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:16:27 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:16:27 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:16:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1479359937',display_name='tempest-TestServerVolumeAttachmentScenario-server-1479359937',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1479359937',id=19,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/F7dEOnEf1GkakSVGeM26tAXSzJLvU4A0ZiMhnYuMASBVngAyTDliFRhpp0b/ouyGqTtzqSDWIhAuvSCM25Ewct/z7Y/O+L+3IH+p59r+ZLDyz1f4M5T9t0CF7VSrfcQ==',key_name='tempest-keypair-404370145',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='723522b7563c4ab79e178b31052e2b71',ramdisk_id='',reservation_id='r-zj86ct5d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-884491858',owner_user_name='tempest-TestServerVolumeAttachmentScenario-884491858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:16:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='baa21850755541ab953640640d175ba8',uuid=7783c26e-ec61-4375-b191-0ce5caf766c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed5a7452-e05e-4923-b8f3-23a67b426ecd", "address": "fa:16:3e:f7:07:98", "network": {"id": "d8856523-a980-4d8a-a541-72e9b88add3e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2086630095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "723522b7563c4ab79e178b31052e2b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped5a7452-e0", "ovs_interfaceid": "ed5a7452-e05e-4923-b8f3-23a67b426ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Converting VIF {"id": "ed5a7452-e05e-4923-b8f3-23a67b426ecd", "address": "fa:16:3e:f7:07:98", "network": {"id": "d8856523-a980-4d8a-a541-72e9b88add3e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2086630095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "723522b7563c4ab79e178b31052e2b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped5a7452-e0", "ovs_interfaceid": "ed5a7452-e05e-4923-b8f3-23a67b426ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:07:98,bridge_name='br-int',has_traffic_filtering=True,id=ed5a7452-e05e-4923-b8f3-23a67b426ecd,network=Network(d8856523-a980-4d8a-a541-72e9b88add3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped5a7452-e0') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.objects.instance [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lazy-loading 'pci_devices' on Instance uuid 7783c26e-ec61-4375-b191-0ce5caf766c7 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:16:27 user nova-compute[73078]:   <uuid>7783c26e-ec61-4375-b191-0ce5caf766c7</uuid>
Aug 14 18:16:27 user nova-compute[73078]:   <name>instance-00000013</name>
Aug 14 18:16:27 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:16:27 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:16:27 user nova-compute[73078]:   <metadata>
Aug 14 18:16:27 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:16:27 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:16:27 user nova-compute[73078]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1479359937</nova:name>
Aug 14 18:16:27 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:16:27</nova:creationTime>
Aug 14 18:16:27 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:16:27 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:16:27 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:16:27 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:16:27 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:16:27 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:16:27 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:16:27 user nova-compute[73078]:       <nova:owner>
Aug 14 18:16:27 user nova-compute[73078]:         <nova:user uuid="baa21850755541ab953640640d175ba8">tempest-TestServerVolumeAttachmentScenario-884491858-project-member</nova:user>
Aug 14 18:16:27 user nova-compute[73078]:         <nova:project uuid="723522b7563c4ab79e178b31052e2b71">tempest-TestServerVolumeAttachmentScenario-884491858</nova:project>
Aug 14 18:16:27 user nova-compute[73078]:       </nova:owner>
Aug 14 18:16:27 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:16:27 user nova-compute[73078]:       <nova:ports>
Aug 14 18:16:27 user nova-compute[73078]:         <nova:port uuid="ed5a7452-e05e-4923-b8f3-23a67b426ecd">
Aug 14 18:16:27 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 18:16:27 user nova-compute[73078]:         </nova:port>
Aug 14 18:16:27 user nova-compute[73078]:       </nova:ports>
Aug 14 18:16:27 user nova-compute[73078]:     </nova:instance>
Aug 14 18:16:27 user nova-compute[73078]:   </metadata>
Aug 14 18:16:27 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:16:27 user nova-compute[73078]:     <system>
Aug 14 18:16:27 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:16:27 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:16:27 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:16:27 user nova-compute[73078]:       <entry name="serial">7783c26e-ec61-4375-b191-0ce5caf766c7</entry>
Aug 14 18:16:27 user nova-compute[73078]:       <entry name="uuid">7783c26e-ec61-4375-b191-0ce5caf766c7</entry>
Aug 14 18:16:27 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:16:27 user nova-compute[73078]:     </system>
Aug 14 18:16:27 user nova-compute[73078]:   </sysinfo>
Aug 14 18:16:27 user nova-compute[73078]:   <os>
Aug 14 18:16:27 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:16:27 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:16:27 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:16:27 user nova-compute[73078]:   </os>
Aug 14 18:16:27 user nova-compute[73078]:   <features>
Aug 14 18:16:27 user nova-compute[73078]:     <acpi/>
Aug 14 18:16:27 user nova-compute[73078]:     <apic/>
Aug 14 18:16:27 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:16:27 user nova-compute[73078]:   </features>
Aug 14 18:16:27 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:16:27 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:16:27 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:16:27 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:16:27 user nova-compute[73078]:   </clock>
Aug 14 18:16:27 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:16:27 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:16:27 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:16:27 user nova-compute[73078]:   </cpu>
Aug 14 18:16:27 user nova-compute[73078]:   <devices>
Aug 14 18:16:27 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:16:27 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:16:27 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/7783c26e-ec61-4375-b191-0ce5caf766c7/disk"/>
Aug 14 18:16:27 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:16:27 user nova-compute[73078]:     </disk>
Aug 14 18:16:27 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:16:27 user nova-compute[73078]:       <mac address="fa:16:3e:f7:07:98"/>
Aug 14 18:16:27 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:16:27 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:16:27 user nova-compute[73078]:       <target dev="taped5a7452-e0"/>
Aug 14 18:16:27 user nova-compute[73078]:     </interface>
Aug 14 18:16:27 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:16:27 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/7783c26e-ec61-4375-b191-0ce5caf766c7/console.log" append="off"/>
Aug 14 18:16:27 user nova-compute[73078]:     </serial>
Aug 14 18:16:27 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:16:27 user nova-compute[73078]:     <video>
Aug 14 18:16:27 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:16:27 user nova-compute[73078]:     </video>
Aug 14 18:16:27 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:16:27 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:16:27 user nova-compute[73078]:     </rng>
Aug 14 18:16:27 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:16:27 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:16:27 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:16:27 user nova-compute[73078]:     </memballoon>
Aug 14 18:16:27 user nova-compute[73078]:   </devices>
Aug 14 18:16:27 user nova-compute[73078]: </domain>
Aug 14 18:16:27 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:16:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1479359937',display_name='tempest-TestServerVolumeAttachmentScenario-server-1479359937',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1479359937',id=19,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/F7dEOnEf1GkakSVGeM26tAXSzJLvU4A0ZiMhnYuMASBVngAyTDliFRhpp0b/ouyGqTtzqSDWIhAuvSCM25Ewct/z7Y/O+L+3IH+p59r+ZLDyz1f4M5T9t0CF7VSrfcQ==',key_name='tempest-keypair-404370145',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='723522b7563c4ab79e178b31052e2b71',ramdisk_id='',reservation_id='r-zj86ct5d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-884491858',owner_user_name='tempest-TestServerVolumeAttachmentScenario-884491858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:16:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='baa21850755541ab953640640d175ba8',uuid=7783c26e-ec61-4375-b191-0ce5caf766c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed5a7452-e05e-4923-b8f3-23a67b426ecd", "address": "fa:16:3e:f7:07:98", "network": {"id": "d8856523-a980-4d8a-a541-72e9b88add3e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2086630095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "723522b7563c4ab79e178b31052e2b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped5a7452-e0", "ovs_interfaceid": "ed5a7452-e05e-4923-b8f3-23a67b426ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Converting VIF {"id": "ed5a7452-e05e-4923-b8f3-23a67b426ecd", "address": "fa:16:3e:f7:07:98", "network": {"id": "d8856523-a980-4d8a-a541-72e9b88add3e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2086630095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "723522b7563c4ab79e178b31052e2b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped5a7452-e0", "ovs_interfaceid": "ed5a7452-e05e-4923-b8f3-23a67b426ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:07:98,bridge_name='br-int',has_traffic_filtering=True,id=ed5a7452-e05e-4923-b8f3-23a67b426ecd,network=Network(d8856523-a980-4d8a-a541-72e9b88add3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped5a7452-e0') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG os_vif [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:07:98,bridge_name='br-int',has_traffic_filtering=True,id=ed5a7452-e05e-4923-b8f3-23a67b426ecd,network=Network(d8856523-a980-4d8a-a541-72e9b88add3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped5a7452-e0') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped5a7452-e0, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=taped5a7452-e0, col_values=(('external_ids', {'iface-id': 'ed5a7452-e05e-4923-b8f3-23a67b426ecd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:07:98', 'vm-uuid': '7783c26e-ec61-4375-b191-0ce5caf766c7'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:27 user nova-compute[73078]: INFO os_vif [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:07:98,bridge_name='br-int',has_traffic_filtering=True,id=ed5a7452-e05e-4923-b8f3-23a67b426ecd,network=Network(d8856523-a980-4d8a-a541-72e9b88add3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped5a7452-e0')
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] No VIF found with MAC fa:16:3e:f7:07:98, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-e0822d2a-559f-4cb4-b64c-963dd30825d9 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-e0822d2a-559f-4cb4-b64c-963dd30825d9 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e0822d2a-559f-4cb4-b64c-963dd30825d9 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.496s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:27 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-e0822d2a-559f-4cb4-b64c-963dd30825d9 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Deleted allocations for instance 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd
Aug 14 18:16:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.compute.manager [req-4fd5c78c-6fe4-4245-aeba-46b1338e6132 req-8f33c905-d74a-4832-a44b-ad6d6c909453 service nova] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Received event network-vif-plugged-f11c2409-22e3-48a1-a629-e9274caa39e3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4fd5c78c-6fe4-4245-aeba-46b1338e6132 req-8f33c905-d74a-4832-a44b-ad6d6c909453 service nova] Acquiring lock "16fe26a2-7fe8-409e-97ca-6c44ef2fbddd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4fd5c78c-6fe4-4245-aeba-46b1338e6132 req-8f33c905-d74a-4832-a44b-ad6d6c909453 service nova] Lock "16fe26a2-7fe8-409e-97ca-6c44ef2fbddd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4fd5c78c-6fe4-4245-aeba-46b1338e6132 req-8f33c905-d74a-4832-a44b-ad6d6c909453 service nova] Lock "16fe26a2-7fe8-409e-97ca-6c44ef2fbddd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.compute.manager [req-4fd5c78c-6fe4-4245-aeba-46b1338e6132 req-8f33c905-d74a-4832-a44b-ad6d6c909453 service nova] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] No waiting events found dispatching network-vif-plugged-f11c2409-22e3-48a1-a629-e9274caa39e3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:16:27 user nova-compute[73078]: WARNING nova.compute.manager [req-4fd5c78c-6fe4-4245-aeba-46b1338e6132 req-8f33c905-d74a-4832-a44b-ad6d6c909453 service nova] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Received unexpected event network-vif-plugged-f11c2409-22e3-48a1-a629-e9274caa39e3 for instance with vm_state deleted and task_state None.
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.compute.manager [req-4fd5c78c-6fe4-4245-aeba-46b1338e6132 req-8f33c905-d74a-4832-a44b-ad6d6c909453 service nova] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Received event network-vif-plugged-f11c2409-22e3-48a1-a629-e9274caa39e3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4fd5c78c-6fe4-4245-aeba-46b1338e6132 req-8f33c905-d74a-4832-a44b-ad6d6c909453 service nova] Acquiring lock "16fe26a2-7fe8-409e-97ca-6c44ef2fbddd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4fd5c78c-6fe4-4245-aeba-46b1338e6132 req-8f33c905-d74a-4832-a44b-ad6d6c909453 service nova] Lock "16fe26a2-7fe8-409e-97ca-6c44ef2fbddd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4fd5c78c-6fe4-4245-aeba-46b1338e6132 req-8f33c905-d74a-4832-a44b-ad6d6c909453 service nova] Lock "16fe26a2-7fe8-409e-97ca-6c44ef2fbddd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.compute.manager [req-4fd5c78c-6fe4-4245-aeba-46b1338e6132 req-8f33c905-d74a-4832-a44b-ad6d6c909453 service nova] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] No waiting events found dispatching network-vif-plugged-f11c2409-22e3-48a1-a629-e9274caa39e3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:16:27 user nova-compute[73078]: WARNING nova.compute.manager [req-4fd5c78c-6fe4-4245-aeba-46b1338e6132 req-8f33c905-d74a-4832-a44b-ad6d6c909453 service nova] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Received unexpected event network-vif-plugged-f11c2409-22e3-48a1-a629-e9274caa39e3 for instance with vm_state deleted and task_state None.
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.compute.manager [req-4fd5c78c-6fe4-4245-aeba-46b1338e6132 req-8f33c905-d74a-4832-a44b-ad6d6c909453 service nova] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Received event network-vif-plugged-f11c2409-22e3-48a1-a629-e9274caa39e3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4fd5c78c-6fe4-4245-aeba-46b1338e6132 req-8f33c905-d74a-4832-a44b-ad6d6c909453 service nova] Acquiring lock "16fe26a2-7fe8-409e-97ca-6c44ef2fbddd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4fd5c78c-6fe4-4245-aeba-46b1338e6132 req-8f33c905-d74a-4832-a44b-ad6d6c909453 service nova] Lock "16fe26a2-7fe8-409e-97ca-6c44ef2fbddd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4fd5c78c-6fe4-4245-aeba-46b1338e6132 req-8f33c905-d74a-4832-a44b-ad6d6c909453 service nova] Lock "16fe26a2-7fe8-409e-97ca-6c44ef2fbddd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.compute.manager [req-4fd5c78c-6fe4-4245-aeba-46b1338e6132 req-8f33c905-d74a-4832-a44b-ad6d6c909453 service nova] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] No waiting events found dispatching network-vif-plugged-f11c2409-22e3-48a1-a629-e9274caa39e3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:16:27 user nova-compute[73078]: WARNING nova.compute.manager [req-4fd5c78c-6fe4-4245-aeba-46b1338e6132 req-8f33c905-d74a-4832-a44b-ad6d6c909453 service nova] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Received unexpected event network-vif-plugged-f11c2409-22e3-48a1-a629-e9274caa39e3 for instance with vm_state deleted and task_state None.
Aug 14 18:16:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e0822d2a-559f-4cb4-b64c-963dd30825d9 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "16fe26a2-7fe8-409e-97ca-6c44ef2fbddd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.656s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.network.neutron [req-54d33004-ae18-4ca5-826d-1df3b74dea7c req-424eb8b0-b2d3-4d85-a1f0-58cfe86ba9d3 service nova] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Updated VIF entry in instance network info cache for port ed5a7452-e05e-4923-b8f3-23a67b426ecd. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG nova.network.neutron [req-54d33004-ae18-4ca5-826d-1df3b74dea7c req-424eb8b0-b2d3-4d85-a1f0-58cfe86ba9d3 service nova] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Updating instance_info_cache with network_info: [{"id": "ed5a7452-e05e-4923-b8f3-23a67b426ecd", "address": "fa:16:3e:f7:07:98", "network": {"id": "d8856523-a980-4d8a-a541-72e9b88add3e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2086630095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "723522b7563c4ab79e178b31052e2b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped5a7452-e0", "ovs_interfaceid": "ed5a7452-e05e-4923-b8f3-23a67b426ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:16:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-54d33004-ae18-4ca5-826d-1df3b74dea7c req-424eb8b0-b2d3-4d85-a1f0-58cfe86ba9d3 service nova] Releasing lock "refresh_cache-7783c26e-ec61-4375-b191-0ce5caf766c7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:16:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:28 user nova-compute[73078]: DEBUG nova.compute.manager [req-208484b2-62c7-42e4-8c08-883da14f68af req-61e60fe0-41ae-4688-b17b-59004be98493 service nova] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Received event network-vif-deleted-f11c2409-22e3-48a1-a629-e9274caa39e3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:16:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:29 user nova-compute[73078]: DEBUG nova.compute.manager [req-ddf29a7a-7d63-427a-8f47-86ede45023ab req-910ecfd9-5209-4dc8-98ef-9b8ef10bb085 service nova] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Received event network-vif-plugged-ed5a7452-e05e-4923-b8f3-23a67b426ecd {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:16:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ddf29a7a-7d63-427a-8f47-86ede45023ab req-910ecfd9-5209-4dc8-98ef-9b8ef10bb085 service nova] Acquiring lock "7783c26e-ec61-4375-b191-0ce5caf766c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ddf29a7a-7d63-427a-8f47-86ede45023ab req-910ecfd9-5209-4dc8-98ef-9b8ef10bb085 service nova] Lock "7783c26e-ec61-4375-b191-0ce5caf766c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ddf29a7a-7d63-427a-8f47-86ede45023ab req-910ecfd9-5209-4dc8-98ef-9b8ef10bb085 service nova] Lock "7783c26e-ec61-4375-b191-0ce5caf766c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:29 user nova-compute[73078]: DEBUG nova.compute.manager [req-ddf29a7a-7d63-427a-8f47-86ede45023ab req-910ecfd9-5209-4dc8-98ef-9b8ef10bb085 service nova] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] No waiting events found dispatching network-vif-plugged-ed5a7452-e05e-4923-b8f3-23a67b426ecd {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:16:29 user nova-compute[73078]: WARNING nova.compute.manager [req-ddf29a7a-7d63-427a-8f47-86ede45023ab req-910ecfd9-5209-4dc8-98ef-9b8ef10bb085 service nova] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Received unexpected event network-vif-plugged-ed5a7452-e05e-4923-b8f3-23a67b426ecd for instance with vm_state building and task_state spawning.
Aug 14 18:16:29 user nova-compute[73078]: DEBUG nova.compute.manager [req-ddf29a7a-7d63-427a-8f47-86ede45023ab req-910ecfd9-5209-4dc8-98ef-9b8ef10bb085 service nova] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Received event network-vif-plugged-ed5a7452-e05e-4923-b8f3-23a67b426ecd {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:16:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ddf29a7a-7d63-427a-8f47-86ede45023ab req-910ecfd9-5209-4dc8-98ef-9b8ef10bb085 service nova] Acquiring lock "7783c26e-ec61-4375-b191-0ce5caf766c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ddf29a7a-7d63-427a-8f47-86ede45023ab req-910ecfd9-5209-4dc8-98ef-9b8ef10bb085 service nova] Lock "7783c26e-ec61-4375-b191-0ce5caf766c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ddf29a7a-7d63-427a-8f47-86ede45023ab req-910ecfd9-5209-4dc8-98ef-9b8ef10bb085 service nova] Lock "7783c26e-ec61-4375-b191-0ce5caf766c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:29 user nova-compute[73078]: DEBUG nova.compute.manager [req-ddf29a7a-7d63-427a-8f47-86ede45023ab req-910ecfd9-5209-4dc8-98ef-9b8ef10bb085 service nova] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] No waiting events found dispatching network-vif-plugged-ed5a7452-e05e-4923-b8f3-23a67b426ecd {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:16:29 user nova-compute[73078]: WARNING nova.compute.manager [req-ddf29a7a-7d63-427a-8f47-86ede45023ab req-910ecfd9-5209-4dc8-98ef-9b8ef10bb085 service nova] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Received unexpected event network-vif-plugged-ed5a7452-e05e-4923-b8f3-23a67b426ecd for instance with vm_state building and task_state spawning.
Aug 14 18:16:31 user nova-compute[73078]: DEBUG nova.compute.manager [req-64940743-ca10-4a6a-9a64-634295dadd1d req-da546a7b-d819-49e5-bbbe-d8619b592055 service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Received event network-changed-c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:16:31 user nova-compute[73078]: DEBUG nova.compute.manager [req-64940743-ca10-4a6a-9a64-634295dadd1d req-da546a7b-d819-49e5-bbbe-d8619b592055 service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Refreshing instance network info cache due to event network-changed-c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:16:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-64940743-ca10-4a6a-9a64-634295dadd1d req-da546a7b-d819-49e5-bbbe-d8619b592055 service nova] Acquiring lock "refresh_cache-72c1fcb2-7828-41b6-b9c7-bd12e7b35c47" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:16:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-64940743-ca10-4a6a-9a64-634295dadd1d req-da546a7b-d819-49e5-bbbe-d8619b592055 service nova] Acquired lock "refresh_cache-72c1fcb2-7828-41b6-b9c7-bd12e7b35c47" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:16:31 user nova-compute[73078]: DEBUG nova.network.neutron [req-64940743-ca10-4a6a-9a64-634295dadd1d req-da546a7b-d819-49e5-bbbe-d8619b592055 service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Refreshing network info cache for port c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:16:31 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036991.7225103, 7783c26e-ec61-4375-b191-0ce5caf766c7 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:16:31 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] VM Resumed (Lifecycle Event)
Aug 14 18:16:31 user nova-compute[73078]: DEBUG nova.compute.manager [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:16:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:16:31 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Instance spawned successfully.
Aug 14 18:16:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:16:31 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:16:31 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:16:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:16:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:16:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:16:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:16:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:16:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:16:31 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:16:31 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692036991.7259595, 7783c26e-ec61-4375-b191-0ce5caf766c7 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:16:31 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] VM Started (Lifecycle Event)
Aug 14 18:16:31 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:16:31 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:16:31 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:16:31 user nova-compute[73078]: INFO nova.compute.manager [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Took 7.42 seconds to spawn the instance on the hypervisor.
Aug 14 18:16:31 user nova-compute[73078]: DEBUG nova.compute.manager [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:16:31 user nova-compute[73078]: INFO nova.compute.manager [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Took 8.51 seconds to build instance.
Aug 14 18:16:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2277815e-f3fa-454d-bbc2-31d31af6d1de tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "7783c26e-ec61-4375-b191-0ce5caf766c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.645s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:32 user nova-compute[73078]: DEBUG nova.objects.instance [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lazy-loading 'flavor' on Instance uuid 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:16:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:32 user nova-compute[73078]: DEBUG nova.network.neutron [req-64940743-ca10-4a6a-9a64-634295dadd1d req-da546a7b-d819-49e5-bbbe-d8619b592055 service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Updated VIF entry in instance network info cache for port c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:16:32 user nova-compute[73078]: DEBUG nova.network.neutron [req-64940743-ca10-4a6a-9a64-634295dadd1d req-da546a7b-d819-49e5-bbbe-d8619b592055 service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Updating instance_info_cache with network_info: [{"id": "c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a", "address": "fa:16:3e:59:9d:f2", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93a3c8e-9e", "ovs_interfaceid": "c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:16:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:32 user nova-compute[73078]: INFO nova.compute.manager [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Attaching volume eb79e58d-10c0-41a7-89f3-80f6f42552ab to /dev/vdb
Aug 14 18:16:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-64940743-ca10-4a6a-9a64-634295dadd1d req-da546a7b-d819-49e5-bbbe-d8619b592055 service nova] Releasing lock "refresh_cache-72c1fcb2-7828-41b6-b9c7-bd12e7b35c47" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:16:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:32 user nova-compute[73078]: DEBUG os_brick.utils [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:16:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:32 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8cf9a7-07e2-44c2-bfb4-9ec4cdb5c4d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:32 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fc3292-d3d9-4df1-8ebd-65b1024e9abc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:32 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5b852c-426d-42fe-8ebc-5f198ae9b6a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:32 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[630643c8-bd02-4fb7-b15a-0c140c00c090]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:16:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:16:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:16:32 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:16:32 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a00fd4-adf7-4992-a3d7-433d6899b8b2]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:16:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:16:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:16:32 user nova-compute[73078]: DEBUG os_brick.utils [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:16:32 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Updating existing volume attachment record: 1fd9d6ee-31e0-4647-a7ca-9ce115f037e4 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:16:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2aa33c81-5335-42c4-bd68-3c42c0f37318 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Acquiring lock "ba60d2d2-656b-4471-aa79-ef95c566583e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2aa33c81-5335-42c4-bd68-3c42c0f37318 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lock "ba60d2d2-656b-4471-aa79-ef95c566583e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2aa33c81-5335-42c4-bd68-3c42c0f37318 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Acquiring lock "ba60d2d2-656b-4471-aa79-ef95c566583e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2aa33c81-5335-42c4-bd68-3c42c0f37318 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lock "ba60d2d2-656b-4471-aa79-ef95c566583e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2aa33c81-5335-42c4-bd68-3c42c0f37318 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lock "ba60d2d2-656b-4471-aa79-ef95c566583e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:36 user nova-compute[73078]: INFO nova.compute.manager [None req-2aa33c81-5335-42c4-bd68-3c42c0f37318 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Terminating instance
Aug 14 18:16:36 user nova-compute[73078]: DEBUG nova.compute.manager [None req-2aa33c81-5335-42c4-bd68-3c42c0f37318 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:16:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:36 user nova-compute[73078]: DEBUG nova.compute.manager [req-830512f9-6bd6-4b85-99bd-a870a1ed3192 req-ddde8e2b-d1dc-42f9-9f46-d5a5b52982d2 service nova] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Received event network-vif-unplugged-338f08c1-3cbf-4c3e-9c22-d911182e561a {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:16:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-830512f9-6bd6-4b85-99bd-a870a1ed3192 req-ddde8e2b-d1dc-42f9-9f46-d5a5b52982d2 service nova] Acquiring lock "ba60d2d2-656b-4471-aa79-ef95c566583e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-830512f9-6bd6-4b85-99bd-a870a1ed3192 req-ddde8e2b-d1dc-42f9-9f46-d5a5b52982d2 service nova] Lock "ba60d2d2-656b-4471-aa79-ef95c566583e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-830512f9-6bd6-4b85-99bd-a870a1ed3192 req-ddde8e2b-d1dc-42f9-9f46-d5a5b52982d2 service nova] Lock "ba60d2d2-656b-4471-aa79-ef95c566583e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:36 user nova-compute[73078]: DEBUG nova.compute.manager [req-830512f9-6bd6-4b85-99bd-a870a1ed3192 req-ddde8e2b-d1dc-42f9-9f46-d5a5b52982d2 service nova] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] No waiting events found dispatching network-vif-unplugged-338f08c1-3cbf-4c3e-9c22-d911182e561a {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:16:36 user nova-compute[73078]: DEBUG nova.compute.manager [req-830512f9-6bd6-4b85-99bd-a870a1ed3192 req-ddde8e2b-d1dc-42f9-9f46-d5a5b52982d2 service nova] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Received event network-vif-unplugged-338f08c1-3cbf-4c3e-9c22-d911182e561a for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:16:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:37 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Instance destroyed successfully.
Aug 14 18:16:37 user nova-compute[73078]: DEBUG nova.objects.instance [None req-2aa33c81-5335-42c4-bd68-3c42c0f37318 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lazy-loading 'resources' on Instance uuid ba60d2d2-656b-4471-aa79-ef95c566583e {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:16:37 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-2aa33c81-5335-42c4-bd68-3c42c0f37318 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:14:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1500269285',display_name='tempest-VolumesActionsTest-instance-1500269285',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1500269285',id=16,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:14:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eed80f7f96d14ae490e428db42e1f6f3',ramdisk_id='',reservation_id='r-bnpl8fqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1155799078',owner_user_name='tempest-VolumesActionsTest-1155799078-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:14:50Z,user_data=None,user_id='31255ab4abf34860a048d6f74033c64c',uuid=ba60d2d2-656b-4471-aa79-ef95c566583e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "338f08c1-3cbf-4c3e-9c22-d911182e561a", "address": "fa:16:3e:11:4a:be", "network": {"id": "747446a8-4755-480b-a3b1-44648769bb00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1534750515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed80f7f96d14ae490e428db42e1f6f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap338f08c1-3c", "ovs_interfaceid": "338f08c1-3cbf-4c3e-9c22-d911182e561a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:16:37 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-2aa33c81-5335-42c4-bd68-3c42c0f37318 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Converting VIF {"id": "338f08c1-3cbf-4c3e-9c22-d911182e561a", "address": "fa:16:3e:11:4a:be", "network": {"id": "747446a8-4755-480b-a3b1-44648769bb00", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1534750515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eed80f7f96d14ae490e428db42e1f6f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap338f08c1-3c", "ovs_interfaceid": "338f08c1-3cbf-4c3e-9c22-d911182e561a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:16:37 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-2aa33c81-5335-42c4-bd68-3c42c0f37318 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:4a:be,bridge_name='br-int',has_traffic_filtering=True,id=338f08c1-3cbf-4c3e-9c22-d911182e561a,network=Network(747446a8-4755-480b-a3b1-44648769bb00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap338f08c1-3c') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:16:37 user nova-compute[73078]: DEBUG os_vif [None req-2aa33c81-5335-42c4-bd68-3c42c0f37318 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:4a:be,bridge_name='br-int',has_traffic_filtering=True,id=338f08c1-3cbf-4c3e-9c22-d911182e561a,network=Network(747446a8-4755-480b-a3b1-44648769bb00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap338f08c1-3c') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:16:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap338f08c1-3c, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:16:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:16:37 user nova-compute[73078]: INFO os_vif [None req-2aa33c81-5335-42c4-bd68-3c42c0f37318 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:4a:be,bridge_name='br-int',has_traffic_filtering=True,id=338f08c1-3cbf-4c3e-9c22-d911182e561a,network=Network(747446a8-4755-480b-a3b1-44648769bb00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap338f08c1-3c')
Aug 14 18:16:37 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-2aa33c81-5335-42c4-bd68-3c42c0f37318 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Deleting instance files /opt/stack/data/nova/instances/ba60d2d2-656b-4471-aa79-ef95c566583e_del
Aug 14 18:16:37 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-2aa33c81-5335-42c4-bd68-3c42c0f37318 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Deletion of /opt/stack/data/nova/instances/ba60d2d2-656b-4471-aa79-ef95c566583e_del complete
Aug 14 18:16:37 user nova-compute[73078]: INFO nova.compute.manager [None req-2aa33c81-5335-42c4-bd68-3c42c0f37318 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 14 18:16:37 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-2aa33c81-5335-42c4-bd68-3c42c0f37318 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:16:37 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:16:37 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:16:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:38 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:16:38 user nova-compute[73078]: DEBUG nova.compute.manager [req-802106a6-b782-42cd-a36f-39dc3dd43b85 req-3a2057fe-0f3b-45a4-9479-933375937166 service nova] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Received event network-vif-deleted-338f08c1-3cbf-4c3e-9c22-d911182e561a {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:16:38 user nova-compute[73078]: INFO nova.compute.manager [req-802106a6-b782-42cd-a36f-39dc3dd43b85 req-3a2057fe-0f3b-45a4-9479-933375937166 service nova] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Neutron deleted interface 338f08c1-3cbf-4c3e-9c22-d911182e561a; detaching it from the instance and deleting it from the info cache
Aug 14 18:16:38 user nova-compute[73078]: DEBUG nova.network.neutron [req-802106a6-b782-42cd-a36f-39dc3dd43b85 req-3a2057fe-0f3b-45a4-9479-933375937166 service nova] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:16:38 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Took 0.79 seconds to deallocate network for instance.
Aug 14 18:16:38 user nova-compute[73078]: DEBUG nova.compute.manager [req-802106a6-b782-42cd-a36f-39dc3dd43b85 req-3a2057fe-0f3b-45a4-9479-933375937166 service nova] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Detach interface failed, port_id=338f08c1-3cbf-4c3e-9c22-d911182e561a, reason: Instance ba60d2d2-656b-4471-aa79-ef95c566583e could not be found. {{(pid=73078) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 18:16:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2aa33c81-5335-42c4-bd68-3c42c0f37318 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2aa33c81-5335-42c4-bd68-3c42c0f37318 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:38 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-2aa33c81-5335-42c4-bd68-3c42c0f37318 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:16:38 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-2aa33c81-5335-42c4-bd68-3c42c0f37318 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:16:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2aa33c81-5335-42c4-bd68-3c42c0f37318 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.524s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:38 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-2aa33c81-5335-42c4-bd68-3c42c0f37318 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Deleted allocations for instance ba60d2d2-656b-4471-aa79-ef95c566583e
Aug 14 18:16:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2aa33c81-5335-42c4-bd68-3c42c0f37318 tempest-VolumesActionsTest-1155799078 tempest-VolumesActionsTest-1155799078-project-member] Lock "ba60d2d2-656b-4471-aa79-ef95c566583e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.497s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:38 user nova-compute[73078]: DEBUG nova.compute.manager [req-84584c30-6206-4e9a-a47c-00b94f617d89 req-9ff07453-bdfb-4051-abcc-da3e407599ee service nova] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Received event network-vif-plugged-338f08c1-3cbf-4c3e-9c22-d911182e561a {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:16:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-84584c30-6206-4e9a-a47c-00b94f617d89 req-9ff07453-bdfb-4051-abcc-da3e407599ee service nova] Acquiring lock "ba60d2d2-656b-4471-aa79-ef95c566583e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-84584c30-6206-4e9a-a47c-00b94f617d89 req-9ff07453-bdfb-4051-abcc-da3e407599ee service nova] Lock "ba60d2d2-656b-4471-aa79-ef95c566583e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-84584c30-6206-4e9a-a47c-00b94f617d89 req-9ff07453-bdfb-4051-abcc-da3e407599ee service nova] Lock "ba60d2d2-656b-4471-aa79-ef95c566583e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:38 user nova-compute[73078]: DEBUG nova.compute.manager [req-84584c30-6206-4e9a-a47c-00b94f617d89 req-9ff07453-bdfb-4051-abcc-da3e407599ee service nova] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] No waiting events found dispatching network-vif-plugged-338f08c1-3cbf-4c3e-9c22-d911182e561a {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:16:38 user nova-compute[73078]: WARNING nova.compute.manager [req-84584c30-6206-4e9a-a47c-00b94f617d89 req-9ff07453-bdfb-4051-abcc-da3e407599ee service nova] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Received unexpected event network-vif-plugged-338f08c1-3cbf-4c3e-9c22-d911182e561a for instance with vm_state deleted and task_state None.
Aug 14 18:16:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-22f010ee-2695-4006-bdd0-ca3283d2fbab tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "8d257202-d8ab-4161-9b67-045cf1e36772" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-22f010ee-2695-4006-bdd0-ca3283d2fbab tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "8d257202-d8ab-4161-9b67-045cf1e36772" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:39 user nova-compute[73078]: INFO nova.compute.manager [None req-22f010ee-2695-4006-bdd0-ca3283d2fbab tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Detaching volume 9a7941bf-b1da-44d2-8c65-184a4ac9b3a0
Aug 14 18:16:39 user nova-compute[73078]: INFO nova.virt.block_device [None req-22f010ee-2695-4006-bdd0-ca3283d2fbab tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Attempting to driver detach volume 9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 from mountpoint /dev/vdc
Aug 14 18:16:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-22f010ee-2695-4006-bdd0-ca3283d2fbab tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Attempting to detach device vdc from instance 8d257202-d8ab-4161-9b67-045cf1e36772 from the persistent domain config. {{(pid=73078) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 18:16:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-22f010ee-2695-4006-bdd0-ca3283d2fbab tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:16:39 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:16:39 user nova-compute[73078]:   <source dev="/dev/sdb"/>
Aug 14 18:16:39 user nova-compute[73078]:   <target dev="vdc" bus="virtio"/>
Aug 14 18:16:39 user nova-compute[73078]:   <serial>9a7941bf-b1da-44d2-8c65-184a4ac9b3a0</serial>
Aug 14 18:16:39 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 18:16:39 user nova-compute[73078]: </disk>
Aug 14 18:16:39 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:16:39 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-22f010ee-2695-4006-bdd0-ca3283d2fbab tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Successfully detached device vdc from instance 8d257202-d8ab-4161-9b67-045cf1e36772 from the persistent domain config.
Aug 14 18:16:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-22f010ee-2695-4006-bdd0-ca3283d2fbab tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 8d257202-d8ab-4161-9b67-045cf1e36772 from the live domain config. {{(pid=73078) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 18:16:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-22f010ee-2695-4006-bdd0-ca3283d2fbab tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:16:39 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:16:39 user nova-compute[73078]:   <source dev="/dev/sdb"/>
Aug 14 18:16:39 user nova-compute[73078]:   <target dev="vdc" bus="virtio"/>
Aug 14 18:16:39 user nova-compute[73078]:   <serial>9a7941bf-b1da-44d2-8c65-184a4ac9b3a0</serial>
Aug 14 18:16:39 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 18:16:39 user nova-compute[73078]: </disk>
Aug 14 18:16:39 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:16:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Received event <DeviceRemovedEvent: 1692036999.9769518, 8d257202-d8ab-4161-9b67-045cf1e36772 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73078) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 18:16:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-22f010ee-2695-4006-bdd0-ca3283d2fbab tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 8d257202-d8ab-4161-9b67-045cf1e36772 {{(pid=73078) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 18:16:39 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-22f010ee-2695-4006-bdd0-ca3283d2fbab tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Successfully detached device vdc from instance 8d257202-d8ab-4161-9b67-045cf1e36772 from the live domain config.
Aug 14 18:16:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22f010ee-2695-4006-bdd0-ca3283d2fbab tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:16:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f010ee-2695-4006-bdd0-ca3283d2fbab tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXDlMzTO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:16:39 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-22f010ee-2695-4006-bdd0-ca3283d2fbab tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:16:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-22f010ee-2695-4006-bdd0-ca3283d2fbab tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:16:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-22f010ee-2695-4006-bdd0-ca3283d2fbab tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:16:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f010ee-2695-4006-bdd0-ca3283d2fbab tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:16:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a7bae1-fda9-40a1-890b-65ef8a8ff334]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee9f3d1-db4e-43b8-9bb6-cc9931fc1810]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f010ee-2695-4006-bdd0-ca3283d2fbab tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 (non-flash)
Aug 14 18:16:40 user nova-compute[73078]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:16:40 user nova-compute[73078]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:16:40 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f010ee-2695-4006-bdd0-ca3283d2fbab tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 (non-flash)
Aug 14 18:16:40 user nova-compute[73078]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:16:40 user nova-compute[73078]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:16:40 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f010ee-2695-4006-bdd0-ca3283d2fbab tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe97828ef80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0'): ({'sdb'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-22f010ee-2695-4006-bdd0-ca3283d2fbab tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Removing single pathed devices sdb {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f2d5b1-60a2-458f-914e-cf8fe0acc462]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62f0de0-37a4-46ca-8299-c68950a48362]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-22f010ee-2695-4006-bdd0-ca3283d2fbab tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Flushing IO for device /dev/sdb {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[38311b27-787b-472d-8741-e6696e5ae4c9]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-22f010ee-2695-4006-bdd0-ca3283d2fbab tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0003138-b92d-454e-b610-f161506d709d]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-22f010ee-2695-4006-bdd0-ca3283d2fbab tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-22f010ee-2695-4006-bdd0-ca3283d2fbab tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] SCSI volumes sdb have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f010ee-2695-4006-bdd0-ca3283d2fbab tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d9ced2-8c68-41fe-9dec-9794ff91f54b]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f010ee-2695-4006-bdd0-ca3283d2fbab tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[821ac5ca-07be-4507-9a19-898cd8f497f2]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f010ee-2695-4006-bdd0-ca3283d2fbab tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0, portal: 172.16.0.220,3260]
Aug 14 18:16:40 user nova-compute[73078]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0, portal: 172.16.0.220,3260] successful.
Aug 14 18:16:40 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a7941bf-b1da-44d2-8c65-184a4ac9b3a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a020e8c-a914-487e-93b4-42f62a442704]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f010ee-2695-4006-bdd0-ca3283d2fbab tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-22f010ee-2695-4006-bdd0-ca3283d2fbab tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f010ee-2695-4006-bdd0-ca3283d2fbab tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] <== disconnect_volume: return (376ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22f010ee-2695-4006-bdd0-ca3283d2fbab tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:16:40 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692036985.6481776, 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:16:40 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] VM Stopped (Lifecycle Event)
Aug 14 18:16:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-881e4b11-4b82-4301-b6a3-ed482dd6a100 None None] [instance: 16fe26a2-7fe8-409e-97ca-6c44ef2fbddd] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:16:41 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:16:41 user nova-compute[73078]: DEBUG nova.objects.instance [None req-22f010ee-2695-4006-bdd0-ca3283d2fbab tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lazy-loading 'flavor' on Instance uuid 8d257202-d8ab-4161-9b67-045cf1e36772 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:16:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-22f010ee-2695-4006-bdd0-ca3283d2fbab tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "8d257202-d8ab-4161-9b67-045cf1e36772" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.919s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73078) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kscWnpYV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:16:43 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:16:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:16:43 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:16:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:16:43 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:16:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a221a57-799d-4c2f-8dbf-e77178874915]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:16:43 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d0cef7-8620-4edb-b602-af19ff5ea474]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab] added
Aug 14 18:16:43 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[be153e8e-23d7-479f-b252-2bc89b797235]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9aa4fa-57ab-4fe6-b60a-2de23545b698]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kscWnpYV {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kscWnpYV" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[22160342-0fb4-4830-ad19-2abee11d2520]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kscWnpYV'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e90033c-8929-477f-9df9-67f68c5e8d6e]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3c30f4-0de5-4c4c-bb63-78b7a7e4705d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:16:43 user nova-compute[73078]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:16:43 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:16:43 user nova-compute[73078]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:16:43 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[94951dbe-ed10-4580-9088-1adcfe514730]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab, portal: 172.16.0.220,3260]
Aug 14 18:16:43 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab, portal: 172.16.0.220,3260] successful.
Aug 14 18:16:43 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[13de8f68-2338-434d-ba90-2a45a820b81b]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d37159-0394-4d08-bbc9-8fab63d3072a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:16:43 user nova-compute[73078]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:16:43 user nova-compute[73078]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:16:43 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:16:43 user nova-compute[73078]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:16:43 user nova-compute[73078]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:16:43 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:16:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:44 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc80bb0-fc3a-4840-ab1b-4f1f45664294]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:44 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:16:44 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kscWnpYV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:16:44 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:16:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:16:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '26262383234363662', 'path': '/dev/sdb'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:16:45 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262383234363662', 'path': '/dev/sdb'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:16:45 user nova-compute[73078]: DEBUG nova.objects.instance [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lazy-loading 'flavor' on Instance uuid 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:16:45 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 18:16:45 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:16:45 user nova-compute[73078]:   <source dev="/dev/sdb"/>
Aug 14 18:16:45 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:16:45 user nova-compute[73078]:   <serial>eb79e58d-10c0-41a7-89f3-80f6f42552ab</serial>
Aug 14 18:16:45 user nova-compute[73078]: </disk>
Aug 14 18:16:45 user nova-compute[73078]:  {{(pid=73078) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 18:16:45 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:16:45 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:16:45 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:16:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:45 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:16:45 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:16:45 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:16:45 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] No VIF found with MAC fa:16:3e:59:9d:f2, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:16:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-24787c88-3ce6-4496-b39a-eacd70489efa tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.282s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:16:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7783c26e-ec61-4375-b191-0ce5caf766c7/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7783c26e-ec61-4375-b191-0ce5caf766c7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7783c26e-ec61-4375-b191-0ce5caf766c7/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7783c26e-ec61-4375-b191-0ce5caf766c7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:47 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:16:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk.rescue --force-share --output=json" returned: 0 in 0.253s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk.rescue --force-share --output=json" returned: 0 in 0.270s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json" returned: 0 in 0.326s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:48 user nova-compute[73078]: INFO nova.compute.manager [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Rebuilding instance
Aug 14 18:16:48 user nova-compute[73078]: DEBUG nova.objects.instance [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lazy-loading 'trusted_certs' on Instance uuid 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:16:48 user nova-compute[73078]: DEBUG nova.compute.manager [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:16:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:48 user nova-compute[73078]: DEBUG nova.objects.instance [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lazy-loading 'pci_requests' on Instance uuid 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:16:48 user nova-compute[73078]: DEBUG nova.objects.instance [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lazy-loading 'pci_devices' on Instance uuid 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:16:48 user nova-compute[73078]: DEBUG nova.objects.instance [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lazy-loading 'resources' on Instance uuid 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:16:48 user nova-compute[73078]: DEBUG nova.objects.instance [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lazy-loading 'migration_context' on Instance uuid 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:16:48 user nova-compute[73078]: DEBUG nova.objects.instance [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73078) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 14 18:16:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG nova.compute.manager [req-63f6e121-d7b4-4a75-956f-4a70ce5e3fc1 req-c86d0636-0c0a-4242-bee0-a213ddaaf9d2 service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Received event network-vif-unplugged-c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-63f6e121-d7b4-4a75-956f-4a70ce5e3fc1 req-c86d0636-0c0a-4242-bee0-a213ddaaf9d2 service nova] Acquiring lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-63f6e121-d7b4-4a75-956f-4a70ce5e3fc1 req-c86d0636-0c0a-4242-bee0-a213ddaaf9d2 service nova] Lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-63f6e121-d7b4-4a75-956f-4a70ce5e3fc1 req-c86d0636-0c0a-4242-bee0-a213ddaaf9d2 service nova] Lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG nova.compute.manager [req-63f6e121-d7b4-4a75-956f-4a70ce5e3fc1 req-c86d0636-0c0a-4242-bee0-a213ddaaf9d2 service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] No waiting events found dispatching network-vif-unplugged-c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:16:49 user nova-compute[73078]: WARNING nova.compute.manager [req-63f6e121-d7b4-4a75-956f-4a70ce5e3fc1 req-c86d0636-0c0a-4242-bee0-a213ddaaf9d2 service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Received unexpected event network-vif-unplugged-c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a for instance with vm_state active and task_state rebuilding.
Aug 14 18:16:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:49 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Instance destroyed successfully.
Aug 14 18:16:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:49 user nova-compute[73078]: INFO nova.compute.manager [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Detaching volume eb79e58d-10c0-41a7-89f3-80f6f42552ab
Aug 14 18:16:49 user nova-compute[73078]: INFO nova.virt.block_device [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Attempting to driver detach volume eb79e58d-10c0-41a7-89f3-80f6f42552ab from mountpoint /dev/vdb
Aug 14 18:16:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Attempting to detach device vdb from instance 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47 from the persistent domain config. {{(pid=73078) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:16:49 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:16:49 user nova-compute[73078]:   <source dev="/dev/sdb"/>
Aug 14 18:16:49 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:16:49 user nova-compute[73078]:   <serial>eb79e58d-10c0-41a7-89f3-80f6f42552ab</serial>
Aug 14 18:16:49 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:16:49 user nova-compute[73078]: </disk>
Aug 14 18:16:49 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:16:49 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Successfully detached device vdb from instance 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47 from the persistent domain config.
Aug 14 18:16:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kscWnpYV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:16:49 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 18:16:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fd0047-7ba4-44c9-a217-dd23d677e3d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dbe084-120a-4bcb-849a-dc67149e5c5a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:16:49 user nova-compute[73078]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:16:49 user nova-compute[73078]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:16:49 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:16:49 user nova-compute[73078]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:16:49 user nova-compute[73078]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:16:49 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe978116170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab'): ({'sdb'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Removing single pathed devices sdb {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74ca909-bda5-4c15-955f-278d4027339d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9894c50f-4cfd-4a9c-a75d-a06e37b6f70f]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Flushing IO for device /dev/sdb {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[67803ebd-42c0-4a37-872f-d0079335e78a]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[635a2ba5-0022-4aec-975a-d8401a119d0e]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] SCSI volumes sdb have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:16:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:50 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aefe4d1-3b69-4fbb-a5b8-89f71f81626f]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:16:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:50 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[570f7862-3256-4b11-8fe6-652981046d94]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab, portal: 172.16.0.220,3260]
Aug 14 18:16:50 user nova-compute[73078]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab, portal: 172.16.0.220,3260] successful.
Aug 14 18:16:50 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:16:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:50 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d9b204-4897-47cf-a946-b3676874b853]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:16:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:16:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] <== disconnect_volume: return (376ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:16:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:16:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:16:51 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:16:51 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:16:51 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=7071MB free_disk=25.446495056152344GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:51 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Instance destroyed successfully.
Aug 14 18:16:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:14:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1747051739',display_name='tempest-ServerActionsTestOtherA-server-294631183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1747051739',id=15,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7MoxQfLpU8YABS9Pw20/hLN1B8HMClZxOewhbMQPCKdvwfAau43e4Qw7i1r0zeStVmZeOs2kcJHkp+76O4z0OTCmnK5xY5GG1VsFRZAQIs0+ge0mW06cadbyyO+FeOxg==',key_name='tempest-keypair-1384674648',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:14:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='993dd55f40454640824687ffb6a3c581',ramdisk_id='',reservation_id='r-yhnd265c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1876890021',owner_user_name='tempest-ServerActionsTestOtherA-1876890021-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:16:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cca1112ab354f9fb31658e18c0d03b1',uuid=72c1fcb2-7828-41b6-b9c7-bd12e7b35c47,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a", "address": "fa:16:3e:59:9d:f2", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93a3c8e-9e", "ovs_interfaceid": "c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Converting VIF {"id": "c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a", "address": "fa:16:3e:59:9d:f2", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93a3c8e-9e", "ovs_interfaceid": "c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:9d:f2,bridge_name='br-int',has_traffic_filtering=True,id=c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a,network=Network(bfef9745-5a40-44b6-a6d5-2ef1e77fc5db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93a3c8e-9e') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG os_vif [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:9d:f2,bridge_name='br-int',has_traffic_filtering=True,id=c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a,network=Network(bfef9745-5a40-44b6-a6d5-2ef1e77fc5db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93a3c8e-9e') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc93a3c8e-9e, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:51 user nova-compute[73078]: INFO os_vif [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:9d:f2,bridge_name='br-int',has_traffic_filtering=True,id=c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a,network=Network(bfef9745-5a40-44b6-a6d5-2ef1e77fc5db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93a3c8e-9e')
Aug 14 18:16:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kscWnpYV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:16:51 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 18:16:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8a9d01-f502-462a-9e2f-24b7751a2b97]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Applying migration context for instance 24c00db3-2457-443d-b5ab-7e6ecaa57515 as it has an incoming, in-progress migration bc0b08ea-7f2e-432b-800c-8d8bf1f62e7e. Migration status is finished {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 14 18:16:51 user nova-compute[73078]: INFO nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Updating resource usage from migration bc0b08ea-7f2e-432b-800c-8d8bf1f62e7e
Aug 14 18:16:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b783c18-473b-448b-a7a2-dfdb9a876147]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:16:51 user nova-compute[73078]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:16:51 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:16:51 user nova-compute[73078]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:16:51 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe97828fb50>, {}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Disconnecting from: [] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] <== disconnect_volume: return (74ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:16:51 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Deleting instance files /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47_del
Aug 14 18:16:51 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Deletion of /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47_del complete
Aug 14 18:16:51 user nova-compute[73078]: INFO nova.virt.block_device [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Booting with volume eb79e58d-10c0-41a7-89f3-80f6f42552ab at /dev/vdb
Aug 14 18:16:51 user nova-compute[73078]: DEBUG os_brick.utils [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance de80e188-9385-4613-8a6c-aa72b624ad55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 1f88cb97-4f22-439e-99f2-d7cb8d5aff36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 3c840309-9884-4c8a-a6ee-1acd44f32c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 8d257202-d8ab-4161-9b67-045cf1e36772 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Migration bc0b08ea-7f2e-432b-800c-8d8bf1f62e7e is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 24c00db3-2457-443d-b5ab-7e6ecaa57515 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance ea445c0c-e5a1-4e24-8008-2cd64a679f34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 7783c26e-ec61-4375-b191-0ce5caf766c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2979acf5-7c6a-43f8-bad2-990582c4bc62]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-e1611556-3433-4b17-9f7f-12953cff6251 req-8d8aed9c-1163-4823-804b-64ddef9b1471 service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Received event network-vif-plugged-c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e1611556-3433-4b17-9f7f-12953cff6251 req-8d8aed9c-1163-4823-804b-64ddef9b1471 service nova] Acquiring lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e1611556-3433-4b17-9f7f-12953cff6251 req-8d8aed9c-1163-4823-804b-64ddef9b1471 service nova] Lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e1611556-3433-4b17-9f7f-12953cff6251 req-8d8aed9c-1163-4823-804b-64ddef9b1471 service nova] Lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-e1611556-3433-4b17-9f7f-12953cff6251 req-8d8aed9c-1163-4823-804b-64ddef9b1471 service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] No waiting events found dispatching network-vif-plugged-c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:16:51 user nova-compute[73078]: WARNING nova.compute.manager [req-e1611556-3433-4b17-9f7f-12953cff6251 req-8d8aed9c-1163-4823-804b-64ddef9b1471 service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Received unexpected event network-vif-plugged-c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a for instance with vm_state active and task_state rebuild_block_device_mapping.
Aug 14 18:16:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d321c84-1e79-426b-8735-385a93b15eaa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Refreshing inventories for resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39d8dca-c462-4d99-9c8f-73c357cc03ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eecb061-4631-4043-bae2-2cc922751b8a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Updating ProviderTree inventory for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Updating inventory in ProviderTree for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG nova.network.neutron [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Port 99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 binding to destination host user is already ACTIVE {{(pid=73078) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Acquiring lock "refresh_cache-24c00db3-2457-443d-b5ab-7e6ecaa57515" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Acquired lock "refresh_cache-24c00db3-2457-443d-b5ab-7e6ecaa57515" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG nova.network.neutron [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:16:51 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:16:51 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[46690c8a-6eaf-43a6-b94c-e357da696622]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG os_brick.utils [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Updating existing volume attachment record: 671eb27c-8371-4e7d-8a18-f9c979cb722f {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Refreshing aggregate associations for resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b, aggregates: None {{(pid=73078) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 18:16:51 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Refreshing trait associations for resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV {{(pid=73078) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 18:16:52 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692036997.0581584, ba60d2d2-656b-4471-aa79-ef95c566583e => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:16:52 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] VM Stopped (Lifecycle Event)
Aug 14 18:16:52 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:16:52 user nova-compute[73078]: DEBUG nova.compute.manager [None req-681586f0-de5f-48a0-9de5-fcd79242f309 None None] [instance: ba60d2d2-656b-4471-aa79-ef95c566583e] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:16:52 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:16:52 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:16:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.954s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:52 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:16:52 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Cleaning up deleted instances {{(pid=73078) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 18:16:52 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] There are 0 instances to clean {{(pid=73078) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 18:16:52 user nova-compute[73078]: DEBUG nova.network.neutron [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Updating instance_info_cache with network_info: [{"id": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "address": "fa:16:3e:ce:cd:93", "network": {"id": "1ec1577a-2943-44e6-9fd6-9d8308fcf09f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-135315381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09794ca2aebc4f50a4ab26cecefb4d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d8f3d6-2e", "ovs_interfaceid": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:16:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Releasing lock "refresh_cache-24c00db3-2457-443d-b5ab-7e6ecaa57515" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:16:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Creating tmpfile /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/tmpz_f1omxp to verify with other compute node that the instance is on the same shared storage. {{(pid=73078) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 14 18:16:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:52 user nova-compute[73078]: DEBUG nova.compute.manager [req-77b2b775-98ca-4453-9287-fa3addaf44e6 req-a8f2262c-6c92-4c1f-8c7a-13eef360f6f4 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Received event network-vif-unplugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:16:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-77b2b775-98ca-4453-9287-fa3addaf44e6 req-a8f2262c-6c92-4c1f-8c7a-13eef360f6f4 service nova] Acquiring lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-77b2b775-98ca-4453-9287-fa3addaf44e6 req-a8f2262c-6c92-4c1f-8c7a-13eef360f6f4 service nova] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-77b2b775-98ca-4453-9287-fa3addaf44e6 req-a8f2262c-6c92-4c1f-8c7a-13eef360f6f4 service nova] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:52 user nova-compute[73078]: DEBUG nova.compute.manager [req-77b2b775-98ca-4453-9287-fa3addaf44e6 req-a8f2262c-6c92-4c1f-8c7a-13eef360f6f4 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] No waiting events found dispatching network-vif-unplugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:16:52 user nova-compute[73078]: WARNING nova.compute.manager [req-77b2b775-98ca-4453-9287-fa3addaf44e6 req-a8f2262c-6c92-4c1f-8c7a-13eef360f6f4 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Received unexpected event network-vif-unplugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 for instance with vm_state resized and task_state resize_reverting.
Aug 14 18:16:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Acquiring lock "83aca621-7182-49a9-b4b3-8f22dd50f869" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG nova.compute.manager [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:16:53 user nova-compute[73078]: INFO nova.compute.claims [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Claim successful on node user
Aug 14 18:16:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-8d257202-d8ab-4161-9b67-045cf1e36772" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-8d257202-d8ab-4161-9b67-045cf1e36772" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:16:53 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Instance destroyed successfully.
Aug 14 18:16:53 user nova-compute[73078]: DEBUG nova.objects.instance [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lazy-loading 'resources' on Instance uuid 24c00db3-2457-443d-b5ab-7e6ecaa57515 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-800184995',display_name='tempest-ServerActionsTestOtherB-server-800184995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-800184995',id=5,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbnc7U7feBP7majde5yxGnuBaGos4MxLqvnB0BjKphlc0UqHWP3CzhimKim+Kv31+0a1u5JyxtEQSRk/yFbj17pMkgZ6K1nerehXIw6QXdILWEOhFCV63jMfH8QM13ghA==',key_name='tempest-keypair-2079056104',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:15:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09794ca2aebc4f50a4ab26cecefb4d0c',ramdisk_id='',reservation_id='r-ikq8fsl0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-727924132',owner_user_name='tempest-ServerActionsTestOtherB-727924132-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:15:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ad487c5160a4dd8b9a03d468edf4bef',uuid=24c00db3-2457-443d-b5ab-7e6ecaa57515,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "address": "fa:16:3e:ce:cd:93", "network": {"id": "1ec1577a-2943-44e6-9fd6-9d8308fcf09f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-135315381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09794ca2aebc4f50a4ab26cecefb4d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d8f3d6-2e", "ovs_interfaceid": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Converting VIF {"id": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "address": "fa:16:3e:ce:cd:93", "network": {"id": "1ec1577a-2943-44e6-9fd6-9d8308fcf09f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-135315381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09794ca2aebc4f50a4ab26cecefb4d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d8f3d6-2e", "ovs_interfaceid": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:cd:93,bridge_name='br-int',has_traffic_filtering=True,id=99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563,network=Network(1ec1577a-2943-44e6-9fd6-9d8308fcf09f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d8f3d6-2e') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG os_vif [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:cd:93,bridge_name='br-int',has_traffic_filtering=True,id=99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563,network=Network(1ec1577a-2943-44e6-9fd6-9d8308fcf09f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d8f3d6-2e') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99d8f3d6-2e, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:16:53 user nova-compute[73078]: INFO os_vif [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:cd:93,bridge_name='br-int',has_traffic_filtering=True,id=99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563,network=Network(1ec1577a-2943-44e6-9fd6-9d8308fcf09f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d8f3d6-2e')
Aug 14 18:16:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XefjBbVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:16:53 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:16:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bf0584-a10c-4521-a05e-57363979febc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd971dfa-40a6-402d-850c-b3e04fa73e12]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:16:53 user nova-compute[73078]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:16:53 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:16:53 user nova-compute[73078]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:16:53 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9781c83a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272'): ({'sdc'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Removing single pathed devices sdc {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d04d50b-968a-4a4b-be4a-851c9497ddf3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b21291-cd6d-4b19-a0dd-4ee358235e19]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Flushing IO for device /dev/sdc {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[691c6aef-5c0c-450f-8b53-fe009502d1e0]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6948f4ba-7b9b-4134-ba18-2980a4da082b]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] SCSI volumes sdc have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.611s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG nova.compute.manager [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0840fd87-cdf8-428e-a1ad-2db2feeb7d98]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:16:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG nova.compute.manager [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG nova.network.neutron [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4014028b-bd81-4359-a719-0921dcd91114]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272, portal: 172.16.0.220,3260]
Aug 14 18:16:54 user nova-compute[73078]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272, portal: 172.16.0.220,3260] successful.
Aug 14 18:16:54 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Updating instance_info_cache with network_info: [{"id": "10688f4a-5919-4a48-9767-92e304a494be", "address": "fa:16:3e:a4:3b:fc", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10688f4a-59", "ovs_interfaceid": "10688f4a-5919-4a48-9767-92e304a494be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f51a98-feab-41c5-b98b-a486d3458142]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] <== disconnect_volume: return (337ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:16:54 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:16:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-8d257202-d8ab-4161-9b67-045cf1e36772" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG nova.compute.manager [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:16:54 user nova-compute[73078]: INFO nova.virt.block_device [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Booting with volume 1d451bb3-f3ac-4eee-ae2e-722f3db4887a at /dev/vda
Aug 14 18:16:54 user nova-compute[73078]: DEBUG nova.policy [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aced5b7859ff428ba065909862c08da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed67729880341ffb35e2e668fd80e95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG os_brick.utils [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3754c776-a632-46dc-86c8-8874434e337a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc4eda1-606e-49ee-b949-eee6a88f57df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32c4197-c738-46a1-b0ec-9c2cde06ea58]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfc11da-23f9-487a-b48f-0115777bad89]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:16:54 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:16:54 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[417895a6-3ae0-4675-b527-8fa009acce4c]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG os_brick.utils [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Updating existing volume attachment record: c85ee7f5-3364-4851-a2ee-1d8e73108304 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG nova.compute.manager [req-c0a15c63-bc20-4ddf-a8f9-32cd219691b9 req-92e77742-c24a-4ecf-b6f0-1ea86a4815de service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Received event network-vif-plugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-c0a15c63-bc20-4ddf-a8f9-32cd219691b9 req-92e77742-c24a-4ecf-b6f0-1ea86a4815de service nova] Acquiring lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-c0a15c63-bc20-4ddf-a8f9-32cd219691b9 req-92e77742-c24a-4ecf-b6f0-1ea86a4815de service nova] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-c0a15c63-bc20-4ddf-a8f9-32cd219691b9 req-92e77742-c24a-4ecf-b6f0-1ea86a4815de service nova] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:54 user nova-compute[73078]: DEBUG nova.compute.manager [req-c0a15c63-bc20-4ddf-a8f9-32cd219691b9 req-92e77742-c24a-4ecf-b6f0-1ea86a4815de service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] No waiting events found dispatching network-vif-plugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:16:54 user nova-compute[73078]: WARNING nova.compute.manager [req-c0a15c63-bc20-4ddf-a8f9-32cd219691b9 req-92e77742-c24a-4ecf-b6f0-1ea86a4815de service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Received unexpected event network-vif-plugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 for instance with vm_state resized and task_state resize_reverting.
Aug 14 18:16:55 user nova-compute[73078]: DEBUG nova.network.neutron [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Successfully created port: 9f1350b2-c0dd-4818-a941-22f37f92e610 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:16:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:55 user nova-compute[73078]: DEBUG nova.objects.instance [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lazy-loading 'migration_context' on Instance uuid 24c00db3-2457-443d-b5ab-7e6ecaa57515 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:16:55 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:16:55 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:16:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.599s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:55 user nova-compute[73078]: DEBUG nova.network.neutron [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Successfully created port: 1054bcf2-2aa6-4112-bd95-9d471c3f63cd {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:16:55 user nova-compute[73078]: INFO nova.compute.manager [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Swapping old allocation on dict_keys(['af8baf5b-57ff-4012-bdc8-cc28446f0e7b']) held by migration bc0b08ea-7f2e-432b-800c-8d8bf1f62e7e for instance
Aug 14 18:16:55 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Overwriting current allocation {'allocations': {'af8baf5b-57ff-4012-bdc8-cc28446f0e7b': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 25}}, 'project_id': '09794ca2aebc4f50a4ab26cecefb4d0c', 'user_id': '0ad487c5160a4dd8b9a03d468edf4bef', 'consumer_generation': 1} on consumer 24c00db3-2457-443d-b5ab-7e6ecaa57515 {{(pid=73078) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 14 18:16:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Acquiring lock "refresh_cache-24c00db3-2457-443d-b5ab-7e6ecaa57515" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:16:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Acquired lock "refresh_cache-24c00db3-2457-443d-b5ab-7e6ecaa57515" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:16:56 user nova-compute[73078]: DEBUG nova.network.neutron [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:16:56 user nova-compute[73078]: DEBUG nova.network.neutron [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Successfully created port: 10e5877a-b0ba-449a-81db-1ecf3e760851 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:16:56 user nova-compute[73078]: DEBUG nova.network.neutron [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Updating instance_info_cache with network_info: [{"id": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "address": "fa:16:3e:ce:cd:93", "network": {"id": "1ec1577a-2943-44e6-9fd6-9d8308fcf09f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-135315381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09794ca2aebc4f50a4ab26cecefb4d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d8f3d6-2e", "ovs_interfaceid": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:16:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Releasing lock "refresh_cache-24c00db3-2457-443d-b5ab-7e6ecaa57515" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:16:56 user nova-compute[73078]: DEBUG os_brick.utils [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:16:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:56 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[288ff482-ba21-4a0c-b180-13a6d73292ce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:57 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6cbb83-30f5-4c68-aceb-42b28b96de67]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:16:57 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee52d95-12c0-4147-857e-175d908c86dc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:57 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[780a2794-ebfa-423b-8585-873e59a6204e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:16:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:16:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:16:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:16:57 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:16:57 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7940d814-1843-450c-a63e-988166baf357]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:16:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:16:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:16:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:16:57 user nova-compute[73078]: DEBUG os_brick.utils [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:16:57 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:57 user nova-compute[73078]: DEBUG nova.network.neutron [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Successfully created port: dc245bed-0f7e-49a7-a6af-71072040d109 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:16:58 user nova-compute[73078]: WARNING nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] While synchronizing instance power states, found 11 instances in the database and 8 instances on the hypervisor.
Aug 14 18:16:58 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Triggering sync for uuid de80e188-9385-4613-8a6c-aa72b624ad55 {{(pid=73078) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Triggering sync for uuid 1f88cb97-4f22-439e-99f2-d7cb8d5aff36 {{(pid=73078) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Triggering sync for uuid 3c840309-9884-4c8a-a6ee-1acd44f32c4c {{(pid=73078) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Triggering sync for uuid 24c00db3-2457-443d-b5ab-7e6ecaa57515 {{(pid=73078) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Triggering sync for uuid 8d257202-d8ab-4161-9b67-045cf1e36772 {{(pid=73078) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Triggering sync for uuid 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30 {{(pid=73078) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Triggering sync for uuid 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47 {{(pid=73078) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Triggering sync for uuid 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c {{(pid=73078) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Triggering sync for uuid ea445c0c-e5a1-4e24-8008-2cd64a679f34 {{(pid=73078) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Triggering sync for uuid 7783c26e-ec61-4375-b191-0ce5caf766c7 {{(pid=73078) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Triggering sync for uuid 83aca621-7182-49a9-b4b3-8f22dd50f869 {{(pid=73078) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "de80e188-9385-4613-8a6c-aa72b624ad55" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "de80e188-9385-4613-8a6c-aa72b624ad55" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "1f88cb97-4f22-439e-99f2-d7cb8d5aff36" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "1f88cb97-4f22-439e-99f2-d7cb8d5aff36" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "24c00db3-2457-443d-b5ab-7e6ecaa57515" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:58 user nova-compute[73078]: INFO nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 14 18:16:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "8d257202-d8ab-4161-9b67-045cf1e36772" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "8d257202-d8ab-4161-9b67-045cf1e36772" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "10f9d4a9-ee3f-45bd-95e4-edd4819dcf30" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "10f9d4a9-ee3f-45bd-95e4-edd4819dcf30" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:58 user nova-compute[73078]: INFO nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] During sync_power_state the instance has a pending task (rebuild_block_device_mapping). Skip.
Aug 14 18:16:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "7783c26e-ec61-4375-b191-0ce5caf766c7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "7783c26e-ec61-4375-b191-0ce5caf766c7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "83aca621-7182-49a9-b4b3-8f22dd50f869" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "de80e188-9385-4613-8a6c-aa72b624ad55" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "8d257202-d8ab-4161-9b67-045cf1e36772" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "1f88cb97-4f22-439e-99f2-d7cb8d5aff36" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.130s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.124s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "10f9d4a9-ee3f-45bd-95e4-edd4819dcf30" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.132s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "7783c26e-ec61-4375-b191-0ce5caf766c7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.143s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG nova.network.neutron [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Successfully created port: 1ebbf2bd-0d73-4374-a69e-0f0c3e018c85 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:16:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:16:59 user nova-compute[73078]: DEBUG nova.network.neutron [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Successfully updated port: 9f1350b2-c0dd-4818-a941-22f37f92e610 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:16:59 user nova-compute[73078]: DEBUG nova.compute.manager [req-1bf94dc1-1633-4979-a5d4-29e0d8265d12 req-3c5c8a92-9756-44c8-bb2f-a231df0cf693 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-changed-9f1350b2-c0dd-4818-a941-22f37f92e610 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:16:59 user nova-compute[73078]: DEBUG nova.compute.manager [req-1bf94dc1-1633-4979-a5d4-29e0d8265d12 req-3c5c8a92-9756-44c8-bb2f-a231df0cf693 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Refreshing instance network info cache due to event network-changed-9f1350b2-c0dd-4818-a941-22f37f92e610. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:16:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1bf94dc1-1633-4979-a5d4-29e0d8265d12 req-3c5c8a92-9756-44c8-bb2f-a231df0cf693 service nova] Acquiring lock "refresh_cache-83aca621-7182-49a9-b4b3-8f22dd50f869" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:16:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1bf94dc1-1633-4979-a5d4-29e0d8265d12 req-3c5c8a92-9756-44c8-bb2f-a231df0cf693 service nova] Acquired lock "refresh_cache-83aca621-7182-49a9-b4b3-8f22dd50f869" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:16:59 user nova-compute[73078]: DEBUG nova.network.neutron [req-1bf94dc1-1633-4979-a5d4-29e0d8265d12 req-3c5c8a92-9756-44c8-bb2f-a231df0cf693 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Refreshing network info cache for port 9f1350b2-c0dd-4818-a941-22f37f92e610 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:16:59 user nova-compute[73078]: DEBUG nova.network.neutron [req-1bf94dc1-1633-4979-a5d4-29e0d8265d12 req-3c5c8a92-9756-44c8-bb2f-a231df0cf693 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:16:59 user nova-compute[73078]: DEBUG nova.network.neutron [req-1bf94dc1-1633-4979-a5d4-29e0d8265d12 req-3c5c8a92-9756-44c8-bb2f-a231df0cf693 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:16:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1bf94dc1-1633-4979-a5d4-29e0d8265d12 req-3c5c8a92-9756-44c8-bb2f-a231df0cf693 service nova] Releasing lock "refresh_cache-83aca621-7182-49a9-b4b3-8f22dd50f869" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:17:00 user nova-compute[73078]: DEBUG nova.network.neutron [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Successfully updated port: fd713ad0-5a38-4d0e-8f2c-2c388a9f6849 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:17:01 user nova-compute[73078]: DEBUG nova.network.neutron [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Successfully updated port: 62809f7b-d1f3-4cae-9685-107e5008c9eb {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:17:01 user nova-compute[73078]: DEBUG nova.compute.manager [req-9728d6df-432e-47a8-9a4b-2feef395047b req-ab93bc84-694a-4bd7-9fd9-133211f9c68c service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-changed-fd713ad0-5a38-4d0e-8f2c-2c388a9f6849 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:01 user nova-compute[73078]: DEBUG nova.compute.manager [req-9728d6df-432e-47a8-9a4b-2feef395047b req-ab93bc84-694a-4bd7-9fd9-133211f9c68c service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Refreshing instance network info cache due to event network-changed-fd713ad0-5a38-4d0e-8f2c-2c388a9f6849. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:17:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9728d6df-432e-47a8-9a4b-2feef395047b req-ab93bc84-694a-4bd7-9fd9-133211f9c68c service nova] Acquiring lock "refresh_cache-83aca621-7182-49a9-b4b3-8f22dd50f869" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:17:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9728d6df-432e-47a8-9a4b-2feef395047b req-ab93bc84-694a-4bd7-9fd9-133211f9c68c service nova] Acquired lock "refresh_cache-83aca621-7182-49a9-b4b3-8f22dd50f869" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:17:01 user nova-compute[73078]: DEBUG nova.network.neutron [req-9728d6df-432e-47a8-9a4b-2feef395047b req-ab93bc84-694a-4bd7-9fd9-133211f9c68c service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Refreshing network info cache for port fd713ad0-5a38-4d0e-8f2c-2c388a9f6849 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:17:01 user nova-compute[73078]: DEBUG nova.network.neutron [req-9728d6df-432e-47a8-9a4b-2feef395047b req-ab93bc84-694a-4bd7-9fd9-133211f9c68c service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:17:01 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:17:01 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Creating image(s)
Aug 14 18:17:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "/opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "/opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "/opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.193s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:01 user nova-compute[73078]: DEBUG nova.network.neutron [req-9728d6df-432e-47a8-9a4b-2feef395047b req-ab93bc84-694a-4bd7-9fd9-133211f9c68c service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:17:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9728d6df-432e-47a8-9a4b-2feef395047b req-ab93bc84-694a-4bd7-9fd9-133211f9c68c service nova] Releasing lock "refresh_cache-83aca621-7182-49a9-b4b3-8f22dd50f869" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:17:01 user nova-compute[73078]: DEBUG nova.compute.manager [req-9728d6df-432e-47a8-9a4b-2feef395047b req-ab93bc84-694a-4bd7-9fd9-133211f9c68c service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-changed-62809f7b-d1f3-4cae-9685-107e5008c9eb {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:01 user nova-compute[73078]: DEBUG nova.compute.manager [req-9728d6df-432e-47a8-9a4b-2feef395047b req-ab93bc84-694a-4bd7-9fd9-133211f9c68c service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Refreshing instance network info cache due to event network-changed-62809f7b-d1f3-4cae-9685-107e5008c9eb. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:17:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9728d6df-432e-47a8-9a4b-2feef395047b req-ab93bc84-694a-4bd7-9fd9-133211f9c68c service nova] Acquiring lock "refresh_cache-83aca621-7182-49a9-b4b3-8f22dd50f869" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:17:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9728d6df-432e-47a8-9a4b-2feef395047b req-ab93bc84-694a-4bd7-9fd9-133211f9c68c service nova] Acquired lock "refresh_cache-83aca621-7182-49a9-b4b3-8f22dd50f869" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:17:01 user nova-compute[73078]: DEBUG nova.network.neutron [req-9728d6df-432e-47a8-9a4b-2feef395047b req-ab93bc84-694a-4bd7-9fd9-133211f9c68c service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Refreshing network info cache for port 62809f7b-d1f3-4cae-9685-107e5008c9eb {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:17:01 user nova-compute[73078]: DEBUG nova.network.neutron [req-9728d6df-432e-47a8-9a4b-2feef395047b req-ab93bc84-694a-4bd7-9fd9-133211f9c68c service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:17:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.200s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk 1073741824" returned: 0 in 0.064s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.199s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Checking if we can resize image /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG nova.network.neutron [req-9728d6df-432e-47a8-9a4b-2feef395047b req-ab93bc84-694a-4bd7-9fd9-133211f9c68c service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG nova.network.neutron [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Successfully updated port: 1054bcf2-2aa6-4112-bd95-9d471c3f63cd {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9728d6df-432e-47a8-9a4b-2feef395047b req-ab93bc84-694a-4bd7-9fd9-133211f9c68c service nova] Releasing lock "refresh_cache-83aca621-7182-49a9-b4b3-8f22dd50f869" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Cannot resize image /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Ensure instance console log exists: /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Start _get_guest_xml network_info=[{"id": "c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a", "address": "fa:16:3e:59:9d:f2", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93a3c8e-9e", "ovs_interfaceid": "c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '671eb27c-8371-4e7d-8a18-f9c979cb722f', 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kscWnpYV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '72c1fcb2-7828-41b6-b9c7-bd12e7b35c47', 'attached_at': '', 'detached_at': '', 'volume_id': 'eb79e58d-10c0-41a7-89f3-80f6f42552ab', 'serial': 'eb79e58d-10c0-41a7-89f3-80f6f42552ab'}, 'volume_type': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:17:02 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 14 18:17:02 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 14 18:17:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG nova.objects.instance [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lazy-loading 'vcpu_model' on Instance uuid 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kscWnpYV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:17:02 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 18:17:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:17:02 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 18:17:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:17:02 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d9454d-b60e-4bda-81b1-87f0992cf536]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:17:02 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde2db13-c84c-4b28-999e-4abdfc7bee6d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab] added
Aug 14 18:17:02 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d69b108-2575-4bfe-9e61-a17e782c7d66]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b8d9ef-80d5-4e75-9fb7-7af227ad7dee]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kscWnpYV {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kscWnpYV" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[98aa7993-b2e5-4488-9909-8def876b392a]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kscWnpYV'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce48452a-f187-42c2-a314-87bd9ed50b14]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc21dbdf-b5cb-44aa-8352-ec59e3ffd57f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:17:02 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:17:02 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bc31e5-1497-44e9-9b36-bf2cde4f477d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab, portal: 172.16.0.220,3260]
Aug 14 18:17:02 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab, portal: 172.16.0.220,3260] successful.
Aug 14 18:17:02 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fd98c2-ce43-46a3-805d-31914cbbabd7]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0104fad-0fcd-4485-89fb-ea66acf7c29b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:17:02 user nova-compute[73078]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:17:02 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:17:02 user nova-compute[73078]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:17:02 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19c05de-8fd2-451b-9512-ad7ac928d998]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:17:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kscWnpYV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG nova.network.neutron [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Successfully updated port: 10e5877a-b0ba-449a-81db-1ecf3e760851 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG nova.compute.manager [req-803d1d2e-7a8a-425e-a251-4c08a7429b9d req-5e83e1a2-990a-42c3-a2e0-5d7cef8beee3 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-changed-1054bcf2-2aa6-4112-bd95-9d471c3f63cd {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG nova.compute.manager [req-803d1d2e-7a8a-425e-a251-4c08a7429b9d req-5e83e1a2-990a-42c3-a2e0-5d7cef8beee3 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Refreshing instance network info cache due to event network-changed-1054bcf2-2aa6-4112-bd95-9d471c3f63cd. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-803d1d2e-7a8a-425e-a251-4c08a7429b9d req-5e83e1a2-990a-42c3-a2e0-5d7cef8beee3 service nova] Acquiring lock "refresh_cache-83aca621-7182-49a9-b4b3-8f22dd50f869" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-803d1d2e-7a8a-425e-a251-4c08a7429b9d req-5e83e1a2-990a-42c3-a2e0-5d7cef8beee3 service nova] Acquired lock "refresh_cache-83aca621-7182-49a9-b4b3-8f22dd50f869" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG nova.network.neutron [req-803d1d2e-7a8a-425e-a251-4c08a7429b9d req-5e83e1a2-990a-42c3-a2e0-5d7cef8beee3 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Refreshing network info cache for port 1054bcf2-2aa6-4112-bd95-9d471c3f63cd {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG nova.network.neutron [req-803d1d2e-7a8a-425e-a251-4c08a7429b9d req-5e83e1a2-990a-42c3-a2e0-5d7cef8beee3 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:17:03 user nova-compute[73078]: INFO nova.virt.block_device [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Booting with volume 8454ec2f-377b-4ee8-8336-b663cb778b9a at /dev/vdb
Aug 14 18:17:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG os_brick.utils [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7573114d-e002-4d95-b3ed-82853cad3995]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ad3461-fbf1-4efb-949a-2c80d10d042c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[976a6cfd-4a0e-4544-a851-8ff9b2d942c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[14434b44-8509-49a0-a0b4-4ba79eebdcb4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26262383234363662', 'path': '/dev/sdb'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262383234363662', 'path': '/dev/sdb'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:17:03 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:17:03 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[65cb51c2-e383-468b-8b99-3b92950ca70d]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG os_brick.utils [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Updating existing volume attachment record: 6cb3849f-1535-41a0-8c6d-b7262c8d8257 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T18:14:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1747051739',display_name='tempest-ServerActionsTestOtherA-server-294631183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1747051739',id=15,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7MoxQfLpU8YABS9Pw20/hLN1B8HMClZxOewhbMQPCKdvwfAau43e4Qw7i1r0zeStVmZeOs2kcJHkp+76O4z0OTCmnK5xY5GG1VsFRZAQIs0+ge0mW06cadbyyO+FeOxg==',key_name='tempest-keypair-1384674648',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:14:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='993dd55f40454640824687ffb6a3c581',ramdisk_id='',reservation_id='r-yhnd265c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1876890021',owner_user_name='tempest-ServerActionsTestOtherA-1876890021-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:16:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cca1112ab354f9fb31658e18c0d03b1',uuid=72c1fcb2-7828-41b6-b9c7-bd12e7b35c47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a", "address": "fa:16:3e:59:9d:f2", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93a3c8e-9e", "ovs_interfaceid": "c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Converting VIF {"id": "c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a", "address": "fa:16:3e:59:9d:f2", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93a3c8e-9e", "ovs_interfaceid": "c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:9d:f2,bridge_name='br-int',has_traffic_filtering=True,id=c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a,network=Network(bfef9745-5a40-44b6-a6d5-2ef1e77fc5db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93a3c8e-9e') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:17:03 user nova-compute[73078]:   <uuid>72c1fcb2-7828-41b6-b9c7-bd12e7b35c47</uuid>
Aug 14 18:17:03 user nova-compute[73078]:   <name>instance-0000000f</name>
Aug 14 18:17:03 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:17:03 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:17:03 user nova-compute[73078]:   <metadata>
Aug 14 18:17:03 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:17:03 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:17:03 user nova-compute[73078]:       <nova:name>tempest-ServerActionsTestOtherA-server-294631183</nova:name>
Aug 14 18:17:03 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:17:02</nova:creationTime>
Aug 14 18:17:03 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:17:03 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:17:03 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:17:03 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:17:03 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:17:03 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:17:03 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:17:03 user nova-compute[73078]:       <nova:owner>
Aug 14 18:17:03 user nova-compute[73078]:         <nova:user uuid="0cca1112ab354f9fb31658e18c0d03b1">tempest-ServerActionsTestOtherA-1876890021-project-member</nova:user>
Aug 14 18:17:03 user nova-compute[73078]:         <nova:project uuid="993dd55f40454640824687ffb6a3c581">tempest-ServerActionsTestOtherA-1876890021</nova:project>
Aug 14 18:17:03 user nova-compute[73078]:       </nova:owner>
Aug 14 18:17:03 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:17:03 user nova-compute[73078]:       <nova:ports>
Aug 14 18:17:03 user nova-compute[73078]:         <nova:port uuid="c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a">
Aug 14 18:17:03 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 18:17:03 user nova-compute[73078]:         </nova:port>
Aug 14 18:17:03 user nova-compute[73078]:       </nova:ports>
Aug 14 18:17:03 user nova-compute[73078]:     </nova:instance>
Aug 14 18:17:03 user nova-compute[73078]:   </metadata>
Aug 14 18:17:03 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:17:03 user nova-compute[73078]:     <system>
Aug 14 18:17:03 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:17:03 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:17:03 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:17:03 user nova-compute[73078]:       <entry name="serial">72c1fcb2-7828-41b6-b9c7-bd12e7b35c47</entry>
Aug 14 18:17:03 user nova-compute[73078]:       <entry name="uuid">72c1fcb2-7828-41b6-b9c7-bd12e7b35c47</entry>
Aug 14 18:17:03 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:17:03 user nova-compute[73078]:     </system>
Aug 14 18:17:03 user nova-compute[73078]:   </sysinfo>
Aug 14 18:17:03 user nova-compute[73078]:   <os>
Aug 14 18:17:03 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:17:03 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:17:03 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:17:03 user nova-compute[73078]:   </os>
Aug 14 18:17:03 user nova-compute[73078]:   <features>
Aug 14 18:17:03 user nova-compute[73078]:     <acpi/>
Aug 14 18:17:03 user nova-compute[73078]:     <apic/>
Aug 14 18:17:03 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:17:03 user nova-compute[73078]:   </features>
Aug 14 18:17:03 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:17:03 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:17:03 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:17:03 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:17:03 user nova-compute[73078]:   </clock>
Aug 14 18:17:03 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:17:03 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:17:03 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:17:03 user nova-compute[73078]:   </cpu>
Aug 14 18:17:03 user nova-compute[73078]:   <devices>
Aug 14 18:17:03 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:17:03 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:17:03 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk"/>
Aug 14 18:17:03 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:17:03 user nova-compute[73078]:     </disk>
Aug 14 18:17:03 user nova-compute[73078]:     <disk type="block" device="disk">
Aug 14 18:17:03 user nova-compute[73078]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:17:03 user nova-compute[73078]:       <source dev="/dev/sdb"/>
Aug 14 18:17:03 user nova-compute[73078]:       <target dev="vdb" bus="virtio"/>
Aug 14 18:17:03 user nova-compute[73078]:       <serial>eb79e58d-10c0-41a7-89f3-80f6f42552ab</serial>
Aug 14 18:17:03 user nova-compute[73078]:     </disk>
Aug 14 18:17:03 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:17:03 user nova-compute[73078]:       <mac address="fa:16:3e:59:9d:f2"/>
Aug 14 18:17:03 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:17:03 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:17:03 user nova-compute[73078]:       <target dev="tapc93a3c8e-9e"/>
Aug 14 18:17:03 user nova-compute[73078]:     </interface>
Aug 14 18:17:03 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:17:03 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/console.log" append="off"/>
Aug 14 18:17:03 user nova-compute[73078]:     </serial>
Aug 14 18:17:03 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:17:03 user nova-compute[73078]:     <video>
Aug 14 18:17:03 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:17:03 user nova-compute[73078]:     </video>
Aug 14 18:17:03 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:17:03 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:17:03 user nova-compute[73078]:     </rng>
Aug 14 18:17:03 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:17:03 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:17:03 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:17:03 user nova-compute[73078]:     </memballoon>
Aug 14 18:17:03 user nova-compute[73078]:   </devices>
Aug 14 18:17:03 user nova-compute[73078]: </domain>
Aug 14 18:17:03 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T18:14:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1747051739',display_name='tempest-ServerActionsTestOtherA-server-294631183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1747051739',id=15,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7MoxQfLpU8YABS9Pw20/hLN1B8HMClZxOewhbMQPCKdvwfAau43e4Qw7i1r0zeStVmZeOs2kcJHkp+76O4z0OTCmnK5xY5GG1VsFRZAQIs0+ge0mW06cadbyyO+FeOxg==',key_name='tempest-keypair-1384674648',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:14:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='993dd55f40454640824687ffb6a3c581',ramdisk_id='',reservation_id='r-yhnd265c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1876890021',owner_user_name='tempest-ServerActionsTestOtherA-1876890021-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:16:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cca1112ab354f9fb31658e18c0d03b1',uuid=72c1fcb2-7828-41b6-b9c7-bd12e7b35c47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a", "address": "fa:16:3e:59:9d:f2", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93a3c8e-9e", "ovs_interfaceid": "c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Converting VIF {"id": "c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a", "address": "fa:16:3e:59:9d:f2", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93a3c8e-9e", "ovs_interfaceid": "c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:9d:f2,bridge_name='br-int',has_traffic_filtering=True,id=c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a,network=Network(bfef9745-5a40-44b6-a6d5-2ef1e77fc5db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93a3c8e-9e') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG os_vif [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:9d:f2,bridge_name='br-int',has_traffic_filtering=True,id=c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a,network=Network(bfef9745-5a40-44b6-a6d5-2ef1e77fc5db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93a3c8e-9e') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc93a3c8e-9e, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc93a3c8e-9e, col_values=(('external_ids', {'iface-id': 'c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:9d:f2', 'vm-uuid': '72c1fcb2-7828-41b6-b9c7-bd12e7b35c47'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:17:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:03 user nova-compute[73078]: INFO os_vif [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:9d:f2,bridge_name='br-int',has_traffic_filtering=True,id=c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a,network=Network(bfef9745-5a40-44b6-a6d5-2ef1e77fc5db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93a3c8e-9e')
Aug 14 18:17:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:17:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:17:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] No VIF found with MAC fa:16:3e:59:9d:f2, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:17:04 user nova-compute[73078]: DEBUG nova.network.neutron [req-803d1d2e-7a8a-425e-a251-4c08a7429b9d req-5e83e1a2-990a-42c3-a2e0-5d7cef8beee3 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:17:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-803d1d2e-7a8a-425e-a251-4c08a7429b9d req-5e83e1a2-990a-42c3-a2e0-5d7cef8beee3 service nova] Releasing lock "refresh_cache-83aca621-7182-49a9-b4b3-8f22dd50f869" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:17:04 user nova-compute[73078]: DEBUG nova.compute.manager [req-803d1d2e-7a8a-425e-a251-4c08a7429b9d req-5e83e1a2-990a-42c3-a2e0-5d7cef8beee3 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-changed-10e5877a-b0ba-449a-81db-1ecf3e760851 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:04 user nova-compute[73078]: DEBUG nova.compute.manager [req-803d1d2e-7a8a-425e-a251-4c08a7429b9d req-5e83e1a2-990a-42c3-a2e0-5d7cef8beee3 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Refreshing instance network info cache due to event network-changed-10e5877a-b0ba-449a-81db-1ecf3e760851. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:17:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-803d1d2e-7a8a-425e-a251-4c08a7429b9d req-5e83e1a2-990a-42c3-a2e0-5d7cef8beee3 service nova] Acquiring lock "refresh_cache-83aca621-7182-49a9-b4b3-8f22dd50f869" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:17:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-803d1d2e-7a8a-425e-a251-4c08a7429b9d req-5e83e1a2-990a-42c3-a2e0-5d7cef8beee3 service nova] Acquired lock "refresh_cache-83aca621-7182-49a9-b4b3-8f22dd50f869" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:17:04 user nova-compute[73078]: DEBUG nova.network.neutron [req-803d1d2e-7a8a-425e-a251-4c08a7429b9d req-5e83e1a2-990a-42c3-a2e0-5d7cef8beee3 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Refreshing network info cache for port 10e5877a-b0ba-449a-81db-1ecf3e760851 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:17:04 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692037009.4500895, 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:17:04 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] VM Stopped (Lifecycle Event)
Aug 14 18:17:04 user nova-compute[73078]: DEBUG nova.compute.manager [None req-b5bcb1dc-1f25-47ed-9e91-5172fefbaed3 None None] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:17:04 user nova-compute[73078]: DEBUG nova.network.neutron [req-803d1d2e-7a8a-425e-a251-4c08a7429b9d req-5e83e1a2-990a-42c3-a2e0-5d7cef8beee3 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:17:04 user nova-compute[73078]: DEBUG nova.network.neutron [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Successfully updated port: dc245bed-0f7e-49a7-a6af-71072040d109 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:17:05 user nova-compute[73078]: DEBUG nova.network.neutron [req-803d1d2e-7a8a-425e-a251-4c08a7429b9d req-5e83e1a2-990a-42c3-a2e0-5d7cef8beee3 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:17:05 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-803d1d2e-7a8a-425e-a251-4c08a7429b9d req-5e83e1a2-990a-42c3-a2e0-5d7cef8beee3 service nova] Releasing lock "refresh_cache-83aca621-7182-49a9-b4b3-8f22dd50f869" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:17:05 user nova-compute[73078]: DEBUG nova.compute.manager [req-bcdd6e9e-e5df-4b8e-ae30-d7d248aea11c req-0567cd4c-72e0-4762-a4ef-27ac88e5950e service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-changed-dc245bed-0f7e-49a7-a6af-71072040d109 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:05 user nova-compute[73078]: DEBUG nova.compute.manager [req-bcdd6e9e-e5df-4b8e-ae30-d7d248aea11c req-0567cd4c-72e0-4762-a4ef-27ac88e5950e service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Refreshing instance network info cache due to event network-changed-dc245bed-0f7e-49a7-a6af-71072040d109. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:17:05 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-bcdd6e9e-e5df-4b8e-ae30-d7d248aea11c req-0567cd4c-72e0-4762-a4ef-27ac88e5950e service nova] Acquiring lock "refresh_cache-83aca621-7182-49a9-b4b3-8f22dd50f869" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:17:05 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-bcdd6e9e-e5df-4b8e-ae30-d7d248aea11c req-0567cd4c-72e0-4762-a4ef-27ac88e5950e service nova] Acquired lock "refresh_cache-83aca621-7182-49a9-b4b3-8f22dd50f869" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:17:05 user nova-compute[73078]: DEBUG nova.network.neutron [req-bcdd6e9e-e5df-4b8e-ae30-d7d248aea11c req-0567cd4c-72e0-4762-a4ef-27ac88e5950e service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Refreshing network info cache for port dc245bed-0f7e-49a7-a6af-71072040d109 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:17:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:05 user nova-compute[73078]: DEBUG nova.network.neutron [req-bcdd6e9e-e5df-4b8e-ae30-d7d248aea11c req-0567cd4c-72e0-4762-a4ef-27ac88e5950e service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:17:06 user nova-compute[73078]: DEBUG nova.compute.manager [req-9364042f-df80-44b5-9529-45291ab78106 req-c0a98292-c281-48d9-a4ff-80df58543b9b service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Received event network-vif-plugged-c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9364042f-df80-44b5-9529-45291ab78106 req-c0a98292-c281-48d9-a4ff-80df58543b9b service nova] Acquiring lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9364042f-df80-44b5-9529-45291ab78106 req-c0a98292-c281-48d9-a4ff-80df58543b9b service nova] Lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9364042f-df80-44b5-9529-45291ab78106 req-c0a98292-c281-48d9-a4ff-80df58543b9b service nova] Lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:06 user nova-compute[73078]: DEBUG nova.compute.manager [req-9364042f-df80-44b5-9529-45291ab78106 req-c0a98292-c281-48d9-a4ff-80df58543b9b service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] No waiting events found dispatching network-vif-plugged-c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:17:06 user nova-compute[73078]: WARNING nova.compute.manager [req-9364042f-df80-44b5-9529-45291ab78106 req-c0a98292-c281-48d9-a4ff-80df58543b9b service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Received unexpected event network-vif-plugged-c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a for instance with vm_state active and task_state rebuild_spawning.
Aug 14 18:17:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:06 user nova-compute[73078]: DEBUG nova.network.neutron [req-bcdd6e9e-e5df-4b8e-ae30-d7d248aea11c req-0567cd4c-72e0-4762-a4ef-27ac88e5950e service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:17:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-bcdd6e9e-e5df-4b8e-ae30-d7d248aea11c req-0567cd4c-72e0-4762-a4ef-27ac88e5950e service nova] Releasing lock "refresh_cache-83aca621-7182-49a9-b4b3-8f22dd50f869" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:17:06 user nova-compute[73078]: DEBUG nova.network.neutron [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Successfully updated port: 1ebbf2bd-0d73-4374-a69e-0f0c3e018c85 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:17:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Acquiring lock "refresh_cache-83aca621-7182-49a9-b4b3-8f22dd50f869" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:17:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Acquired lock "refresh_cache-83aca621-7182-49a9-b4b3-8f22dd50f869" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:17:06 user nova-compute[73078]: DEBUG nova.network.neutron [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:17:06 user nova-compute[73078]: DEBUG nova.network.neutron [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Starting finish_revert_migration {{(pid=73078) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Start _get_guest_xml network_info=[{"id": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "address": "fa:16:3e:ce:cd:93", "network": {"id": "1ec1577a-2943-44e6-9fd6-9d8308fcf09f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-135315381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09794ca2aebc4f50a4ab26cecefb4d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d8f3d6-2e", "ovs_interfaceid": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '1bfb060a-4485-4179-b063-aac9a1100dbe', 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XefjBbVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '24c00db3-2457-443d-b5ab-7e6ecaa57515', 'attached_at': '2023-08-14T18:17:07.000000', 'detached_at': '', 'volume_id': 'cd880623-a7e9-4e11-9490-b18345719272', 'serial': 'cd880623-a7e9-4e11-9490-b18345719272'}, 'volume_type': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:17:07 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:17:07 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:17:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG nova.objects.instance [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lazy-loading 'vcpu_model' on Instance uuid 24c00db3-2457-443d-b5ab-7e6ecaa57515 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XefjBbVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:17:07 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:17:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:17:07 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:17:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:17:07 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:17:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cc0e13-1905-43af-9277-8ad67e8c0a25]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:17:07 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5253df-ba1f-441e-87b0-4dc0c1ac3e15]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272] added
Aug 14 18:17:07 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eecbfbe-1cf6-48db-be7b-f8881265b51e]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[554171f8-b985-47d5-92da-a9c95bd6a03b]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XefjBbVt {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XefjBbVt" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8444b1-bcf4-4be1-aff9-f9e2832f5b2d]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XefjBbVt'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[902e001d-dc5b-4622-bbb7-b2278a50a443]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c73d79-a094-434d-af57-00e4c1baf9f5]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:17:07 user nova-compute[73078]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:17:07 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:17:07 user nova-compute[73078]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:17:07 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG nova.compute.manager [req-de770fef-465e-4895-ab3c-10933133508d req-a38c2e8b-f304-43cb-b365-16978da54417 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-changed-1ebbf2bd-0d73-4374-a69e-0f0c3e018c85 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG nova.compute.manager [req-de770fef-465e-4895-ab3c-10933133508d req-a38c2e8b-f304-43cb-b365-16978da54417 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Refreshing instance network info cache due to event network-changed-1ebbf2bd-0d73-4374-a69e-0f0c3e018c85. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-de770fef-465e-4895-ab3c-10933133508d req-a38c2e8b-f304-43cb-b365-16978da54417 service nova] Acquiring lock "refresh_cache-83aca621-7182-49a9-b4b3-8f22dd50f869" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc59428-4675-4f37-ab74-b27adba3eceb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272, portal: 172.16.0.220,3260]
Aug 14 18:17:07 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272, portal: 172.16.0.220,3260] successful.
Aug 14 18:17:07 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e478710-d692-4168-82a4-4c00a78d67a0]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3533d6d5-f349-4a51-b434-0680646297a8]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:17:07 user nova-compute[73078]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:17:07 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:17:07 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:17:07 user nova-compute[73078]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:17:07 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:17:07 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[683620b1-3fe7-48f4-9b01-1c4d34e64b4d]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:17:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XefjBbVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037028.0453959, 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:17:08 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] VM Resumed (Lifecycle Event)
Aug 14 18:17:08 user nova-compute[73078]: DEBUG nova.compute.manager [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:17:08 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Instance spawned successfully.
Aug 14 18:17:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG nova.compute.manager [req-b8ee4b0e-0aae-4c06-a0c0-f63d8317199c req-c0587115-c72d-4aa3-aaa4-b41e224dc561 service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Received event network-vif-plugged-c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b8ee4b0e-0aae-4c06-a0c0-f63d8317199c req-c0587115-c72d-4aa3-aaa4-b41e224dc561 service nova] Acquiring lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b8ee4b0e-0aae-4c06-a0c0-f63d8317199c req-c0587115-c72d-4aa3-aaa4-b41e224dc561 service nova] Lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b8ee4b0e-0aae-4c06-a0c0-f63d8317199c req-c0587115-c72d-4aa3-aaa4-b41e224dc561 service nova] Lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG nova.compute.manager [req-b8ee4b0e-0aae-4c06-a0c0-f63d8317199c req-c0587115-c72d-4aa3-aaa4-b41e224dc561 service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] No waiting events found dispatching network-vif-plugged-c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:17:08 user nova-compute[73078]: WARNING nova.compute.manager [req-b8ee4b0e-0aae-4c06-a0c0-f63d8317199c req-c0587115-c72d-4aa3-aaa4-b41e224dc561 service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Received unexpected event network-vif-plugged-c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a for instance with vm_state active and task_state rebuild_spawning.
Aug 14 18:17:08 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:17:08 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 14 18:17:08 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037028.0468473, 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:17:08 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] VM Started (Lifecycle Event)
Aug 14 18:17:08 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG nova.compute.manager [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:17:08 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 14 18:17:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG nova.objects.instance [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73078) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9e15dd6c-c0fc-4edc-b61b-377f9463610e tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.086s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692037013.688529, 24c00db3-2457-443d-b5ab-7e6ecaa57515 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:17:08 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] VM Stopped (Lifecycle Event)
Aug 14 18:17:08 user nova-compute[73078]: DEBUG nova.compute.manager [None req-6520557b-bcce-4756-8118-701cd7432019 None None] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '26263623536306532', 'path': '/dev/sdc'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263623536306532', 'path': '/dev/sdc'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-800184995',display_name='tempest-ServerActionsTestOtherB-server-800184995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-800184995',id=5,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbnc7U7feBP7majde5yxGnuBaGos4MxLqvnB0BjKphlc0UqHWP3CzhimKim+Kv31+0a1u5JyxtEQSRk/yFbj17pMkgZ6K1nerehXIw6QXdILWEOhFCV63jMfH8QM13ghA==',key_name='tempest-keypair-2079056104',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:15:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='09794ca2aebc4f50a4ab26cecefb4d0c',ramdisk_id='',reservation_id='r-ikq8fsl0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-727924132',owner_user_name='tempest-ServerActionsTestOtherB-727924132-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:16:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ad487c5160a4dd8b9a03d468edf4bef',uuid=24c00db3-2457-443d-b5ab-7e6ecaa57515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "address": "fa:16:3e:ce:cd:93", "network": {"id": "1ec1577a-2943-44e6-9fd6-9d8308fcf09f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-135315381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09794ca2aebc4f50a4ab26cecefb4d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d8f3d6-2e", "ovs_interfaceid": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Converting VIF {"id": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "address": "fa:16:3e:ce:cd:93", "network": {"id": "1ec1577a-2943-44e6-9fd6-9d8308fcf09f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-135315381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09794ca2aebc4f50a4ab26cecefb4d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d8f3d6-2e", "ovs_interfaceid": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:cd:93,bridge_name='br-int',has_traffic_filtering=True,id=99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563,network=Network(1ec1577a-2943-44e6-9fd6-9d8308fcf09f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d8f3d6-2e') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:17:08 user nova-compute[73078]:   <uuid>24c00db3-2457-443d-b5ab-7e6ecaa57515</uuid>
Aug 14 18:17:08 user nova-compute[73078]:   <name>instance-00000005</name>
Aug 14 18:17:08 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:17:08 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:17:08 user nova-compute[73078]:   <metadata>
Aug 14 18:17:08 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:17:08 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:17:08 user nova-compute[73078]:       <nova:name>tempest-ServerActionsTestOtherB-server-800184995</nova:name>
Aug 14 18:17:08 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:17:07</nova:creationTime>
Aug 14 18:17:08 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:17:08 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:17:08 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:17:08 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:17:08 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:17:08 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:17:08 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:17:08 user nova-compute[73078]:       <nova:owner>
Aug 14 18:17:08 user nova-compute[73078]:         <nova:user uuid="0ad487c5160a4dd8b9a03d468edf4bef">tempest-ServerActionsTestOtherB-727924132-project-member</nova:user>
Aug 14 18:17:08 user nova-compute[73078]:         <nova:project uuid="09794ca2aebc4f50a4ab26cecefb4d0c">tempest-ServerActionsTestOtherB-727924132</nova:project>
Aug 14 18:17:08 user nova-compute[73078]:       </nova:owner>
Aug 14 18:17:08 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:17:08 user nova-compute[73078]:       <nova:ports>
Aug 14 18:17:08 user nova-compute[73078]:         <nova:port uuid="99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563">
Aug 14 18:17:08 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 14 18:17:08 user nova-compute[73078]:         </nova:port>
Aug 14 18:17:08 user nova-compute[73078]:       </nova:ports>
Aug 14 18:17:08 user nova-compute[73078]:     </nova:instance>
Aug 14 18:17:08 user nova-compute[73078]:   </metadata>
Aug 14 18:17:08 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:17:08 user nova-compute[73078]:     <system>
Aug 14 18:17:08 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:17:08 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:17:08 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:17:08 user nova-compute[73078]:       <entry name="serial">24c00db3-2457-443d-b5ab-7e6ecaa57515</entry>
Aug 14 18:17:08 user nova-compute[73078]:       <entry name="uuid">24c00db3-2457-443d-b5ab-7e6ecaa57515</entry>
Aug 14 18:17:08 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:17:08 user nova-compute[73078]:     </system>
Aug 14 18:17:08 user nova-compute[73078]:   </sysinfo>
Aug 14 18:17:08 user nova-compute[73078]:   <os>
Aug 14 18:17:08 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:17:08 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:17:08 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:17:08 user nova-compute[73078]:   </os>
Aug 14 18:17:08 user nova-compute[73078]:   <features>
Aug 14 18:17:08 user nova-compute[73078]:     <acpi/>
Aug 14 18:17:08 user nova-compute[73078]:     <apic/>
Aug 14 18:17:08 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:17:08 user nova-compute[73078]:   </features>
Aug 14 18:17:08 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:17:08 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:17:08 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:17:08 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:17:08 user nova-compute[73078]:   </clock>
Aug 14 18:17:08 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:17:08 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:17:08 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:17:08 user nova-compute[73078]:   </cpu>
Aug 14 18:17:08 user nova-compute[73078]:   <devices>
Aug 14 18:17:08 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:17:08 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:17:08 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk"/>
Aug 14 18:17:08 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:17:08 user nova-compute[73078]:     </disk>
Aug 14 18:17:08 user nova-compute[73078]:     <disk type="block" device="disk">
Aug 14 18:17:08 user nova-compute[73078]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:17:08 user nova-compute[73078]:       <source dev="/dev/sdc"/>
Aug 14 18:17:08 user nova-compute[73078]:       <target dev="vdb" bus="virtio"/>
Aug 14 18:17:08 user nova-compute[73078]:       <serial>cd880623-a7e9-4e11-9490-b18345719272</serial>
Aug 14 18:17:08 user nova-compute[73078]:     </disk>
Aug 14 18:17:08 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:17:08 user nova-compute[73078]:       <mac address="fa:16:3e:ce:cd:93"/>
Aug 14 18:17:08 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:17:08 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:17:08 user nova-compute[73078]:       <target dev="tap99d8f3d6-2e"/>
Aug 14 18:17:08 user nova-compute[73078]:     </interface>
Aug 14 18:17:08 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:17:08 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/console.log" append="off"/>
Aug 14 18:17:08 user nova-compute[73078]:     </serial>
Aug 14 18:17:08 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:17:08 user nova-compute[73078]:     <video>
Aug 14 18:17:08 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:17:08 user nova-compute[73078]:     </video>
Aug 14 18:17:08 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:17:08 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:17:08 user nova-compute[73078]:     </rng>
Aug 14 18:17:08 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:17:08 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:17:08 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:17:08 user nova-compute[73078]:     </memballoon>
Aug 14 18:17:08 user nova-compute[73078]:   </devices>
Aug 14 18:17:08 user nova-compute[73078]: </domain>
Aug 14 18:17:08 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-800184995',display_name='tempest-ServerActionsTestOtherB-server-800184995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-800184995',id=5,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbnc7U7feBP7majde5yxGnuBaGos4MxLqvnB0BjKphlc0UqHWP3CzhimKim+Kv31+0a1u5JyxtEQSRk/yFbj17pMkgZ6K1nerehXIw6QXdILWEOhFCV63jMfH8QM13ghA==',key_name='tempest-keypair-2079056104',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:15:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='09794ca2aebc4f50a4ab26cecefb4d0c',ramdisk_id='',reservation_id='r-ikq8fsl0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-727924132',owner_user_name='tempest-ServerActionsTestOtherB-727924132-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:16:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ad487c5160a4dd8b9a03d468edf4bef',uuid=24c00db3-2457-443d-b5ab-7e6ecaa57515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "address": "fa:16:3e:ce:cd:93", "network": {"id": "1ec1577a-2943-44e6-9fd6-9d8308fcf09f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-135315381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09794ca2aebc4f50a4ab26cecefb4d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d8f3d6-2e", "ovs_interfaceid": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Converting VIF {"id": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "address": "fa:16:3e:ce:cd:93", "network": {"id": "1ec1577a-2943-44e6-9fd6-9d8308fcf09f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-135315381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09794ca2aebc4f50a4ab26cecefb4d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d8f3d6-2e", "ovs_interfaceid": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:cd:93,bridge_name='br-int',has_traffic_filtering=True,id=99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563,network=Network(1ec1577a-2943-44e6-9fd6-9d8308fcf09f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d8f3d6-2e') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG os_vif [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:cd:93,bridge_name='br-int',has_traffic_filtering=True,id=99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563,network=Network(1ec1577a-2943-44e6-9fd6-9d8308fcf09f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d8f3d6-2e') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99d8f3d6-2e, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap99d8f3d6-2e, col_values=(('external_ids', {'iface-id': '99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:cd:93', 'vm-uuid': '24c00db3-2457-443d-b5ab-7e6ecaa57515'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:17:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:08 user nova-compute[73078]: INFO os_vif [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:cd:93,bridge_name='br-int',has_traffic_filtering=True,id=99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563,network=Network(1ec1577a-2943-44e6-9fd6-9d8308fcf09f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d8f3d6-2e')
Aug 14 18:17:09 user nova-compute[73078]: DEBUG nova.network.neutron [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Updating instance_info_cache with network_info: [{"id": "9f1350b2-c0dd-4818-a941-22f37f92e610", "address": "fa:16:3e:6a:9a:37", "network": {"id": "aefa1b37-86f6-4b56-a958-52e56c6af504", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-370961776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1350b2-c0", "ovs_interfaceid": "9f1350b2-c0dd-4818-a941-22f37f92e610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd713ad0-5a38-4d0e-8f2c-2c388a9f6849", "address": "fa:16:3e:f2:47:21", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd713ad0-5a", "ovs_interfaceid": "fd713ad0-5a38-4d0e-8f2c-2c388a9f6849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "62809f7b-d1f3-4cae-9685-107e5008c9eb", "address": "fa:16:3e:94:eb:d7", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62809f7b-d1", "ovs_interfaceid": "62809f7b-d1f3-4cae-9685-107e5008c9eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1054bcf2-2aa6-4112-bd95-9d471c3f63cd", "address": "fa:16:3e:79:2c:7b", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1054bcf2-2a", "ovs_interfaceid": "1054bcf2-2aa6-4112-bd95-9d471c3f63cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10e5877a-b0ba-449a-81db-1ecf3e760851", "address": "fa:16:3e:ec:f7:8e", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e5877a-b0", "ovs_interfaceid": "10e5877a-b0ba-449a-81db-1ecf3e760851", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc245bed-0f7e-49a7-a6af-71072040d109", "address": "fa:16:3e:f9:96:4c", "network": {"id": "5a386415-85db-4304-a0f0-65460a1f8308", "bridge": "br-int", "label": "tempest-device-tagging-net2-529646808", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc245bed-0f", "ovs_interfaceid": "dc245bed-0f7e-49a7-a6af-71072040d109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ebbf2bd-0d73-4374-a69e-0f0c3e018c85", "address": "fa:16:3e:ee:37:9e", "network": {"id": "5a386415-85db-4304-a0f0-65460a1f8308", "bridge": "br-int", "label": "tempest-device-tagging-net2-529646808", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ebbf2bd-0d", "ovs_interfaceid": "1ebbf2bd-0d73-4374-a69e-0f0c3e018c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:17:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Releasing lock "refresh_cache-83aca621-7182-49a9-b4b3-8f22dd50f869" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:17:09 user nova-compute[73078]: DEBUG nova.compute.manager [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Instance network_info: |[{"id": "9f1350b2-c0dd-4818-a941-22f37f92e610", "address": "fa:16:3e:6a:9a:37", "network": {"id": "aefa1b37-86f6-4b56-a958-52e56c6af504", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-370961776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1350b2-c0", "ovs_interfaceid": "9f1350b2-c0dd-4818-a941-22f37f92e610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd713ad0-5a38-4d0e-8f2c-2c388a9f6849", "address": "fa:16:3e:f2:47:21", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd713ad0-5a", "ovs_interfaceid": "fd713ad0-5a38-4d0e-8f2c-2c388a9f6849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "62809f7b-d1f3-4cae-9685-107e5008c9eb", "address": "fa:16:3e:94:eb:d7", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62809f7b-d1", "ovs_interfaceid": "62809f7b-d1f3-4cae-9685-107e5008c9eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1054bcf2-2aa6-4112-bd95-9d471c3f63cd", "address": "fa:16:3e:79:2c:7b", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1054bcf2-2a", "ovs_interfaceid": "1054bcf2-2aa6-4112-bd95-9d471c3f63cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10e5877a-b0ba-449a-81db-1ecf3e760851", "address": "fa:16:3e:ec:f7:8e", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e5877a-b0", "ovs_interfaceid": "10e5877a-b0ba-449a-81db-1ecf3e760851", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc245bed-0f7e-49a7-a6af-71072040d109", "address": "fa:16:3e:f9:96:4c", "network": {"id": "5a386415-85db-4304-a0f0-65460a1f8308", "bridge": "br-int", "label": "tempest-device-tagging-net2-529646808", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc245bed-0f", "ovs_interfaceid": "dc245bed-0f7e-49a7-a6af-71072040d109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ebbf2bd-0d73-4374-a69e-0f0c3e018c85", "address": "fa:16:3e:ee:37:9e", "network": {"id": "5a386415-85db-4304-a0f0-65460a1f8308", "bridge": "br-int", "label": "tempest-device-tagging-net2-529646808", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ebbf2bd-0d", "ovs_interfaceid": "1ebbf2bd-0d73-4374-a69e-0f0c3e018c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:17:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-de770fef-465e-4895-ab3c-10933133508d req-a38c2e8b-f304-43cb-b365-16978da54417 service nova] Acquired lock "refresh_cache-83aca621-7182-49a9-b4b3-8f22dd50f869" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:17:09 user nova-compute[73078]: DEBUG nova.network.neutron [req-de770fef-465e-4895-ab3c-10933133508d req-a38c2e8b-f304-43cb-b365-16978da54417 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Refreshing network info cache for port 1ebbf2bd-0d73-4374-a69e-0f0c3e018c85 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:17:09 user nova-compute[73078]: DEBUG nova.network.neutron [req-de770fef-465e-4895-ab3c-10933133508d req-a38c2e8b-f304-43cb-b365-16978da54417 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Updated VIF entry in instance network info cache for port 1ebbf2bd-0d73-4374-a69e-0f0c3e018c85. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:17:09 user nova-compute[73078]: DEBUG nova.network.neutron [req-de770fef-465e-4895-ab3c-10933133508d req-a38c2e8b-f304-43cb-b365-16978da54417 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Updating instance_info_cache with network_info: [{"id": "9f1350b2-c0dd-4818-a941-22f37f92e610", "address": "fa:16:3e:6a:9a:37", "network": {"id": "aefa1b37-86f6-4b56-a958-52e56c6af504", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-370961776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1350b2-c0", "ovs_interfaceid": "9f1350b2-c0dd-4818-a941-22f37f92e610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd713ad0-5a38-4d0e-8f2c-2c388a9f6849", "address": "fa:16:3e:f2:47:21", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd713ad0-5a", "ovs_interfaceid": "fd713ad0-5a38-4d0e-8f2c-2c388a9f6849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "62809f7b-d1f3-4cae-9685-107e5008c9eb", "address": "fa:16:3e:94:eb:d7", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62809f7b-d1", "ovs_interfaceid": "62809f7b-d1f3-4cae-9685-107e5008c9eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1054bcf2-2aa6-4112-bd95-9d471c3f63cd", "address": "fa:16:3e:79:2c:7b", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1054bcf2-2a", "ovs_interfaceid": "1054bcf2-2aa6-4112-bd95-9d471c3f63cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10e5877a-b0ba-449a-81db-1ecf3e760851", "address": "fa:16:3e:ec:f7:8e", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e5877a-b0", "ovs_interfaceid": "10e5877a-b0ba-449a-81db-1ecf3e760851", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc245bed-0f7e-49a7-a6af-71072040d109", "address": "fa:16:3e:f9:96:4c", "network": {"id": "5a386415-85db-4304-a0f0-65460a1f8308", "bridge": "br-int", "label": "tempest-device-tagging-net2-529646808", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc245bed-0f", "ovs_interfaceid": "dc245bed-0f7e-49a7-a6af-71072040d109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ebbf2bd-0d73-4374-a69e-0f0c3e018c85", "address": "fa:16:3e:ee:37:9e", "network": {"id": "5a386415-85db-4304-a0f0-65460a1f8308", "bridge": "br-int", "label": "tempest-device-tagging-net2-529646808", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ebbf2bd-0d", "ovs_interfaceid": "1ebbf2bd-0d73-4374-a69e-0f0c3e018c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:17:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-de770fef-465e-4895-ab3c-10933133508d req-a38c2e8b-f304-43cb-b365-16978da54417 service nova] Releasing lock "refresh_cache-83aca621-7182-49a9-b4b3-8f22dd50f869" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:17:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:10 user nova-compute[73078]: DEBUG nova.compute.manager [req-3f477c64-1b0c-47f6-8743-643e484a2210 req-c55d8c3b-6b43-46ba-b18f-60ae22e1ca57 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Received event network-vif-plugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3f477c64-1b0c-47f6-8743-643e484a2210 req-c55d8c3b-6b43-46ba-b18f-60ae22e1ca57 service nova] Acquiring lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3f477c64-1b0c-47f6-8743-643e484a2210 req-c55d8c3b-6b43-46ba-b18f-60ae22e1ca57 service nova] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3f477c64-1b0c-47f6-8743-643e484a2210 req-c55d8c3b-6b43-46ba-b18f-60ae22e1ca57 service nova] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:10 user nova-compute[73078]: DEBUG nova.compute.manager [req-3f477c64-1b0c-47f6-8743-643e484a2210 req-c55d8c3b-6b43-46ba-b18f-60ae22e1ca57 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] No waiting events found dispatching network-vif-plugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:17:10 user nova-compute[73078]: WARNING nova.compute.manager [req-3f477c64-1b0c-47f6-8743-643e484a2210 req-c55d8c3b-6b43-46ba-b18f-60ae22e1ca57 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Received unexpected event network-vif-plugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 for instance with vm_state resized and task_state resize_reverting.
Aug 14 18:17:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:12 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037032.665394, 24c00db3-2457-443d-b5ab-7e6ecaa57515 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:17:12 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] VM Resumed (Lifecycle Event)
Aug 14 18:17:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:17:12 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Instance running successfully.
Aug 14 18:17:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] finish_revert_migration finished successfully. {{(pid=73078) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 14 18:17:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:17:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:17:12 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 14 18:17:12 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037032.6731458, 24c00db3-2457-443d-b5ab-7e6ecaa57515 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:17:12 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] VM Started (Lifecycle Event)
Aug 14 18:17:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:17:12 user nova-compute[73078]: DEBUG nova.compute.manager [req-bee7198d-e211-4ee1-ad4a-f3bc9e4f5120 req-bcd60521-dc4d-40b2-8321-03470d02f50a service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Received event network-vif-plugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-bee7198d-e211-4ee1-ad4a-f3bc9e4f5120 req-bcd60521-dc4d-40b2-8321-03470d02f50a service nova] Acquiring lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-bee7198d-e211-4ee1-ad4a-f3bc9e4f5120 req-bcd60521-dc4d-40b2-8321-03470d02f50a service nova] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-bee7198d-e211-4ee1-ad4a-f3bc9e4f5120 req-bcd60521-dc4d-40b2-8321-03470d02f50a service nova] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:12 user nova-compute[73078]: DEBUG nova.compute.manager [req-bee7198d-e211-4ee1-ad4a-f3bc9e4f5120 req-bcd60521-dc4d-40b2-8321-03470d02f50a service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] No waiting events found dispatching network-vif-plugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:17:12 user nova-compute[73078]: WARNING nova.compute.manager [req-bee7198d-e211-4ee1-ad4a-f3bc9e4f5120 req-bcd60521-dc4d-40b2-8321-03470d02f50a service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Received unexpected event network-vif-plugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 for instance with vm_state resized and task_state resize_reverting.
Aug 14 18:17:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:17:12 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 14 18:17:12 user nova-compute[73078]: INFO nova.compute.manager [None req-c2270a53-30eb-481b-b123-685440701bd8 tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Updating instance to original state: 'active'
Aug 14 18:17:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:14 user nova-compute[73078]: INFO nova.virt.block_device [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Booting with volume 6b41a12c-4452-402b-a744-4d9d2f5f1147 at /dev/vdc
Aug 14 18:17:14 user nova-compute[73078]: DEBUG os_brick.utils [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:17:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:14 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc1e353-dad2-41fb-9cf0-4447e032eddf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:14 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7cad35-fd43-4d98-a906-1c3a9061e858]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:14 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a006f5-aa08-4809-8ce0-0d7c64398c10]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:14 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[469235f6-2b04-49b6-81a7-155d997a38ab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:17:14 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:17:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:17:14 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:17:14 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6261450-62e1-4fe7-8e57-741252be6073]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:14 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:17:14 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:17:14 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:17:14 user nova-compute[73078]: DEBUG os_brick.utils [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:17:14 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Updating existing volume attachment record: 3e2cc75a-7fce-4674-b9d9-0bd6f2706751 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:17:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:17:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:17:25 user nova-compute[73078]: DEBUG nova.compute.manager [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:17:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:17:25 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Creating image(s)
Aug 14 18:17:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Did not create local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 18:17:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Ensure instance console log exists: /opt/stack/data/nova/instances/83aca621-7182-49a9-b4b3-8f22dd50f869/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:17:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Start _get_guest_xml network_info=[{"id": "9f1350b2-c0dd-4818-a941-22f37f92e610", "address": "fa:16:3e:6a:9a:37", "network": {"id": "aefa1b37-86f6-4b56-a958-52e56c6af504", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-370961776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1350b2-c0", "ovs_interfaceid": "9f1350b2-c0dd-4818-a941-22f37f92e610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd713ad0-5a38-4d0e-8f2c-2c388a9f6849", "address": "fa:16:3e:f2:47:21", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd713ad0-5a", "ovs_interfaceid": "fd713ad0-5a38-4d0e-8f2c-2c388a9f6849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "62809f7b-d1f3-4cae-9685-107e5008c9eb", "address": "fa:16:3e:94:eb:d7", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62809f7b-d1", "ovs_interfaceid": "62809f7b-d1f3-4cae-9685-107e5008c9eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1054bcf2-2aa6-4112-bd95-9d471c3f63cd", "address": "fa:16:3e:79:2c:7b", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1054bcf2-2a", "ovs_interfaceid": "1054bcf2-2aa6-4112-bd95-9d471c3f63cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10e5877a-b0ba-449a-81db-1ecf3e760851", "address": "fa:16:3e:ec:f7:8e", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e5877a-b0", "ovs_interfaceid": "10e5877a-b0ba-449a-81db-1ecf3e760851", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc245bed-0f7e-49a7-a6af-71072040d109", "address": "fa:16:3e:f9:96:4c", "network": {"id": "5a386415-85db-4304-a0f0-65460a1f8308", "bridge": "br-int", "label": "tempest-device-tagging-net2-529646808", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc245bed-0f", "ovs_interfaceid": "dc245bed-0f7e-49a7-a6af-71072040d109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ebbf2bd-0d73-4374-a69e-0f0c3e018c85", "address": "fa:16:3e:ee:37:9e", "network": {"id": "5a386415-85db-4304-a0f0-65460a1f8308", "bridge": "br-int", "label": "tempest-device-tagging-net2-529646808", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ebbf2bd-0d", "ovs_interfaceid": "1ebbf2bd-0d73-4374-a69e-0f0c3e018c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'c85ee7f5-3364-4851-a2ee-1d8e73108304', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'srPiadgv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '83aca621-7182-49a9-b4b3-8f22dd50f869', 'attached_at': '', 'detached_at': '', 'volume_id': '1d451bb3-f3ac-4eee-ae2e-722f3db4887a', 'serial': '1d451bb3-f3ac-4eee-ae2e-722f3db4887a'}, 'volume_type': None}, {'mount_device': '/dev/vdb', 'attachment_id': '6cb3849f-1535-41a0-8c6d-b7262c8d8257', 'boot_index': 1, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'agyfqtiw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '83aca621-7182-49a9-b4b3-8f22dd50f869', 'attached_at': '', 'detached_at': '', 'volume_id': '8454ec2f-377b-4ee8-8336-b663cb778b9a', 'serial': '8454ec2f-377b-4ee8-8336-b663cb778b9a'}, 'volume_type': None}, {'mount_device': '/dev/vdc', 'attachment_id': '3e2cc75a-7fce-4674-b9d9-0bd6f2706751', 'boot_index': 2, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CnaYhpRj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '83aca621-7182-49a9-b4b3-8f22dd50f869', 'attached_at': '', 'detached_at': '', 'volume_id': '6b41a12c-4452-402b-a744-4d9d2f5f1147', 'serial': '6b41a12c-4452-402b-a744-4d9d2f5f1147'}, 'volume_type': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:17:26 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:17:26 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:17:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'srPiadgv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:17:26 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:17:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:17:26 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:17:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:17:26 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:17:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8dd1777-5047-4268-86ac-37be257f7d80]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:17:26 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a1afb3-1c91-471e-963d-875be423eeb0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a] added
Aug 14 18:17:26 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[952d7893-f95d-4229-8893-eb5080a5856c]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7942805f-2765-4db2-bc96-75fa1a3654cd]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v srPiadgv {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v srPiadgv" returned: 0 in 0.043s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[407b3020-884c-4519-957e-4d5fcd75a760]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'srPiadgv'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac12fa0-1c15-4d66-95a8-f5ef5212670e]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[245eec6f-e71f-409c-a949-4a76adc0bb49]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:17:26 user nova-compute[73078]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:17:26 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:17:26 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:17:26 user nova-compute[73078]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:17:26 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:17:26 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc14a62-976d-42d8-8114-309619879dda]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a, portal: 172.16.0.220,3260]
Aug 14 18:17:26 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a, portal: 172.16.0.220,3260] successful.
Aug 14 18:17:26 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.058s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[89914828-d007-43e1-b6f6-e7dcf9881522]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcabd2b5-83db-4d2a-946e-a94af6562a78]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:17:26 user nova-compute[73078]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:17:26 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:17:26 user nova-compute[73078]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)
Aug 14 18:17:26 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:17:26 user nova-compute[73078]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:17:26 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:17:26 user nova-compute[73078]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)
Aug 14 18:17:26 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.453s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] HCTL ('36', '-', '-', 0) found on session 20 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0544464b-618e-4c4c-a847-52dcd4c4174b]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:26 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: None {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'srPiadgv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.493s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] <== connect_volume: return (1495ms) {'type': 'block', 'scsi_wwn': '26530323632306563', 'path': '/dev/sde'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530323632306563', 'path': '/dev/sde'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'agyfqtiw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:17:27 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:17:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:17:27 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:17:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:17:27 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:17:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f90460-8665-46f4-b3f4-05f29f46b2f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:17:27 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5581be15-7326-4f09-9d7e-bc2993063f89]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a] added
Aug 14 18:17:27 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd86540b-a450-4b63-a107-42b82a07ca7c]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7c55ff-f599-430d-ac48-ab2705349f5e]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v agyfqtiw {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v agyfqtiw" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0b5840-e5bb-44bd-92ea-7b50fe982ceb]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'agyfqtiw'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1da5ca-fc28-407b-9ae2-d80dca57aa5e]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9948c2-be7e-4932-9c80-aa480a0088e9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:17:27 user nova-compute[73078]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:17:27 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:17:27 user nova-compute[73078]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)
Aug 14 18:17:27 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:17:27 user nova-compute[73078]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:17:27 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:17:27 user nova-compute[73078]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)
Aug 14 18:17:27 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[39dd7eeb-38f4-4a60-a1f0-187041f1437e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a, portal: 172.16.0.220,3260]
Aug 14 18:17:27 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a, portal: 172.16.0.220,3260] successful.
Aug 14 18:17:27 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ae5093-686f-4800-88a3-5b0837db0168]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebd973a-aa84-48ef-b2e3-8c5d7fce58de]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:17:27 user nova-compute[73078]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:17:27 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:17:27 user nova-compute[73078]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)
Aug 14 18:17:27 user nova-compute[73078]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)
Aug 14 18:17:27 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:17:27 user nova-compute[73078]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:17:27 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:17:27 user nova-compute[73078]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)
Aug 14 18:17:27 user nova-compute[73078]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)
Aug 14 18:17:27 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] HCTL ('37', '-', '-', 0) found on session 21 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f685305-1cc4-41da-8d5e-5d29e87b0b5f]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:27 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Searching for a device in session 21 and hctl ['37', '*', '*', 0] yield: None {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Searching for a device in session 21 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'agyfqtiw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23036363466636635', 'path': '/dev/sdf'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036363466636635', 'path': '/dev/sdf'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CnaYhpRj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:17:28 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:17:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:17:28 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:17:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:17:28 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:17:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c14d3f7-328e-4933-9df9-75603765561b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:17:28 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[605ea104-49d1-4475-a168-fa7d5c2867b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147] added
Aug 14 18:17:28 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca89bf2-b71d-4a1c-a8dc-2ac58699517b]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c80221a-25c0-43f5-80cd-0b3eab5235a1]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CnaYhpRj {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CnaYhpRj" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f35e9b-0a9e-48ab-9c31-2ff937e56fa7]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CnaYhpRj'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28c269b-86a0-4842-8342-1d1a321d8484]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3cc00e-0237-4b76-8312-7b775da68307]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:17:28 user nova-compute[73078]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:17:28 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:17:28 user nova-compute[73078]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)
Aug 14 18:17:28 user nova-compute[73078]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)
Aug 14 18:17:28 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:17:28 user nova-compute[73078]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:17:28 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:17:28 user nova-compute[73078]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)
Aug 14 18:17:28 user nova-compute[73078]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)
Aug 14 18:17:28 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ed60e897-8851-4dbd-b46d-2b192458e477 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "8d257202-d8ab-4161-9b67-045cf1e36772" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ed60e897-8851-4dbd-b46d-2b192458e477 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "8d257202-d8ab-4161-9b67-045cf1e36772" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ed60e897-8851-4dbd-b46d-2b192458e477 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "8d257202-d8ab-4161-9b67-045cf1e36772-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ed60e897-8851-4dbd-b46d-2b192458e477 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "8d257202-d8ab-4161-9b67-045cf1e36772-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ed60e897-8851-4dbd-b46d-2b192458e477 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "8d257202-d8ab-4161-9b67-045cf1e36772-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:29 user nova-compute[73078]: INFO nova.compute.manager [None req-ed60e897-8851-4dbd-b46d-2b192458e477 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Terminating instance
Aug 14 18:17:29 user nova-compute[73078]: DEBUG nova.compute.manager [None req-ed60e897-8851-4dbd-b46d-2b192458e477 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:17:29 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 -p 172.16.0.220:3260 --login" returned: 0 in 1.088s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:29 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d56e02-e7b1-4fb6-b49e-d57e35a115e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:29 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147, portal: 172.16.0.220,3260]
Aug 14 18:17:29 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147, portal: 172.16.0.220,3260] successful.
Aug 14 18:17:29 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:29 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:29 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:29 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f920396a-05fc-4294-840b-d9e46633b717]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:29 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:29 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:29 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:29 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2faa46ef-025f-4cd9-9133-ecb5eff7bf89]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:29 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:17:29 user nova-compute[73078]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:17:29 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:17:29 user nova-compute[73078]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)
Aug 14 18:17:29 user nova-compute[73078]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)
Aug 14 18:17:29 user nova-compute[73078]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)
Aug 14 18:17:29 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:17:29 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:17:29 user nova-compute[73078]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:17:29 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:17:29 user nova-compute[73078]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)
Aug 14 18:17:29 user nova-compute[73078]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)
Aug 14 18:17:29 user nova-compute[73078]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)
Aug 14 18:17:29 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:17:29 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.353s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:17:29 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:17:29 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] HCTL ('38', '-', '-', 0) found on session 22 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:17:29 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:17:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:29 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:29 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.027s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:29 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[96618c6b-044a-4131-b5c0-95e25e0a7960]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:29 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Searching for a device in session 22 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:17:29 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CnaYhpRj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:17:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:30 user nova-compute[73078]: DEBUG nova.compute.manager [req-8011827c-adeb-433e-bb93-bc2a5fa7190f req-622895ae-8cb0-40f3-b690-68355534865d service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Received event network-vif-unplugged-10688f4a-5919-4a48-9767-92e304a494be {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-8011827c-adeb-433e-bb93-bc2a5fa7190f req-622895ae-8cb0-40f3-b690-68355534865d service nova] Acquiring lock "8d257202-d8ab-4161-9b67-045cf1e36772-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-8011827c-adeb-433e-bb93-bc2a5fa7190f req-622895ae-8cb0-40f3-b690-68355534865d service nova] Lock "8d257202-d8ab-4161-9b67-045cf1e36772-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-8011827c-adeb-433e-bb93-bc2a5fa7190f req-622895ae-8cb0-40f3-b690-68355534865d service nova] Lock "8d257202-d8ab-4161-9b67-045cf1e36772-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:30 user nova-compute[73078]: DEBUG nova.compute.manager [req-8011827c-adeb-433e-bb93-bc2a5fa7190f req-622895ae-8cb0-40f3-b690-68355534865d service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] No waiting events found dispatching network-vif-unplugged-10688f4a-5919-4a48-9767-92e304a494be {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:17:30 user nova-compute[73078]: DEBUG nova.compute.manager [req-8011827c-adeb-433e-bb93-bc2a5fa7190f req-622895ae-8cb0-40f3-b690-68355534865d service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Received event network-vif-unplugged-10688f4a-5919-4a48-9767-92e304a494be for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:17:30 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Instance destroyed successfully.
Aug 14 18:17:30 user nova-compute[73078]: DEBUG nova.objects.instance [None req-ed60e897-8851-4dbd-b46d-2b192458e477 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lazy-loading 'resources' on Instance uuid 8d257202-d8ab-4161-9b67-045cf1e36772 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:17:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-ed60e897-8851-4dbd-b46d-2b192458e477 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T18:10:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-371462966',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-371462966',id=6,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAytc5c0yCOWi5RHK68JcsgGL6T5tQXRdaCO7qK9BUc6YvtuTuce/64y+OO5qRLfFUuylpXSvDyoEGmdGwwQQmepFt4h6dnqNjkgX3t+x5pkguE/gjsJr/ZWvvPydMGAmA==',key_name='tempest-keypair-1699997067',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:15:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f00de2496804d6eb570f93307f3f088',ramdisk_id='',reservation_id='r-m6qase30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1593185714',owner_user_name='tempest-AttachVolumeShelveTestJSON-1593185714-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:15:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b07aecccb704835b6b765325b1d18bf',uuid=8d257202-d8ab-4161-9b67-045cf1e36772,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10688f4a-5919-4a48-9767-92e304a494be", "address": "fa:16:3e:a4:3b:fc", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10688f4a-59", "ovs_interfaceid": "10688f4a-5919-4a48-9767-92e304a494be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:17:30 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-ed60e897-8851-4dbd-b46d-2b192458e477 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Converting VIF {"id": "10688f4a-5919-4a48-9767-92e304a494be", "address": "fa:16:3e:a4:3b:fc", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10688f4a-59", "ovs_interfaceid": "10688f4a-5919-4a48-9767-92e304a494be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:17:30 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-ed60e897-8851-4dbd-b46d-2b192458e477 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:3b:fc,bridge_name='br-int',has_traffic_filtering=True,id=10688f4a-5919-4a48-9767-92e304a494be,network=Network(a3adc062-ecf8-4c88-84ab-69425b236920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10688f4a-59') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:17:30 user nova-compute[73078]: DEBUG os_vif [None req-ed60e897-8851-4dbd-b46d-2b192458e477 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:3b:fc,bridge_name='br-int',has_traffic_filtering=True,id=10688f4a-5919-4a48-9767-92e304a494be,network=Network(a3adc062-ecf8-4c88-84ab-69425b236920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10688f4a-59') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:17:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10688f4a-59, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:17:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:17:30 user nova-compute[73078]: INFO os_vif [None req-ed60e897-8851-4dbd-b46d-2b192458e477 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:3b:fc,bridge_name='br-int',has_traffic_filtering=True,id=10688f4a-5919-4a48-9767-92e304a494be,network=Network(a3adc062-ecf8-4c88-84ab-69425b236920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10688f4a-59')
Aug 14 18:17:30 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-ed60e897-8851-4dbd-b46d-2b192458e477 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Deleting instance files /opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772_del
Aug 14 18:17:30 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-ed60e897-8851-4dbd-b46d-2b192458e477 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Deletion of /opt/stack/data/nova/instances/8d257202-d8ab-4161-9b67-045cf1e36772_del complete
Aug 14 18:17:30 user nova-compute[73078]: INFO nova.compute.manager [None req-ed60e897-8851-4dbd-b46d-2b192458e477 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 14 18:17:30 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-ed60e897-8851-4dbd-b46d-2b192458e477 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:17:30 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:17:30 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.400s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] <== connect_volume: return (2401ms) {'type': 'block', 'scsi_wwn': '23736333562313432', 'path': '/dev/sdg'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736333562313432', 'path': '/dev/sdg'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-443983221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-443983221',id=20,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHd9bG/5KkbQ9FbKOJ/d6gIa527ZUD7wURLK3IAXPNF94fE9wh+JxFHpVmaAMdvABr+vLMBrDq+zluqLpRUFR9/dqQ1SI0JVgXG+rXidtHm8tRYydztbckUOre9Kg1WkCw==',key_name='tempest-keypair-228573238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ed67729880341ffb35e2e668fd80e95',ramdisk_id='',reservation_id='r-q4nnps0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-95949371',owner_user_name='tempest-TaggedBootDevicesTest_v242-95949371-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:16:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aced5b7859ff428ba065909862c08da0',uuid=83aca621-7182-49a9-b4b3-8f22dd50f869,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f1350b2-c0dd-4818-a941-22f37f92e610", "address": "fa:16:3e:6a:9a:37", "network": {"id": "aefa1b37-86f6-4b56-a958-52e56c6af504", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-370961776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1350b2-c0", "ovs_interfaceid": "9f1350b2-c0dd-4818-a941-22f37f92e610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converting VIF {"id": "9f1350b2-c0dd-4818-a941-22f37f92e610", "address": "fa:16:3e:6a:9a:37", "network": {"id": "aefa1b37-86f6-4b56-a958-52e56c6af504", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-370961776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1350b2-c0", "ovs_interfaceid": "9f1350b2-c0dd-4818-a941-22f37f92e610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:9a:37,bridge_name='br-int',has_traffic_filtering=True,id=9f1350b2-c0dd-4818-a941-22f37f92e610,network=Network(aefa1b37-86f6-4b56-a958-52e56c6af504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f1350b2-c0') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-443983221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-443983221',id=20,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHd9bG/5KkbQ9FbKOJ/d6gIa527ZUD7wURLK3IAXPNF94fE9wh+JxFHpVmaAMdvABr+vLMBrDq+zluqLpRUFR9/dqQ1SI0JVgXG+rXidtHm8tRYydztbckUOre9Kg1WkCw==',key_name='tempest-keypair-228573238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ed67729880341ffb35e2e668fd80e95',ramdisk_id='',reservation_id='r-q4nnps0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-95949371',owner_user_name='tempest-TaggedBootDevicesTest_v242-95949371-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:16:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aced5b7859ff428ba065909862c08da0',uuid=83aca621-7182-49a9-b4b3-8f22dd50f869,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd713ad0-5a38-4d0e-8f2c-2c388a9f6849", "address": "fa:16:3e:f2:47:21", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd713ad0-5a", "ovs_interfaceid": "fd713ad0-5a38-4d0e-8f2c-2c388a9f6849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converting VIF {"id": "fd713ad0-5a38-4d0e-8f2c-2c388a9f6849", "address": "fa:16:3e:f2:47:21", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd713ad0-5a", "ovs_interfaceid": "fd713ad0-5a38-4d0e-8f2c-2c388a9f6849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:47:21,bridge_name='br-int',has_traffic_filtering=True,id=fd713ad0-5a38-4d0e-8f2c-2c388a9f6849,network=Network(7eb2af8e-a61c-4a54-9b96-5be2573c5e65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd713ad0-5a') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-443983221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-443983221',id=20,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHd9bG/5KkbQ9FbKOJ/d6gIa527ZUD7wURLK3IAXPNF94fE9wh+JxFHpVmaAMdvABr+vLMBrDq+zluqLpRUFR9/dqQ1SI0JVgXG+rXidtHm8tRYydztbckUOre9Kg1WkCw==',key_name='tempest-keypair-228573238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ed67729880341ffb35e2e668fd80e95',ramdisk_id='',reservation_id='r-q4nnps0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-95949371',owner_user_name='tempest-TaggedBootDevicesTest_v242-95949371-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:16:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aced5b7859ff428ba065909862c08da0',uuid=83aca621-7182-49a9-b4b3-8f22dd50f869,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62809f7b-d1f3-4cae-9685-107e5008c9eb", "address": "fa:16:3e:94:eb:d7", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62809f7b-d1", "ovs_interfaceid": "62809f7b-d1f3-4cae-9685-107e5008c9eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converting VIF {"id": "62809f7b-d1f3-4cae-9685-107e5008c9eb", "address": "fa:16:3e:94:eb:d7", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62809f7b-d1", "ovs_interfaceid": "62809f7b-d1f3-4cae-9685-107e5008c9eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:eb:d7,bridge_name='br-int',has_traffic_filtering=True,id=62809f7b-d1f3-4cae-9685-107e5008c9eb,network=Network(7eb2af8e-a61c-4a54-9b96-5be2573c5e65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap62809f7b-d1') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-443983221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-443983221',id=20,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHd9bG/5KkbQ9FbKOJ/d6gIa527ZUD7wURLK3IAXPNF94fE9wh+JxFHpVmaAMdvABr+vLMBrDq+zluqLpRUFR9/dqQ1SI0JVgXG+rXidtHm8tRYydztbckUOre9Kg1WkCw==',key_name='tempest-keypair-228573238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ed67729880341ffb35e2e668fd80e95',ramdisk_id='',reservation_id='r-q4nnps0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-95949371',owner_user_name='tempest-TaggedBootDevicesTest_v242-95949371-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:16:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aced5b7859ff428ba065909862c08da0',uuid=83aca621-7182-49a9-b4b3-8f22dd50f869,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1054bcf2-2aa6-4112-bd95-9d471c3f63cd", "address": "fa:16:3e:79:2c:7b", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1054bcf2-2a", "ovs_interfaceid": "1054bcf2-2aa6-4112-bd95-9d471c3f63cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converting VIF {"id": "1054bcf2-2aa6-4112-bd95-9d471c3f63cd", "address": "fa:16:3e:79:2c:7b", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1054bcf2-2a", "ovs_interfaceid": "1054bcf2-2aa6-4112-bd95-9d471c3f63cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:2c:7b,bridge_name='br-int',has_traffic_filtering=True,id=1054bcf2-2aa6-4112-bd95-9d471c3f63cd,network=Network(7eb2af8e-a61c-4a54-9b96-5be2573c5e65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1054bcf2-2a') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-443983221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-443983221',id=20,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHd9bG/5KkbQ9FbKOJ/d6gIa527ZUD7wURLK3IAXPNF94fE9wh+JxFHpVmaAMdvABr+vLMBrDq+zluqLpRUFR9/dqQ1SI0JVgXG+rXidtHm8tRYydztbckUOre9Kg1WkCw==',key_name='tempest-keypair-228573238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ed67729880341ffb35e2e668fd80e95',ramdisk_id='',reservation_id='r-q4nnps0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-95949371',owner_user_name='tempest-TaggedBootDevicesTest_v242-95949371-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:16:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aced5b7859ff428ba065909862c08da0',uuid=83aca621-7182-49a9-b4b3-8f22dd50f869,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10e5877a-b0ba-449a-81db-1ecf3e760851", "address": "fa:16:3e:ec:f7:8e", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e5877a-b0", "ovs_interfaceid": "10e5877a-b0ba-449a-81db-1ecf3e760851", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converting VIF {"id": "10e5877a-b0ba-449a-81db-1ecf3e760851", "address": "fa:16:3e:ec:f7:8e", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e5877a-b0", "ovs_interfaceid": "10e5877a-b0ba-449a-81db-1ecf3e760851", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:f7:8e,bridge_name='br-int',has_traffic_filtering=True,id=10e5877a-b0ba-449a-81db-1ecf3e760851,network=Network(7eb2af8e-a61c-4a54-9b96-5be2573c5e65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e5877a-b0') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-443983221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-443983221',id=20,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHd9bG/5KkbQ9FbKOJ/d6gIa527ZUD7wURLK3IAXPNF94fE9wh+JxFHpVmaAMdvABr+vLMBrDq+zluqLpRUFR9/dqQ1SI0JVgXG+rXidtHm8tRYydztbckUOre9Kg1WkCw==',key_name='tempest-keypair-228573238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ed67729880341ffb35e2e668fd80e95',ramdisk_id='',reservation_id='r-q4nnps0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-95949371',owner_user_name='tempest-TaggedBootDevicesTest_v242-95949371-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:16:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aced5b7859ff428ba065909862c08da0',uuid=83aca621-7182-49a9-b4b3-8f22dd50f869,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc245bed-0f7e-49a7-a6af-71072040d109", "address": "fa:16:3e:f9:96:4c", "network": {"id": "5a386415-85db-4304-a0f0-65460a1f8308", "bridge": "br-int", "label": "tempest-device-tagging-net2-529646808", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc245bed-0f", "ovs_interfaceid": "dc245bed-0f7e-49a7-a6af-71072040d109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converting VIF {"id": "dc245bed-0f7e-49a7-a6af-71072040d109", "address": "fa:16:3e:f9:96:4c", "network": {"id": "5a386415-85db-4304-a0f0-65460a1f8308", "bridge": "br-int", "label": "tempest-device-tagging-net2-529646808", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc245bed-0f", "ovs_interfaceid": "dc245bed-0f7e-49a7-a6af-71072040d109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:96:4c,bridge_name='br-int',has_traffic_filtering=True,id=dc245bed-0f7e-49a7-a6af-71072040d109,network=Network(5a386415-85db-4304-a0f0-65460a1f8308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc245bed-0f') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-443983221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-443983221',id=20,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHd9bG/5KkbQ9FbKOJ/d6gIa527ZUD7wURLK3IAXPNF94fE9wh+JxFHpVmaAMdvABr+vLMBrDq+zluqLpRUFR9/dqQ1SI0JVgXG+rXidtHm8tRYydztbckUOre9Kg1WkCw==',key_name='tempest-keypair-228573238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ed67729880341ffb35e2e668fd80e95',ramdisk_id='',reservation_id='r-q4nnps0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-95949371',owner_user_name='tempest-TaggedBootDevicesTest_v242-95949371-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:16:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aced5b7859ff428ba065909862c08da0',uuid=83aca621-7182-49a9-b4b3-8f22dd50f869,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ebbf2bd-0d73-4374-a69e-0f0c3e018c85", "address": "fa:16:3e:ee:37:9e", "network": {"id": "5a386415-85db-4304-a0f0-65460a1f8308", "bridge": "br-int", "label": "tempest-device-tagging-net2-529646808", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ebbf2bd-0d", "ovs_interfaceid": "1ebbf2bd-0d73-4374-a69e-0f0c3e018c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converting VIF {"id": "1ebbf2bd-0d73-4374-a69e-0f0c3e018c85", "address": "fa:16:3e:ee:37:9e", "network": {"id": "5a386415-85db-4304-a0f0-65460a1f8308", "bridge": "br-int", "label": "tempest-device-tagging-net2-529646808", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ebbf2bd-0d", "ovs_interfaceid": "1ebbf2bd-0d73-4374-a69e-0f0c3e018c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:37:9e,bridge_name='br-int',has_traffic_filtering=True,id=1ebbf2bd-0d73-4374-a69e-0f0c3e018c85,network=Network(5a386415-85db-4304-a0f0-65460a1f8308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ebbf2bd-0d') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.objects.instance [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Lazy-loading 'pci_devices' on Instance uuid 83aca621-7182-49a9-b4b3-8f22dd50f869 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:17:31 user nova-compute[73078]:   <uuid>83aca621-7182-49a9-b4b3-8f22dd50f869</uuid>
Aug 14 18:17:31 user nova-compute[73078]:   <name>instance-00000014</name>
Aug 14 18:17:31 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:17:31 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:17:31 user nova-compute[73078]:   <metadata>
Aug 14 18:17:31 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:17:31 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:17:31 user nova-compute[73078]:       <nova:name>tempest-device-tagging-server-443983221</nova:name>
Aug 14 18:17:31 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:17:25</nova:creationTime>
Aug 14 18:17:31 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:17:31 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:17:31 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:17:31 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:17:31 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:17:31 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:17:31 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:17:31 user nova-compute[73078]:       <nova:owner>
Aug 14 18:17:31 user nova-compute[73078]:         <nova:user uuid="aced5b7859ff428ba065909862c08da0">tempest-TaggedBootDevicesTest_v242-95949371-project-member</nova:user>
Aug 14 18:17:31 user nova-compute[73078]:         <nova:project uuid="7ed67729880341ffb35e2e668fd80e95">tempest-TaggedBootDevicesTest_v242-95949371</nova:project>
Aug 14 18:17:31 user nova-compute[73078]:       </nova:owner>
Aug 14 18:17:31 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:17:31 user nova-compute[73078]:       <nova:ports>
Aug 14 18:17:31 user nova-compute[73078]:         <nova:port uuid="9f1350b2-c0dd-4818-a941-22f37f92e610">
Aug 14 18:17:31 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 18:17:31 user nova-compute[73078]:         </nova:port>
Aug 14 18:17:31 user nova-compute[73078]:         <nova:port uuid="fd713ad0-5a38-4d0e-8f2c-2c388a9f6849">
Aug 14 18:17:31 user nova-compute[73078]:           <nova:ip type="fixed" address="10.1.1.10" ipVersion="4"/>
Aug 14 18:17:31 user nova-compute[73078]:         </nova:port>
Aug 14 18:17:31 user nova-compute[73078]:         <nova:port uuid="62809f7b-d1f3-4cae-9685-107e5008c9eb">
Aug 14 18:17:31 user nova-compute[73078]:           <nova:ip type="fixed" address="10.1.1.53" ipVersion="4"/>
Aug 14 18:17:31 user nova-compute[73078]:         </nova:port>
Aug 14 18:17:31 user nova-compute[73078]:         <nova:port uuid="1054bcf2-2aa6-4112-bd95-9d471c3f63cd">
Aug 14 18:17:31 user nova-compute[73078]:           <nova:ip type="fixed" address="10.1.1.82" ipVersion="4"/>
Aug 14 18:17:31 user nova-compute[73078]:         </nova:port>
Aug 14 18:17:31 user nova-compute[73078]:         <nova:port uuid="10e5877a-b0ba-449a-81db-1ecf3e760851">
Aug 14 18:17:31 user nova-compute[73078]:           <nova:ip type="fixed" address="10.1.1.239" ipVersion="4"/>
Aug 14 18:17:31 user nova-compute[73078]:         </nova:port>
Aug 14 18:17:31 user nova-compute[73078]:         <nova:port uuid="dc245bed-0f7e-49a7-a6af-71072040d109">
Aug 14 18:17:31 user nova-compute[73078]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 14 18:17:31 user nova-compute[73078]:         </nova:port>
Aug 14 18:17:31 user nova-compute[73078]:         <nova:port uuid="1ebbf2bd-0d73-4374-a69e-0f0c3e018c85">
Aug 14 18:17:31 user nova-compute[73078]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 14 18:17:31 user nova-compute[73078]:         </nova:port>
Aug 14 18:17:31 user nova-compute[73078]:       </nova:ports>
Aug 14 18:17:31 user nova-compute[73078]:     </nova:instance>
Aug 14 18:17:31 user nova-compute[73078]:   </metadata>
Aug 14 18:17:31 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:17:31 user nova-compute[73078]:     <system>
Aug 14 18:17:31 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:17:31 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:17:31 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:17:31 user nova-compute[73078]:       <entry name="serial">83aca621-7182-49a9-b4b3-8f22dd50f869</entry>
Aug 14 18:17:31 user nova-compute[73078]:       <entry name="uuid">83aca621-7182-49a9-b4b3-8f22dd50f869</entry>
Aug 14 18:17:31 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:17:31 user nova-compute[73078]:     </system>
Aug 14 18:17:31 user nova-compute[73078]:   </sysinfo>
Aug 14 18:17:31 user nova-compute[73078]:   <os>
Aug 14 18:17:31 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:17:31 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:17:31 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:17:31 user nova-compute[73078]:   </os>
Aug 14 18:17:31 user nova-compute[73078]:   <features>
Aug 14 18:17:31 user nova-compute[73078]:     <acpi/>
Aug 14 18:17:31 user nova-compute[73078]:     <apic/>
Aug 14 18:17:31 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:17:31 user nova-compute[73078]:   </features>
Aug 14 18:17:31 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:17:31 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:17:31 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:17:31 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:17:31 user nova-compute[73078]:   </clock>
Aug 14 18:17:31 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:17:31 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:17:31 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:17:31 user nova-compute[73078]:   </cpu>
Aug 14 18:17:31 user nova-compute[73078]:   <devices>
Aug 14 18:17:31 user nova-compute[73078]:     <disk type="file" device="cdrom">
Aug 14 18:17:31 user nova-compute[73078]:       <driver name="qemu" type="raw" cache="none"/>
Aug 14 18:17:31 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/83aca621-7182-49a9-b4b3-8f22dd50f869/disk.config"/>
Aug 14 18:17:31 user nova-compute[73078]:       <target dev="hda" bus="ide"/>
Aug 14 18:17:31 user nova-compute[73078]:     </disk>
Aug 14 18:17:31 user nova-compute[73078]:     <disk type="block" device="disk">
Aug 14 18:17:31 user nova-compute[73078]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:17:31 user nova-compute[73078]:       <source dev="/dev/sde"/>
Aug 14 18:17:31 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:17:31 user nova-compute[73078]:       <serial>1d451bb3-f3ac-4eee-ae2e-722f3db4887a</serial>
Aug 14 18:17:31 user nova-compute[73078]:     </disk>
Aug 14 18:17:31 user nova-compute[73078]:     <disk type="block" device="disk">
Aug 14 18:17:31 user nova-compute[73078]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:17:31 user nova-compute[73078]:       <source dev="/dev/sdf"/>
Aug 14 18:17:31 user nova-compute[73078]:       <target dev="vdb" bus="virtio"/>
Aug 14 18:17:31 user nova-compute[73078]:       <serial>8454ec2f-377b-4ee8-8336-b663cb778b9a</serial>
Aug 14 18:17:31 user nova-compute[73078]:     </disk>
Aug 14 18:17:31 user nova-compute[73078]:     <disk type="block" device="disk">
Aug 14 18:17:31 user nova-compute[73078]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:17:31 user nova-compute[73078]:       <source dev="/dev/sdg"/>
Aug 14 18:17:31 user nova-compute[73078]:       <target dev="vdc" bus="virtio"/>
Aug 14 18:17:31 user nova-compute[73078]:       <serial>6b41a12c-4452-402b-a744-4d9d2f5f1147</serial>
Aug 14 18:17:31 user nova-compute[73078]:     </disk>
Aug 14 18:17:31 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:17:31 user nova-compute[73078]:       <mac address="fa:16:3e:6a:9a:37"/>
Aug 14 18:17:31 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:17:31 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:17:31 user nova-compute[73078]:       <target dev="tap9f1350b2-c0"/>
Aug 14 18:17:31 user nova-compute[73078]:     </interface>
Aug 14 18:17:31 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:17:31 user nova-compute[73078]:       <mac address="fa:16:3e:f2:47:21"/>
Aug 14 18:17:31 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:17:31 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:17:31 user nova-compute[73078]:       <target dev="tapfd713ad0-5a"/>
Aug 14 18:17:31 user nova-compute[73078]:     </interface>
Aug 14 18:17:31 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:17:31 user nova-compute[73078]:       <mac address="fa:16:3e:94:eb:d7"/>
Aug 14 18:17:31 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:17:31 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:17:31 user nova-compute[73078]:       <target dev="tap62809f7b-d1"/>
Aug 14 18:17:31 user nova-compute[73078]:     </interface>
Aug 14 18:17:31 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:17:31 user nova-compute[73078]:       <mac address="fa:16:3e:79:2c:7b"/>
Aug 14 18:17:31 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:17:31 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:17:31 user nova-compute[73078]:       <target dev="tap1054bcf2-2a"/>
Aug 14 18:17:31 user nova-compute[73078]:     </interface>
Aug 14 18:17:31 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:17:31 user nova-compute[73078]:       <mac address="fa:16:3e:ec:f7:8e"/>
Aug 14 18:17:31 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:17:31 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:17:31 user nova-compute[73078]:       <target dev="tap10e5877a-b0"/>
Aug 14 18:17:31 user nova-compute[73078]:     </interface>
Aug 14 18:17:31 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:17:31 user nova-compute[73078]:       <mac address="fa:16:3e:f9:96:4c"/>
Aug 14 18:17:31 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:17:31 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:17:31 user nova-compute[73078]:       <target dev="tapdc245bed-0f"/>
Aug 14 18:17:31 user nova-compute[73078]:     </interface>
Aug 14 18:17:31 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:17:31 user nova-compute[73078]:       <mac address="fa:16:3e:ee:37:9e"/>
Aug 14 18:17:31 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:17:31 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:17:31 user nova-compute[73078]:       <target dev="tap1ebbf2bd-0d"/>
Aug 14 18:17:31 user nova-compute[73078]:     </interface>
Aug 14 18:17:31 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:17:31 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/83aca621-7182-49a9-b4b3-8f22dd50f869/console.log" append="off"/>
Aug 14 18:17:31 user nova-compute[73078]:     </serial>
Aug 14 18:17:31 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:17:31 user nova-compute[73078]:     <video>
Aug 14 18:17:31 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:17:31 user nova-compute[73078]:     </video>
Aug 14 18:17:31 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:17:31 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:17:31 user nova-compute[73078]:     </rng>
Aug 14 18:17:31 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:17:31 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:17:31 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:17:31 user nova-compute[73078]:     </memballoon>
Aug 14 18:17:31 user nova-compute[73078]:   </devices>
Aug 14 18:17:31 user nova-compute[73078]: </domain>
Aug 14 18:17:31 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-443983221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-443983221',id=20,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHd9bG/5KkbQ9FbKOJ/d6gIa527ZUD7wURLK3IAXPNF94fE9wh+JxFHpVmaAMdvABr+vLMBrDq+zluqLpRUFR9/dqQ1SI0JVgXG+rXidtHm8tRYydztbckUOre9Kg1WkCw==',key_name='tempest-keypair-228573238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ed67729880341ffb35e2e668fd80e95',ramdisk_id='',reservation_id='r-q4nnps0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-95949371',owner_user_name='tempest-TaggedBootDevicesTest_v242-95949371-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:16:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aced5b7859ff428ba065909862c08da0',uuid=83aca621-7182-49a9-b4b3-8f22dd50f869,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f1350b2-c0dd-4818-a941-22f37f92e610", "address": "fa:16:3e:6a:9a:37", "network": {"id": "aefa1b37-86f6-4b56-a958-52e56c6af504", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-370961776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1350b2-c0", "ovs_interfaceid": "9f1350b2-c0dd-4818-a941-22f37f92e610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converting VIF {"id": "9f1350b2-c0dd-4818-a941-22f37f92e610", "address": "fa:16:3e:6a:9a:37", "network": {"id": "aefa1b37-86f6-4b56-a958-52e56c6af504", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-370961776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1350b2-c0", "ovs_interfaceid": "9f1350b2-c0dd-4818-a941-22f37f92e610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:9a:37,bridge_name='br-int',has_traffic_filtering=True,id=9f1350b2-c0dd-4818-a941-22f37f92e610,network=Network(aefa1b37-86f6-4b56-a958-52e56c6af504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f1350b2-c0') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG os_vif [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:9a:37,bridge_name='br-int',has_traffic_filtering=True,id=9f1350b2-c0dd-4818-a941-22f37f92e610,network=Network(aefa1b37-86f6-4b56-a958-52e56c6af504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f1350b2-c0') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f1350b2-c0, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9f1350b2-c0, col_values=(('external_ids', {'iface-id': '9f1350b2-c0dd-4818-a941-22f37f92e610', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:9a:37', 'vm-uuid': '83aca621-7182-49a9-b4b3-8f22dd50f869'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:31 user nova-compute[73078]: INFO os_vif [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:9a:37,bridge_name='br-int',has_traffic_filtering=True,id=9f1350b2-c0dd-4818-a941-22f37f92e610,network=Network(aefa1b37-86f6-4b56-a958-52e56c6af504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f1350b2-c0')
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-443983221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-443983221',id=20,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHd9bG/5KkbQ9FbKOJ/d6gIa527ZUD7wURLK3IAXPNF94fE9wh+JxFHpVmaAMdvABr+vLMBrDq+zluqLpRUFR9/dqQ1SI0JVgXG+rXidtHm8tRYydztbckUOre9Kg1WkCw==',key_name='tempest-keypair-228573238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ed67729880341ffb35e2e668fd80e95',ramdisk_id='',reservation_id='r-q4nnps0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-95949371',owner_user_name='tempest-TaggedBootDevicesTest_v242-95949371-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:16:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aced5b7859ff428ba065909862c08da0',uuid=83aca621-7182-49a9-b4b3-8f22dd50f869,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd713ad0-5a38-4d0e-8f2c-2c388a9f6849", "address": "fa:16:3e:f2:47:21", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd713ad0-5a", "ovs_interfaceid": "fd713ad0-5a38-4d0e-8f2c-2c388a9f6849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converting VIF {"id": "fd713ad0-5a38-4d0e-8f2c-2c388a9f6849", "address": "fa:16:3e:f2:47:21", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd713ad0-5a", "ovs_interfaceid": "fd713ad0-5a38-4d0e-8f2c-2c388a9f6849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:47:21,bridge_name='br-int',has_traffic_filtering=True,id=fd713ad0-5a38-4d0e-8f2c-2c388a9f6849,network=Network(7eb2af8e-a61c-4a54-9b96-5be2573c5e65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd713ad0-5a') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG os_vif [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:47:21,bridge_name='br-int',has_traffic_filtering=True,id=fd713ad0-5a38-4d0e-8f2c-2c388a9f6849,network=Network(7eb2af8e-a61c-4a54-9b96-5be2573c5e65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd713ad0-5a') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd713ad0-5a, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfd713ad0-5a, col_values=(('external_ids', {'iface-id': 'fd713ad0-5a38-4d0e-8f2c-2c388a9f6849', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:47:21', 'vm-uuid': '83aca621-7182-49a9-b4b3-8f22dd50f869'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:31 user nova-compute[73078]: INFO os_vif [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:47:21,bridge_name='br-int',has_traffic_filtering=True,id=fd713ad0-5a38-4d0e-8f2c-2c388a9f6849,network=Network(7eb2af8e-a61c-4a54-9b96-5be2573c5e65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd713ad0-5a')
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-443983221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-443983221',id=20,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHd9bG/5KkbQ9FbKOJ/d6gIa527ZUD7wURLK3IAXPNF94fE9wh+JxFHpVmaAMdvABr+vLMBrDq+zluqLpRUFR9/dqQ1SI0JVgXG+rXidtHm8tRYydztbckUOre9Kg1WkCw==',key_name='tempest-keypair-228573238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ed67729880341ffb35e2e668fd80e95',ramdisk_id='',reservation_id='r-q4nnps0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-95949371',owner_user_name='tempest-TaggedBootDevicesTest_v242-95949371-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:16:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aced5b7859ff428ba065909862c08da0',uuid=83aca621-7182-49a9-b4b3-8f22dd50f869,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62809f7b-d1f3-4cae-9685-107e5008c9eb", "address": "fa:16:3e:94:eb:d7", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62809f7b-d1", "ovs_interfaceid": "62809f7b-d1f3-4cae-9685-107e5008c9eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converting VIF {"id": "62809f7b-d1f3-4cae-9685-107e5008c9eb", "address": "fa:16:3e:94:eb:d7", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62809f7b-d1", "ovs_interfaceid": "62809f7b-d1f3-4cae-9685-107e5008c9eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:eb:d7,bridge_name='br-int',has_traffic_filtering=True,id=62809f7b-d1f3-4cae-9685-107e5008c9eb,network=Network(7eb2af8e-a61c-4a54-9b96-5be2573c5e65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap62809f7b-d1') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG os_vif [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:eb:d7,bridge_name='br-int',has_traffic_filtering=True,id=62809f7b-d1f3-4cae-9685-107e5008c9eb,network=Network(7eb2af8e-a61c-4a54-9b96-5be2573c5e65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap62809f7b-d1') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62809f7b-d1, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap62809f7b-d1, col_values=(('external_ids', {'iface-id': '62809f7b-d1f3-4cae-9685-107e5008c9eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:eb:d7', 'vm-uuid': '83aca621-7182-49a9-b4b3-8f22dd50f869'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:31 user nova-compute[73078]: INFO os_vif [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:eb:d7,bridge_name='br-int',has_traffic_filtering=True,id=62809f7b-d1f3-4cae-9685-107e5008c9eb,network=Network(7eb2af8e-a61c-4a54-9b96-5be2573c5e65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap62809f7b-d1')
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-443983221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-443983221',id=20,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHd9bG/5KkbQ9FbKOJ/d6gIa527ZUD7wURLK3IAXPNF94fE9wh+JxFHpVmaAMdvABr+vLMBrDq+zluqLpRUFR9/dqQ1SI0JVgXG+rXidtHm8tRYydztbckUOre9Kg1WkCw==',key_name='tempest-keypair-228573238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ed67729880341ffb35e2e668fd80e95',ramdisk_id='',reservation_id='r-q4nnps0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-95949371',owner_user_name='tempest-TaggedBootDevicesTest_v242-95949371-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:16:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aced5b7859ff428ba065909862c08da0',uuid=83aca621-7182-49a9-b4b3-8f22dd50f869,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1054bcf2-2aa6-4112-bd95-9d471c3f63cd", "address": "fa:16:3e:79:2c:7b", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1054bcf2-2a", "ovs_interfaceid": "1054bcf2-2aa6-4112-bd95-9d471c3f63cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converting VIF {"id": "1054bcf2-2aa6-4112-bd95-9d471c3f63cd", "address": "fa:16:3e:79:2c:7b", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1054bcf2-2a", "ovs_interfaceid": "1054bcf2-2aa6-4112-bd95-9d471c3f63cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:2c:7b,bridge_name='br-int',has_traffic_filtering=True,id=1054bcf2-2aa6-4112-bd95-9d471c3f63cd,network=Network(7eb2af8e-a61c-4a54-9b96-5be2573c5e65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1054bcf2-2a') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG os_vif [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:2c:7b,bridge_name='br-int',has_traffic_filtering=True,id=1054bcf2-2aa6-4112-bd95-9d471c3f63cd,network=Network(7eb2af8e-a61c-4a54-9b96-5be2573c5e65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1054bcf2-2a') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1054bcf2-2a, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1054bcf2-2a, col_values=(('external_ids', {'iface-id': '1054bcf2-2aa6-4112-bd95-9d471c3f63cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:2c:7b', 'vm-uuid': '83aca621-7182-49a9-b4b3-8f22dd50f869'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:31 user nova-compute[73078]: INFO os_vif [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:2c:7b,bridge_name='br-int',has_traffic_filtering=True,id=1054bcf2-2aa6-4112-bd95-9d471c3f63cd,network=Network(7eb2af8e-a61c-4a54-9b96-5be2573c5e65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1054bcf2-2a')
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-443983221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-443983221',id=20,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHd9bG/5KkbQ9FbKOJ/d6gIa527ZUD7wURLK3IAXPNF94fE9wh+JxFHpVmaAMdvABr+vLMBrDq+zluqLpRUFR9/dqQ1SI0JVgXG+rXidtHm8tRYydztbckUOre9Kg1WkCw==',key_name='tempest-keypair-228573238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ed67729880341ffb35e2e668fd80e95',ramdisk_id='',reservation_id='r-q4nnps0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-95949371',owner_user_name='tempest-TaggedBootDevicesTest_v242-95949371-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:16:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aced5b7859ff428ba065909862c08da0',uuid=83aca621-7182-49a9-b4b3-8f22dd50f869,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10e5877a-b0ba-449a-81db-1ecf3e760851", "address": "fa:16:3e:ec:f7:8e", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e5877a-b0", "ovs_interfaceid": "10e5877a-b0ba-449a-81db-1ecf3e760851", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converting VIF {"id": "10e5877a-b0ba-449a-81db-1ecf3e760851", "address": "fa:16:3e:ec:f7:8e", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e5877a-b0", "ovs_interfaceid": "10e5877a-b0ba-449a-81db-1ecf3e760851", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:f7:8e,bridge_name='br-int',has_traffic_filtering=True,id=10e5877a-b0ba-449a-81db-1ecf3e760851,network=Network(7eb2af8e-a61c-4a54-9b96-5be2573c5e65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e5877a-b0') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG os_vif [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:f7:8e,bridge_name='br-int',has_traffic_filtering=True,id=10e5877a-b0ba-449a-81db-1ecf3e760851,network=Network(7eb2af8e-a61c-4a54-9b96-5be2573c5e65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e5877a-b0') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10e5877a-b0, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap10e5877a-b0, col_values=(('external_ids', {'iface-id': '10e5877a-b0ba-449a-81db-1ecf3e760851', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:f7:8e', 'vm-uuid': '83aca621-7182-49a9-b4b3-8f22dd50f869'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:31 user nova-compute[73078]: INFO os_vif [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:f7:8e,bridge_name='br-int',has_traffic_filtering=True,id=10e5877a-b0ba-449a-81db-1ecf3e760851,network=Network(7eb2af8e-a61c-4a54-9b96-5be2573c5e65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e5877a-b0')
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-443983221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-443983221',id=20,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHd9bG/5KkbQ9FbKOJ/d6gIa527ZUD7wURLK3IAXPNF94fE9wh+JxFHpVmaAMdvABr+vLMBrDq+zluqLpRUFR9/dqQ1SI0JVgXG+rXidtHm8tRYydztbckUOre9Kg1WkCw==',key_name='tempest-keypair-228573238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ed67729880341ffb35e2e668fd80e95',ramdisk_id='',reservation_id='r-q4nnps0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-95949371',owner_user_name='tempest-TaggedBootDevicesTest_v242-95949371-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:16:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aced5b7859ff428ba065909862c08da0',uuid=83aca621-7182-49a9-b4b3-8f22dd50f869,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc245bed-0f7e-49a7-a6af-71072040d109", "address": "fa:16:3e:f9:96:4c", "network": {"id": "5a386415-85db-4304-a0f0-65460a1f8308", "bridge": "br-int", "label": "tempest-device-tagging-net2-529646808", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc245bed-0f", "ovs_interfaceid": "dc245bed-0f7e-49a7-a6af-71072040d109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converting VIF {"id": "dc245bed-0f7e-49a7-a6af-71072040d109", "address": "fa:16:3e:f9:96:4c", "network": {"id": "5a386415-85db-4304-a0f0-65460a1f8308", "bridge": "br-int", "label": "tempest-device-tagging-net2-529646808", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc245bed-0f", "ovs_interfaceid": "dc245bed-0f7e-49a7-a6af-71072040d109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:96:4c,bridge_name='br-int',has_traffic_filtering=True,id=dc245bed-0f7e-49a7-a6af-71072040d109,network=Network(5a386415-85db-4304-a0f0-65460a1f8308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc245bed-0f') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG os_vif [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:96:4c,bridge_name='br-int',has_traffic_filtering=True,id=dc245bed-0f7e-49a7-a6af-71072040d109,network=Network(5a386415-85db-4304-a0f0-65460a1f8308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc245bed-0f') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc245bed-0f, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdc245bed-0f, col_values=(('external_ids', {'iface-id': 'dc245bed-0f7e-49a7-a6af-71072040d109', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:96:4c', 'vm-uuid': '83aca621-7182-49a9-b4b3-8f22dd50f869'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:31 user nova-compute[73078]: INFO os_vif [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:96:4c,bridge_name='br-int',has_traffic_filtering=True,id=dc245bed-0f7e-49a7-a6af-71072040d109,network=Network(5a386415-85db-4304-a0f0-65460a1f8308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc245bed-0f')
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-443983221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-443983221',id=20,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHd9bG/5KkbQ9FbKOJ/d6gIa527ZUD7wURLK3IAXPNF94fE9wh+JxFHpVmaAMdvABr+vLMBrDq+zluqLpRUFR9/dqQ1SI0JVgXG+rXidtHm8tRYydztbckUOre9Kg1WkCw==',key_name='tempest-keypair-228573238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ed67729880341ffb35e2e668fd80e95',ramdisk_id='',reservation_id='r-q4nnps0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-95949371',owner_user_name='tempest-TaggedBootDevicesTest_v242-95949371-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:16:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aced5b7859ff428ba065909862c08da0',uuid=83aca621-7182-49a9-b4b3-8f22dd50f869,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ebbf2bd-0d73-4374-a69e-0f0c3e018c85", "address": "fa:16:3e:ee:37:9e", "network": {"id": "5a386415-85db-4304-a0f0-65460a1f8308", "bridge": "br-int", "label": "tempest-device-tagging-net2-529646808", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ebbf2bd-0d", "ovs_interfaceid": "1ebbf2bd-0d73-4374-a69e-0f0c3e018c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converting VIF {"id": "1ebbf2bd-0d73-4374-a69e-0f0c3e018c85", "address": "fa:16:3e:ee:37:9e", "network": {"id": "5a386415-85db-4304-a0f0-65460a1f8308", "bridge": "br-int", "label": "tempest-device-tagging-net2-529646808", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ebbf2bd-0d", "ovs_interfaceid": "1ebbf2bd-0d73-4374-a69e-0f0c3e018c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:37:9e,bridge_name='br-int',has_traffic_filtering=True,id=1ebbf2bd-0d73-4374-a69e-0f0c3e018c85,network=Network(5a386415-85db-4304-a0f0-65460a1f8308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ebbf2bd-0d') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG os_vif [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:37:9e,bridge_name='br-int',has_traffic_filtering=True,id=1ebbf2bd-0d73-4374-a69e-0f0c3e018c85,network=Network(5a386415-85db-4304-a0f0-65460a1f8308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ebbf2bd-0d') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ebbf2bd-0d, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1ebbf2bd-0d, col_values=(('external_ids', {'iface-id': '1ebbf2bd-0d73-4374-a69e-0f0c3e018c85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:37:9e', 'vm-uuid': '83aca621-7182-49a9-b4b3-8f22dd50f869'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:31 user nova-compute[73078]: INFO os_vif [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:37:9e,bridge_name='br-int',has_traffic_filtering=True,id=1ebbf2bd-0d73-4374-a69e-0f0c3e018c85,network=Network(5a386415-85db-4304-a0f0-65460a1f8308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ebbf2bd-0d')
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] No BDM found with device name hda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] No VIF found with MAC fa:16:3e:6a:9a:37, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] No VIF found with MAC fa:16:3e:ec:f7:8e, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:17:31 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Using config drive
Aug 14 18:17:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-da37d6cc-1264-4e3c-b880-02f0eadd0a84 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Acquiring lock "10f9d4a9-ee3f-45bd-95e4-edd4819dcf30" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-da37d6cc-1264-4e3c-b880-02f0eadd0a84 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "10f9d4a9-ee3f-45bd-95e4-edd4819dcf30" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-da37d6cc-1264-4e3c-b880-02f0eadd0a84 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Acquiring lock "10f9d4a9-ee3f-45bd-95e4-edd4819dcf30-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-da37d6cc-1264-4e3c-b880-02f0eadd0a84 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "10f9d4a9-ee3f-45bd-95e4-edd4819dcf30-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-da37d6cc-1264-4e3c-b880-02f0eadd0a84 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "10f9d4a9-ee3f-45bd-95e4-edd4819dcf30-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:31 user nova-compute[73078]: INFO nova.compute.manager [None req-da37d6cc-1264-4e3c-b880-02f0eadd0a84 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Terminating instance
Aug 14 18:17:31 user nova-compute[73078]: DEBUG nova.compute.manager [None req-da37d6cc-1264-4e3c-b880-02f0eadd0a84 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:32 user nova-compute[73078]: INFO nova.compute.manager [None req-df1ec593-06ab-4343-9b54-8fe8b3229f83 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Unrescuing
Aug 14 18:17:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-df1ec593-06ab-4343-9b54-8fe8b3229f83 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "refresh_cache-de80e188-9385-4613-8a6c-aa72b624ad55" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:17:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-df1ec593-06ab-4343-9b54-8fe8b3229f83 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquired lock "refresh_cache-de80e188-9385-4613-8a6c-aa72b624ad55" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:17:32 user nova-compute[73078]: DEBUG nova.network.neutron [None req-df1ec593-06ab-4343-9b54-8fe8b3229f83 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:17:32 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Instance destroyed successfully.
Aug 14 18:17:32 user nova-compute[73078]: DEBUG nova.objects.instance [None req-da37d6cc-1264-4e3c-b880-02f0eadd0a84 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lazy-loading 'resources' on Instance uuid 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:17:32 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-da37d6cc-1264-4e3c-b880-02f0eadd0a84 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1229416704',display_name='tempest-VolumesAdminNegativeTest-server-1229416704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1229416704',id=8,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL/e0arVJj00ekjB5q3VvUCkhgo+KqaamcMsu31WGLM+jn12dW9YePCbHY8SkAvTiAD1hM6rwZd/oPMx/RAudoGEvNO/33/GQlMCXTKB5rvfACcTbcAbtIeqYwa1h0VnA==',key_name='tempest-keypair-1680478252',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:11:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d0d923a445747d8a812c1b7b4510398',ramdisk_id='',reservation_id='r-25qetqjt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1778130930',owner_user_name='tempest-VolumesAdminNegativeTest-1778130930-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:11:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a4b9a2ffd4947ce8fb65976b48b112d',uuid=10f9d4a9-ee3f-45bd-95e4-edd4819dcf30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e2c0a61-c9ce-49a5-891d-97803d8557e1", "address": "fa:16:3e:63:16:7b", "network": {"id": "bcbb9361-92bf-48f3-9d61-e5cdb5d21980", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1013223391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d0d923a445747d8a812c1b7b4510398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e2c0a61-c9", "ovs_interfaceid": "0e2c0a61-c9ce-49a5-891d-97803d8557e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:17:32 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-da37d6cc-1264-4e3c-b880-02f0eadd0a84 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Converting VIF {"id": "0e2c0a61-c9ce-49a5-891d-97803d8557e1", "address": "fa:16:3e:63:16:7b", "network": {"id": "bcbb9361-92bf-48f3-9d61-e5cdb5d21980", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1013223391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d0d923a445747d8a812c1b7b4510398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e2c0a61-c9", "ovs_interfaceid": "0e2c0a61-c9ce-49a5-891d-97803d8557e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:17:32 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-da37d6cc-1264-4e3c-b880-02f0eadd0a84 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:16:7b,bridge_name='br-int',has_traffic_filtering=True,id=0e2c0a61-c9ce-49a5-891d-97803d8557e1,network=Network(bcbb9361-92bf-48f3-9d61-e5cdb5d21980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e2c0a61-c9') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:17:32 user nova-compute[73078]: DEBUG os_vif [None req-da37d6cc-1264-4e3c-b880-02f0eadd0a84 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:16:7b,bridge_name='br-int',has_traffic_filtering=True,id=0e2c0a61-c9ce-49a5-891d-97803d8557e1,network=Network(bcbb9361-92bf-48f3-9d61-e5cdb5d21980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e2c0a61-c9') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:17:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e2c0a61-c9, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:17:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:17:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:32 user nova-compute[73078]: INFO os_vif [None req-da37d6cc-1264-4e3c-b880-02f0eadd0a84 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:16:7b,bridge_name='br-int',has_traffic_filtering=True,id=0e2c0a61-c9ce-49a5-891d-97803d8557e1,network=Network(bcbb9361-92bf-48f3-9d61-e5cdb5d21980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e2c0a61-c9')
Aug 14 18:17:32 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-da37d6cc-1264-4e3c-b880-02f0eadd0a84 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Deleting instance files /opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30_del
Aug 14 18:17:32 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-da37d6cc-1264-4e3c-b880-02f0eadd0a84 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Deletion of /opt/stack/data/nova/instances/10f9d4a9-ee3f-45bd-95e4-edd4819dcf30_del complete
Aug 14 18:17:32 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Creating config drive at /opt/stack/data/nova/instances/83aca621-7182-49a9-b4b3-8f22dd50f869/disk.config
Aug 14 18:17:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/83aca621-7182-49a9-b4b3-8f22dd50f869/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpiwvr7dx0 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:32 user nova-compute[73078]: DEBUG nova.compute.manager [req-fd1fb2fd-49ff-447c-9c40-e7f1d42c4f47 req-b08206a4-03a6-42ae-a659-f09469377f74 service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Received event network-vif-plugged-10688f4a-5919-4a48-9767-92e304a494be {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-fd1fb2fd-49ff-447c-9c40-e7f1d42c4f47 req-b08206a4-03a6-42ae-a659-f09469377f74 service nova] Acquiring lock "8d257202-d8ab-4161-9b67-045cf1e36772-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-fd1fb2fd-49ff-447c-9c40-e7f1d42c4f47 req-b08206a4-03a6-42ae-a659-f09469377f74 service nova] Lock "8d257202-d8ab-4161-9b67-045cf1e36772-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-fd1fb2fd-49ff-447c-9c40-e7f1d42c4f47 req-b08206a4-03a6-42ae-a659-f09469377f74 service nova] Lock "8d257202-d8ab-4161-9b67-045cf1e36772-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:32 user nova-compute[73078]: DEBUG nova.compute.manager [req-fd1fb2fd-49ff-447c-9c40-e7f1d42c4f47 req-b08206a4-03a6-42ae-a659-f09469377f74 service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] No waiting events found dispatching network-vif-plugged-10688f4a-5919-4a48-9767-92e304a494be {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:17:32 user nova-compute[73078]: WARNING nova.compute.manager [req-fd1fb2fd-49ff-447c-9c40-e7f1d42c4f47 req-b08206a4-03a6-42ae-a659-f09469377f74 service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Received unexpected event network-vif-plugged-10688f4a-5919-4a48-9767-92e304a494be for instance with vm_state active and task_state deleting.
Aug 14 18:17:32 user nova-compute[73078]: DEBUG nova.compute.manager [req-fd1fb2fd-49ff-447c-9c40-e7f1d42c4f47 req-b08206a4-03a6-42ae-a659-f09469377f74 service nova] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Received event network-vif-unplugged-0e2c0a61-c9ce-49a5-891d-97803d8557e1 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-fd1fb2fd-49ff-447c-9c40-e7f1d42c4f47 req-b08206a4-03a6-42ae-a659-f09469377f74 service nova] Acquiring lock "10f9d4a9-ee3f-45bd-95e4-edd4819dcf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-fd1fb2fd-49ff-447c-9c40-e7f1d42c4f47 req-b08206a4-03a6-42ae-a659-f09469377f74 service nova] Lock "10f9d4a9-ee3f-45bd-95e4-edd4819dcf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-fd1fb2fd-49ff-447c-9c40-e7f1d42c4f47 req-b08206a4-03a6-42ae-a659-f09469377f74 service nova] Lock "10f9d4a9-ee3f-45bd-95e4-edd4819dcf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:32 user nova-compute[73078]: DEBUG nova.compute.manager [req-fd1fb2fd-49ff-447c-9c40-e7f1d42c4f47 req-b08206a4-03a6-42ae-a659-f09469377f74 service nova] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] No waiting events found dispatching network-vif-unplugged-0e2c0a61-c9ce-49a5-891d-97803d8557e1 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:17:32 user nova-compute[73078]: DEBUG nova.compute.manager [req-fd1fb2fd-49ff-447c-9c40-e7f1d42c4f47 req-b08206a4-03a6-42ae-a659-f09469377f74 service nova] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Received event network-vif-unplugged-0e2c0a61-c9ce-49a5-891d-97803d8557e1 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:17:32 user nova-compute[73078]: INFO nova.compute.manager [None req-da37d6cc-1264-4e3c-b880-02f0eadd0a84 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Took 1.08 seconds to destroy the instance on the hypervisor.
Aug 14 18:17:32 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-da37d6cc-1264-4e3c-b880-02f0eadd0a84 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:17:32 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:17:32 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:17:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/83aca621-7182-49a9-b4b3-8f22dd50f869/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpiwvr7dx0" returned: 0 in 0.101s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:32 user nova-compute[73078]: DEBUG nova.network.neutron [None req-df1ec593-06ab-4343-9b54-8fe8b3229f83 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Updating instance_info_cache with network_info: [{"id": "2afe973c-46fa-4336-996f-b5dcd374c96e", "address": "fa:16:3e:5d:60:2f", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe973c-46", "ovs_interfaceid": "2afe973c-46fa-4336-996f-b5dcd374c96e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:17:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-df1ec593-06ab-4343-9b54-8fe8b3229f83 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Releasing lock "refresh_cache-de80e188-9385-4613-8a6c-aa72b624ad55" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:17:32 user nova-compute[73078]: DEBUG nova.objects.instance [None req-df1ec593-06ab-4343-9b54-8fe8b3229f83 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lazy-loading 'flavor' on Instance uuid de80e188-9385-4613-8a6c-aa72b624ad55 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:17:33 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:17:33 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Took 2.16 seconds to deallocate network for instance.
Aug 14 18:17:33 user nova-compute[73078]: DEBUG nova.compute.manager [req-fbad495f-53fe-4e5d-937b-47faee500612 req-8bf5061b-cfa8-4b7a-9704-6118e002745e service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Received event network-vif-deleted-10688f4a-5919-4a48-9767-92e304a494be {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:33 user nova-compute[73078]: INFO nova.compute.manager [req-fbad495f-53fe-4e5d-937b-47faee500612 req-8bf5061b-cfa8-4b7a-9704-6118e002745e service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Neutron deleted interface 10688f4a-5919-4a48-9767-92e304a494be; detaching it from the instance and deleting it from the info cache
Aug 14 18:17:33 user nova-compute[73078]: DEBUG nova.network.neutron [req-fbad495f-53fe-4e5d-937b-47faee500612 req-8bf5061b-cfa8-4b7a-9704-6118e002745e service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:17:33 user nova-compute[73078]: DEBUG nova.compute.manager [req-fbad495f-53fe-4e5d-937b-47faee500612 req-8bf5061b-cfa8-4b7a-9704-6118e002745e service nova] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Detach interface failed, port_id=10688f4a-5919-4a48-9767-92e304a494be, reason: Instance 8d257202-d8ab-4161-9b67-045cf1e36772 could not be found. {{(pid=73078) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 18:17:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ed60e897-8851-4dbd-b46d-2b192458e477 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ed60e897-8851-4dbd-b46d-2b192458e477 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:33 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-ed60e897-8851-4dbd-b46d-2b192458e477 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:17:33 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-ed60e897-8851-4dbd-b46d-2b192458e477 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:17:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ed60e897-8851-4dbd-b46d-2b192458e477 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.561s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:33 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:17:33 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-ed60e897-8851-4dbd-b46d-2b192458e477 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Deleted allocations for instance 8d257202-d8ab-4161-9b67-045cf1e36772
Aug 14 18:17:33 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Took 1.26 seconds to deallocate network for instance.
Aug 14 18:17:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-da37d6cc-1264-4e3c-b880-02f0eadd0a84 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-da37d6cc-1264-4e3c-b880-02f0eadd0a84 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:34 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ed60e897-8851-4dbd-b46d-2b192458e477 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "8d257202-d8ab-4161-9b67-045cf1e36772" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.203s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:34 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Instance destroyed successfully.
Aug 14 18:17:34 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-da37d6cc-1264-4e3c-b880-02f0eadd0a84 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:17:34 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-da37d6cc-1264-4e3c-b880-02f0eadd0a84 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:17:34 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-da37d6cc-1264-4e3c-b880-02f0eadd0a84 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:34 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-da37d6cc-1264-4e3c-b880-02f0eadd0a84 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Deleted allocations for instance 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30
Aug 14 18:17:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:34 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-da37d6cc-1264-4e3c-b880-02f0eadd0a84 tempest-VolumesAdminNegativeTest-1778130930 tempest-VolumesAdminNegativeTest-1778130930-project-member] Lock "10f9d4a9-ee3f-45bd-95e4-edd4819dcf30" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.984s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:34 user nova-compute[73078]: DEBUG nova.compute.manager [req-ad645fd0-d349-4145-9e98-a1a10aa837aa req-f5a0d938-a183-4a43-908d-4376f205eaf4 service nova] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Received event network-vif-plugged-0e2c0a61-c9ce-49a5-891d-97803d8557e1 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:34 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ad645fd0-d349-4145-9e98-a1a10aa837aa req-f5a0d938-a183-4a43-908d-4376f205eaf4 service nova] Acquiring lock "10f9d4a9-ee3f-45bd-95e4-edd4819dcf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:34 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ad645fd0-d349-4145-9e98-a1a10aa837aa req-f5a0d938-a183-4a43-908d-4376f205eaf4 service nova] Lock "10f9d4a9-ee3f-45bd-95e4-edd4819dcf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:34 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ad645fd0-d349-4145-9e98-a1a10aa837aa req-f5a0d938-a183-4a43-908d-4376f205eaf4 service nova] Lock "10f9d4a9-ee3f-45bd-95e4-edd4819dcf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:34 user nova-compute[73078]: DEBUG nova.compute.manager [req-ad645fd0-d349-4145-9e98-a1a10aa837aa req-f5a0d938-a183-4a43-908d-4376f205eaf4 service nova] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] No waiting events found dispatching network-vif-plugged-0e2c0a61-c9ce-49a5-891d-97803d8557e1 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:17:34 user nova-compute[73078]: WARNING nova.compute.manager [req-ad645fd0-d349-4145-9e98-a1a10aa837aa req-f5a0d938-a183-4a43-908d-4376f205eaf4 service nova] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Received unexpected event network-vif-plugged-0e2c0a61-c9ce-49a5-891d-97803d8557e1 for instance with vm_state deleted and task_state None.
Aug 14 18:17:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:35 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:35 user nova-compute[73078]: DEBUG nova.compute.manager [req-a2b4a312-5a26-4776-8cbc-5d49bb4347d2 req-e1b13456-1d93-4e33-a0ea-e5e0dfaebab4 service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Received event network-vif-unplugged-2afe973c-46fa-4336-996f-b5dcd374c96e {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a2b4a312-5a26-4776-8cbc-5d49bb4347d2 req-e1b13456-1d93-4e33-a0ea-e5e0dfaebab4 service nova] Acquiring lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a2b4a312-5a26-4776-8cbc-5d49bb4347d2 req-e1b13456-1d93-4e33-a0ea-e5e0dfaebab4 service nova] Lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a2b4a312-5a26-4776-8cbc-5d49bb4347d2 req-e1b13456-1d93-4e33-a0ea-e5e0dfaebab4 service nova] Lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:35 user nova-compute[73078]: DEBUG nova.compute.manager [req-a2b4a312-5a26-4776-8cbc-5d49bb4347d2 req-e1b13456-1d93-4e33-a0ea-e5e0dfaebab4 service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] No waiting events found dispatching network-vif-unplugged-2afe973c-46fa-4336-996f-b5dcd374c96e {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:17:35 user nova-compute[73078]: WARNING nova.compute.manager [req-a2b4a312-5a26-4776-8cbc-5d49bb4347d2 req-e1b13456-1d93-4e33-a0ea-e5e0dfaebab4 service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Received unexpected event network-vif-unplugged-2afe973c-46fa-4336-996f-b5dcd374c96e for instance with vm_state rescued and task_state unrescuing.
Aug 14 18:17:35 user nova-compute[73078]: DEBUG nova.compute.manager [req-a2b4a312-5a26-4776-8cbc-5d49bb4347d2 req-e1b13456-1d93-4e33-a0ea-e5e0dfaebab4 service nova] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Received event network-vif-deleted-0e2c0a61-c9ce-49a5-891d-97803d8557e1 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:35 user nova-compute[73078]: DEBUG nova.compute.manager [req-a2b4a312-5a26-4776-8cbc-5d49bb4347d2 req-e1b13456-1d93-4e33-a0ea-e5e0dfaebab4 service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Received event network-vif-plugged-2afe973c-46fa-4336-996f-b5dcd374c96e {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a2b4a312-5a26-4776-8cbc-5d49bb4347d2 req-e1b13456-1d93-4e33-a0ea-e5e0dfaebab4 service nova] Acquiring lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a2b4a312-5a26-4776-8cbc-5d49bb4347d2 req-e1b13456-1d93-4e33-a0ea-e5e0dfaebab4 service nova] Lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a2b4a312-5a26-4776-8cbc-5d49bb4347d2 req-e1b13456-1d93-4e33-a0ea-e5e0dfaebab4 service nova] Lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:35 user nova-compute[73078]: DEBUG nova.compute.manager [req-a2b4a312-5a26-4776-8cbc-5d49bb4347d2 req-e1b13456-1d93-4e33-a0ea-e5e0dfaebab4 service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] No waiting events found dispatching network-vif-plugged-2afe973c-46fa-4336-996f-b5dcd374c96e {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:17:35 user nova-compute[73078]: WARNING nova.compute.manager [req-a2b4a312-5a26-4776-8cbc-5d49bb4347d2 req-e1b13456-1d93-4e33-a0ea-e5e0dfaebab4 service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Received unexpected event network-vif-plugged-2afe973c-46fa-4336-996f-b5dcd374c96e for instance with vm_state rescued and task_state unrescuing.
Aug 14 18:17:35 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:35 user nova-compute[73078]: DEBUG nova.compute.manager [req-3929ec81-2d40-4b73-9d04-e47681bc42d3 req-ef6f9d9a-46be-4bf8-b2c2-3a728a07a54d service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-plugged-9f1350b2-c0dd-4818-a941-22f37f92e610 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3929ec81-2d40-4b73-9d04-e47681bc42d3 req-ef6f9d9a-46be-4bf8-b2c2-3a728a07a54d service nova] Acquiring lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3929ec81-2d40-4b73-9d04-e47681bc42d3 req-ef6f9d9a-46be-4bf8-b2c2-3a728a07a54d service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3929ec81-2d40-4b73-9d04-e47681bc42d3 req-ef6f9d9a-46be-4bf8-b2c2-3a728a07a54d service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:35 user nova-compute[73078]: DEBUG nova.compute.manager [req-3929ec81-2d40-4b73-9d04-e47681bc42d3 req-ef6f9d9a-46be-4bf8-b2c2-3a728a07a54d service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] No waiting events found dispatching network-vif-plugged-9f1350b2-c0dd-4818-a941-22f37f92e610 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:17:35 user nova-compute[73078]: WARNING nova.compute.manager [req-3929ec81-2d40-4b73-9d04-e47681bc42d3 req-ef6f9d9a-46be-4bf8-b2c2-3a728a07a54d service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received unexpected event network-vif-plugged-9f1350b2-c0dd-4818-a941-22f37f92e610 for instance with vm_state building and task_state spawning.
Aug 14 18:17:35 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:35 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:35 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG nova.compute.manager [req-978a03e3-92d8-41d5-8de7-be74bc69ed2b req-6e7e9dfb-9c0b-4258-8a45-15aa503d23c5 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-plugged-fd713ad0-5a38-4d0e-8f2c-2c388a9f6849 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-978a03e3-92d8-41d5-8de7-be74bc69ed2b req-6e7e9dfb-9c0b-4258-8a45-15aa503d23c5 service nova] Acquiring lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-978a03e3-92d8-41d5-8de7-be74bc69ed2b req-6e7e9dfb-9c0b-4258-8a45-15aa503d23c5 service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-978a03e3-92d8-41d5-8de7-be74bc69ed2b req-6e7e9dfb-9c0b-4258-8a45-15aa503d23c5 service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG nova.compute.manager [req-978a03e3-92d8-41d5-8de7-be74bc69ed2b req-6e7e9dfb-9c0b-4258-8a45-15aa503d23c5 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] No waiting events found dispatching network-vif-plugged-fd713ad0-5a38-4d0e-8f2c-2c388a9f6849 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:17:37 user nova-compute[73078]: WARNING nova.compute.manager [req-978a03e3-92d8-41d5-8de7-be74bc69ed2b req-6e7e9dfb-9c0b-4258-8a45-15aa503d23c5 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received unexpected event network-vif-plugged-fd713ad0-5a38-4d0e-8f2c-2c388a9f6849 for instance with vm_state building and task_state spawning.
Aug 14 18:17:37 user nova-compute[73078]: DEBUG nova.compute.manager [req-978a03e3-92d8-41d5-8de7-be74bc69ed2b req-6e7e9dfb-9c0b-4258-8a45-15aa503d23c5 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-plugged-fd713ad0-5a38-4d0e-8f2c-2c388a9f6849 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-978a03e3-92d8-41d5-8de7-be74bc69ed2b req-6e7e9dfb-9c0b-4258-8a45-15aa503d23c5 service nova] Acquiring lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-978a03e3-92d8-41d5-8de7-be74bc69ed2b req-6e7e9dfb-9c0b-4258-8a45-15aa503d23c5 service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-978a03e3-92d8-41d5-8de7-be74bc69ed2b req-6e7e9dfb-9c0b-4258-8a45-15aa503d23c5 service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG nova.compute.manager [req-978a03e3-92d8-41d5-8de7-be74bc69ed2b req-6e7e9dfb-9c0b-4258-8a45-15aa503d23c5 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] No waiting events found dispatching network-vif-plugged-fd713ad0-5a38-4d0e-8f2c-2c388a9f6849 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:17:37 user nova-compute[73078]: WARNING nova.compute.manager [req-978a03e3-92d8-41d5-8de7-be74bc69ed2b req-6e7e9dfb-9c0b-4258-8a45-15aa503d23c5 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received unexpected event network-vif-plugged-fd713ad0-5a38-4d0e-8f2c-2c388a9f6849 for instance with vm_state building and task_state spawning.
Aug 14 18:17:37 user nova-compute[73078]: DEBUG nova.compute.manager [req-978a03e3-92d8-41d5-8de7-be74bc69ed2b req-6e7e9dfb-9c0b-4258-8a45-15aa503d23c5 service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Received event network-vif-plugged-2afe973c-46fa-4336-996f-b5dcd374c96e {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-978a03e3-92d8-41d5-8de7-be74bc69ed2b req-6e7e9dfb-9c0b-4258-8a45-15aa503d23c5 service nova] Acquiring lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-978a03e3-92d8-41d5-8de7-be74bc69ed2b req-6e7e9dfb-9c0b-4258-8a45-15aa503d23c5 service nova] Lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-978a03e3-92d8-41d5-8de7-be74bc69ed2b req-6e7e9dfb-9c0b-4258-8a45-15aa503d23c5 service nova] Lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG nova.compute.manager [req-978a03e3-92d8-41d5-8de7-be74bc69ed2b req-6e7e9dfb-9c0b-4258-8a45-15aa503d23c5 service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] No waiting events found dispatching network-vif-plugged-2afe973c-46fa-4336-996f-b5dcd374c96e {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:17:37 user nova-compute[73078]: WARNING nova.compute.manager [req-978a03e3-92d8-41d5-8de7-be74bc69ed2b req-6e7e9dfb-9c0b-4258-8a45-15aa503d23c5 service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Received unexpected event network-vif-plugged-2afe973c-46fa-4336-996f-b5dcd374c96e for instance with vm_state rescued and task_state unrescuing.
Aug 14 18:17:37 user nova-compute[73078]: DEBUG nova.compute.manager [req-978a03e3-92d8-41d5-8de7-be74bc69ed2b req-6e7e9dfb-9c0b-4258-8a45-15aa503d23c5 service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Received event network-vif-plugged-2afe973c-46fa-4336-996f-b5dcd374c96e {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-978a03e3-92d8-41d5-8de7-be74bc69ed2b req-6e7e9dfb-9c0b-4258-8a45-15aa503d23c5 service nova] Acquiring lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-978a03e3-92d8-41d5-8de7-be74bc69ed2b req-6e7e9dfb-9c0b-4258-8a45-15aa503d23c5 service nova] Lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-978a03e3-92d8-41d5-8de7-be74bc69ed2b req-6e7e9dfb-9c0b-4258-8a45-15aa503d23c5 service nova] Lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG nova.compute.manager [req-978a03e3-92d8-41d5-8de7-be74bc69ed2b req-6e7e9dfb-9c0b-4258-8a45-15aa503d23c5 service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] No waiting events found dispatching network-vif-plugged-2afe973c-46fa-4336-996f-b5dcd374c96e {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:17:37 user nova-compute[73078]: WARNING nova.compute.manager [req-978a03e3-92d8-41d5-8de7-be74bc69ed2b req-6e7e9dfb-9c0b-4258-8a45-15aa503d23c5 service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Received unexpected event network-vif-plugged-2afe973c-46fa-4336-996f-b5dcd374c96e for instance with vm_state rescued and task_state unrescuing.
Aug 14 18:17:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG nova.compute.manager [req-da93763c-5833-496a-a008-0129216d0858 req-883a5585-c0d1-4118-bbc5-ad78184b09ed service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-plugged-9f1350b2-c0dd-4818-a941-22f37f92e610 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-da93763c-5833-496a-a008-0129216d0858 req-883a5585-c0d1-4118-bbc5-ad78184b09ed service nova] Acquiring lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-da93763c-5833-496a-a008-0129216d0858 req-883a5585-c0d1-4118-bbc5-ad78184b09ed service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-da93763c-5833-496a-a008-0129216d0858 req-883a5585-c0d1-4118-bbc5-ad78184b09ed service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG nova.compute.manager [req-da93763c-5833-496a-a008-0129216d0858 req-883a5585-c0d1-4118-bbc5-ad78184b09ed service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] No waiting events found dispatching network-vif-plugged-9f1350b2-c0dd-4818-a941-22f37f92e610 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:17:37 user nova-compute[73078]: WARNING nova.compute.manager [req-da93763c-5833-496a-a008-0129216d0858 req-883a5585-c0d1-4118-bbc5-ad78184b09ed service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received unexpected event network-vif-plugged-9f1350b2-c0dd-4818-a941-22f37f92e610 for instance with vm_state building and task_state spawning.
Aug 14 18:17:37 user nova-compute[73078]: DEBUG nova.compute.manager [req-da93763c-5833-496a-a008-0129216d0858 req-883a5585-c0d1-4118-bbc5-ad78184b09ed service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-plugged-62809f7b-d1f3-4cae-9685-107e5008c9eb {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-da93763c-5833-496a-a008-0129216d0858 req-883a5585-c0d1-4118-bbc5-ad78184b09ed service nova] Acquiring lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-da93763c-5833-496a-a008-0129216d0858 req-883a5585-c0d1-4118-bbc5-ad78184b09ed service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-da93763c-5833-496a-a008-0129216d0858 req-883a5585-c0d1-4118-bbc5-ad78184b09ed service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG nova.compute.manager [req-da93763c-5833-496a-a008-0129216d0858 req-883a5585-c0d1-4118-bbc5-ad78184b09ed service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] No waiting events found dispatching network-vif-plugged-62809f7b-d1f3-4cae-9685-107e5008c9eb {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:17:37 user nova-compute[73078]: WARNING nova.compute.manager [req-da93763c-5833-496a-a008-0129216d0858 req-883a5585-c0d1-4118-bbc5-ad78184b09ed service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received unexpected event network-vif-plugged-62809f7b-d1f3-4cae-9685-107e5008c9eb for instance with vm_state building and task_state spawning.
Aug 14 18:17:37 user nova-compute[73078]: DEBUG nova.compute.manager [req-da93763c-5833-496a-a008-0129216d0858 req-883a5585-c0d1-4118-bbc5-ad78184b09ed service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-plugged-62809f7b-d1f3-4cae-9685-107e5008c9eb {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-da93763c-5833-496a-a008-0129216d0858 req-883a5585-c0d1-4118-bbc5-ad78184b09ed service nova] Acquiring lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-da93763c-5833-496a-a008-0129216d0858 req-883a5585-c0d1-4118-bbc5-ad78184b09ed service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-da93763c-5833-496a-a008-0129216d0858 req-883a5585-c0d1-4118-bbc5-ad78184b09ed service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG nova.compute.manager [req-da93763c-5833-496a-a008-0129216d0858 req-883a5585-c0d1-4118-bbc5-ad78184b09ed service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] No waiting events found dispatching network-vif-plugged-62809f7b-d1f3-4cae-9685-107e5008c9eb {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:17:37 user nova-compute[73078]: WARNING nova.compute.manager [req-da93763c-5833-496a-a008-0129216d0858 req-883a5585-c0d1-4118-bbc5-ad78184b09ed service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received unexpected event network-vif-plugged-62809f7b-d1f3-4cae-9685-107e5008c9eb for instance with vm_state building and task_state spawning.
Aug 14 18:17:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:39 user nova-compute[73078]: DEBUG nova.compute.manager [req-3d48f0d0-5890-4b7f-87f0-95f343ce517b req-a2ca9815-3f4c-457a-b323-f57574916d30 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-plugged-1054bcf2-2aa6-4112-bd95-9d471c3f63cd {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3d48f0d0-5890-4b7f-87f0-95f343ce517b req-a2ca9815-3f4c-457a-b323-f57574916d30 service nova] Acquiring lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3d48f0d0-5890-4b7f-87f0-95f343ce517b req-a2ca9815-3f4c-457a-b323-f57574916d30 service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3d48f0d0-5890-4b7f-87f0-95f343ce517b req-a2ca9815-3f4c-457a-b323-f57574916d30 service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:39 user nova-compute[73078]: DEBUG nova.compute.manager [req-3d48f0d0-5890-4b7f-87f0-95f343ce517b req-a2ca9815-3f4c-457a-b323-f57574916d30 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] No waiting events found dispatching network-vif-plugged-1054bcf2-2aa6-4112-bd95-9d471c3f63cd {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:17:39 user nova-compute[73078]: WARNING nova.compute.manager [req-3d48f0d0-5890-4b7f-87f0-95f343ce517b req-a2ca9815-3f4c-457a-b323-f57574916d30 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received unexpected event network-vif-plugged-1054bcf2-2aa6-4112-bd95-9d471c3f63cd for instance with vm_state building and task_state spawning.
Aug 14 18:17:39 user nova-compute[73078]: DEBUG nova.compute.manager [req-3d48f0d0-5890-4b7f-87f0-95f343ce517b req-a2ca9815-3f4c-457a-b323-f57574916d30 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-plugged-1054bcf2-2aa6-4112-bd95-9d471c3f63cd {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3d48f0d0-5890-4b7f-87f0-95f343ce517b req-a2ca9815-3f4c-457a-b323-f57574916d30 service nova] Acquiring lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3d48f0d0-5890-4b7f-87f0-95f343ce517b req-a2ca9815-3f4c-457a-b323-f57574916d30 service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3d48f0d0-5890-4b7f-87f0-95f343ce517b req-a2ca9815-3f4c-457a-b323-f57574916d30 service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:39 user nova-compute[73078]: DEBUG nova.compute.manager [req-3d48f0d0-5890-4b7f-87f0-95f343ce517b req-a2ca9815-3f4c-457a-b323-f57574916d30 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] No waiting events found dispatching network-vif-plugged-1054bcf2-2aa6-4112-bd95-9d471c3f63cd {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:17:39 user nova-compute[73078]: WARNING nova.compute.manager [req-3d48f0d0-5890-4b7f-87f0-95f343ce517b req-a2ca9815-3f4c-457a-b323-f57574916d30 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received unexpected event network-vif-plugged-1054bcf2-2aa6-4112-bd95-9d471c3f63cd for instance with vm_state building and task_state spawning.
Aug 14 18:17:39 user nova-compute[73078]: DEBUG nova.compute.manager [req-3d48f0d0-5890-4b7f-87f0-95f343ce517b req-a2ca9815-3f4c-457a-b323-f57574916d30 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-plugged-10e5877a-b0ba-449a-81db-1ecf3e760851 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3d48f0d0-5890-4b7f-87f0-95f343ce517b req-a2ca9815-3f4c-457a-b323-f57574916d30 service nova] Acquiring lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3d48f0d0-5890-4b7f-87f0-95f343ce517b req-a2ca9815-3f4c-457a-b323-f57574916d30 service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3d48f0d0-5890-4b7f-87f0-95f343ce517b req-a2ca9815-3f4c-457a-b323-f57574916d30 service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:39 user nova-compute[73078]: DEBUG nova.compute.manager [req-3d48f0d0-5890-4b7f-87f0-95f343ce517b req-a2ca9815-3f4c-457a-b323-f57574916d30 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] No waiting events found dispatching network-vif-plugged-10e5877a-b0ba-449a-81db-1ecf3e760851 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:17:39 user nova-compute[73078]: WARNING nova.compute.manager [req-3d48f0d0-5890-4b7f-87f0-95f343ce517b req-a2ca9815-3f4c-457a-b323-f57574916d30 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received unexpected event network-vif-plugged-10e5877a-b0ba-449a-81db-1ecf3e760851 for instance with vm_state building and task_state spawning.
Aug 14 18:17:39 user nova-compute[73078]: DEBUG nova.compute.manager [req-3d48f0d0-5890-4b7f-87f0-95f343ce517b req-a2ca9815-3f4c-457a-b323-f57574916d30 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-plugged-10e5877a-b0ba-449a-81db-1ecf3e760851 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3d48f0d0-5890-4b7f-87f0-95f343ce517b req-a2ca9815-3f4c-457a-b323-f57574916d30 service nova] Acquiring lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3d48f0d0-5890-4b7f-87f0-95f343ce517b req-a2ca9815-3f4c-457a-b323-f57574916d30 service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3d48f0d0-5890-4b7f-87f0-95f343ce517b req-a2ca9815-3f4c-457a-b323-f57574916d30 service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:39 user nova-compute[73078]: DEBUG nova.compute.manager [req-3d48f0d0-5890-4b7f-87f0-95f343ce517b req-a2ca9815-3f4c-457a-b323-f57574916d30 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] No waiting events found dispatching network-vif-plugged-10e5877a-b0ba-449a-81db-1ecf3e760851 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:17:39 user nova-compute[73078]: WARNING nova.compute.manager [req-3d48f0d0-5890-4b7f-87f0-95f343ce517b req-a2ca9815-3f4c-457a-b323-f57574916d30 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received unexpected event network-vif-plugged-10e5877a-b0ba-449a-81db-1ecf3e760851 for instance with vm_state building and task_state spawning.
Aug 14 18:17:39 user nova-compute[73078]: DEBUG nova.compute.manager [req-3d48f0d0-5890-4b7f-87f0-95f343ce517b req-a2ca9815-3f4c-457a-b323-f57574916d30 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-plugged-1ebbf2bd-0d73-4374-a69e-0f0c3e018c85 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3d48f0d0-5890-4b7f-87f0-95f343ce517b req-a2ca9815-3f4c-457a-b323-f57574916d30 service nova] Acquiring lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3d48f0d0-5890-4b7f-87f0-95f343ce517b req-a2ca9815-3f4c-457a-b323-f57574916d30 service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3d48f0d0-5890-4b7f-87f0-95f343ce517b req-a2ca9815-3f4c-457a-b323-f57574916d30 service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:39 user nova-compute[73078]: DEBUG nova.compute.manager [req-3d48f0d0-5890-4b7f-87f0-95f343ce517b req-a2ca9815-3f4c-457a-b323-f57574916d30 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] No waiting events found dispatching network-vif-plugged-1ebbf2bd-0d73-4374-a69e-0f0c3e018c85 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:17:39 user nova-compute[73078]: WARNING nova.compute.manager [req-3d48f0d0-5890-4b7f-87f0-95f343ce517b req-a2ca9815-3f4c-457a-b323-f57574916d30 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received unexpected event network-vif-plugged-1ebbf2bd-0d73-4374-a69e-0f0c3e018c85 for instance with vm_state building and task_state spawning.
Aug 14 18:17:39 user nova-compute[73078]: DEBUG nova.compute.manager [req-3d48f0d0-5890-4b7f-87f0-95f343ce517b req-a2ca9815-3f4c-457a-b323-f57574916d30 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-plugged-1ebbf2bd-0d73-4374-a69e-0f0c3e018c85 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3d48f0d0-5890-4b7f-87f0-95f343ce517b req-a2ca9815-3f4c-457a-b323-f57574916d30 service nova] Acquiring lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3d48f0d0-5890-4b7f-87f0-95f343ce517b req-a2ca9815-3f4c-457a-b323-f57574916d30 service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3d48f0d0-5890-4b7f-87f0-95f343ce517b req-a2ca9815-3f4c-457a-b323-f57574916d30 service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:39 user nova-compute[73078]: DEBUG nova.compute.manager [req-3d48f0d0-5890-4b7f-87f0-95f343ce517b req-a2ca9815-3f4c-457a-b323-f57574916d30 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] No waiting events found dispatching network-vif-plugged-1ebbf2bd-0d73-4374-a69e-0f0c3e018c85 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:17:39 user nova-compute[73078]: WARNING nova.compute.manager [req-3d48f0d0-5890-4b7f-87f0-95f343ce517b req-a2ca9815-3f4c-457a-b323-f57574916d30 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received unexpected event network-vif-plugged-1ebbf2bd-0d73-4374-a69e-0f0c3e018c85 for instance with vm_state building and task_state spawning.
Aug 14 18:17:39 user nova-compute[73078]: DEBUG nova.compute.manager [req-6371a9d9-b9b7-4fdd-b448-4c0e7d040220 req-7cfea5c0-cf0d-4e3d-9fca-45bf922950e4 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-plugged-dc245bed-0f7e-49a7-a6af-71072040d109 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6371a9d9-b9b7-4fdd-b448-4c0e7d040220 req-7cfea5c0-cf0d-4e3d-9fca-45bf922950e4 service nova] Acquiring lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6371a9d9-b9b7-4fdd-b448-4c0e7d040220 req-7cfea5c0-cf0d-4e3d-9fca-45bf922950e4 service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6371a9d9-b9b7-4fdd-b448-4c0e7d040220 req-7cfea5c0-cf0d-4e3d-9fca-45bf922950e4 service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:39 user nova-compute[73078]: DEBUG nova.compute.manager [req-6371a9d9-b9b7-4fdd-b448-4c0e7d040220 req-7cfea5c0-cf0d-4e3d-9fca-45bf922950e4 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] No waiting events found dispatching network-vif-plugged-dc245bed-0f7e-49a7-a6af-71072040d109 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:17:39 user nova-compute[73078]: WARNING nova.compute.manager [req-6371a9d9-b9b7-4fdd-b448-4c0e7d040220 req-7cfea5c0-cf0d-4e3d-9fca-45bf922950e4 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received unexpected event network-vif-plugged-dc245bed-0f7e-49a7-a6af-71072040d109 for instance with vm_state building and task_state spawning.
Aug 14 18:17:39 user nova-compute[73078]: DEBUG nova.compute.manager [req-6371a9d9-b9b7-4fdd-b448-4c0e7d040220 req-7cfea5c0-cf0d-4e3d-9fca-45bf922950e4 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-plugged-dc245bed-0f7e-49a7-a6af-71072040d109 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6371a9d9-b9b7-4fdd-b448-4c0e7d040220 req-7cfea5c0-cf0d-4e3d-9fca-45bf922950e4 service nova] Acquiring lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6371a9d9-b9b7-4fdd-b448-4c0e7d040220 req-7cfea5c0-cf0d-4e3d-9fca-45bf922950e4 service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6371a9d9-b9b7-4fdd-b448-4c0e7d040220 req-7cfea5c0-cf0d-4e3d-9fca-45bf922950e4 service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:39 user nova-compute[73078]: DEBUG nova.compute.manager [req-6371a9d9-b9b7-4fdd-b448-4c0e7d040220 req-7cfea5c0-cf0d-4e3d-9fca-45bf922950e4 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] No waiting events found dispatching network-vif-plugged-dc245bed-0f7e-49a7-a6af-71072040d109 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:17:39 user nova-compute[73078]: WARNING nova.compute.manager [req-6371a9d9-b9b7-4fdd-b448-4c0e7d040220 req-7cfea5c0-cf0d-4e3d-9fca-45bf922950e4 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received unexpected event network-vif-plugged-dc245bed-0f7e-49a7-a6af-71072040d109 for instance with vm_state building and task_state spawning.
Aug 14 18:17:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Removed pending event for de80e188-9385-4613-8a6c-aa72b624ad55 due to event {{(pid=73078) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 18:17:40 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037060.1359453, de80e188-9385-4613-8a6c-aa72b624ad55 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:17:40 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] VM Resumed (Lifecycle Event)
Aug 14 18:17:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-df1ec593-06ab-4343-9b54-8fe8b3229f83 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:17:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:17:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:17:40 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 18:17:40 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037060.1395688, de80e188-9385-4613-8a6c-aa72b624ad55 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:17:40 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] VM Started (Lifecycle Event)
Aug 14 18:17:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:17:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:17:40 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037060.655183, 83aca621-7182-49a9-b4b3-8f22dd50f869 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:17:40 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] VM Resumed (Lifecycle Event)
Aug 14 18:17:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:17:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:17:40 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Instance spawned successfully.
Aug 14 18:17:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:17:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:17:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:17:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:17:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:17:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:17:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:17:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:17:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:17:40 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:17:40 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037060.656954, 83aca621-7182-49a9-b4b3-8f22dd50f869 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:17:40 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] VM Started (Lifecycle Event)
Aug 14 18:17:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:17:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:17:40 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:17:40 user nova-compute[73078]: INFO nova.compute.manager [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Took 15.27 seconds to spawn the instance on the hypervisor.
Aug 14 18:17:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:17:40 user nova-compute[73078]: INFO nova.compute.manager [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Took 47.69 seconds to build instance.
Aug 14 18:17:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a231c685-6aa4-468e-bf36-c43b8386fade tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 48.027s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 42.663s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:41 user nova-compute[73078]: INFO nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Aug 14 18:17:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:45 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:17:45 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:17:45 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692037050.8564458, 8d257202-d8ab-4161-9b67-045cf1e36772 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:17:45 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] VM Stopped (Lifecycle Event)
Aug 14 18:17:45 user nova-compute[73078]: DEBUG nova.compute.manager [None req-12adb0ef-aa1b-4487-87c7-9dfa2b8fd616 None None] [instance: 8d257202-d8ab-4161-9b67-045cf1e36772] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:17:46 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:17:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:46 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:17:46 user nova-compute[73078]: DEBUG nova.compute.manager [req-f317a4a4-7574-420b-a5b4-f34f7cb9d31b req-37513ef2-a238-4c12-afea-315e713d92ea service nova] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Received event network-changed-74bc6a0e-0628-4482-be86-c53122e1363c {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:46 user nova-compute[73078]: DEBUG nova.compute.manager [req-f317a4a4-7574-420b-a5b4-f34f7cb9d31b req-37513ef2-a238-4c12-afea-315e713d92ea service nova] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Refreshing instance network info cache due to event network-changed-74bc6a0e-0628-4482-be86-c53122e1363c. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:17:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-f317a4a4-7574-420b-a5b4-f34f7cb9d31b req-37513ef2-a238-4c12-afea-315e713d92ea service nova] Acquiring lock "refresh_cache-90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:17:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-f317a4a4-7574-420b-a5b4-f34f7cb9d31b req-37513ef2-a238-4c12-afea-315e713d92ea service nova] Acquired lock "refresh_cache-90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:17:46 user nova-compute[73078]: DEBUG nova.network.neutron [req-f317a4a4-7574-420b-a5b4-f34f7cb9d31b req-37513ef2-a238-4c12-afea-315e713d92ea service nova] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Refreshing network info cache for port 74bc6a0e-0628-4482-be86-c53122e1363c {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:17:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:47 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692037052.3705232, 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:17:47 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] VM Stopped (Lifecycle Event)
Aug 14 18:17:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk --force-share --output=json" returned: 0 in 0.544s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:47 user nova-compute[73078]: DEBUG nova.compute.manager [None req-61550f04-b8af-4008-919a-0753b8e71939 None None] [instance: 10f9d4a9-ee3f-45bd-95e4-edd4819dcf30] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:17:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk --force-share --output=json" returned: 0 in 0.379s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:47 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:17:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7783c26e-ec61-4375-b191-0ce5caf766c7/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7783c26e-ec61-4375-b191-0ce5caf766c7/disk --force-share --output=json" returned: 0 in 0.447s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7783c26e-ec61-4375-b191-0ce5caf766c7/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:48 user nova-compute[73078]: DEBUG nova.network.neutron [req-f317a4a4-7574-420b-a5b4-f34f7cb9d31b req-37513ef2-a238-4c12-afea-315e713d92ea service nova] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Updated VIF entry in instance network info cache for port 74bc6a0e-0628-4482-be86-c53122e1363c. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:17:48 user nova-compute[73078]: DEBUG nova.network.neutron [req-f317a4a4-7574-420b-a5b4-f34f7cb9d31b req-37513ef2-a238-4c12-afea-315e713d92ea service nova] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Updating instance_info_cache with network_info: [{"id": "74bc6a0e-0628-4482-be86-c53122e1363c", "address": "fa:16:3e:f1:45:de", "network": {"id": "f600e59d-4edc-4daa-a017-629c89211580", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-604738940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b726267e2c49c69b843234bb761f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74bc6a0e-06", "ovs_interfaceid": "74bc6a0e-0628-4482-be86-c53122e1363c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:17:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-f317a4a4-7574-420b-a5b4-f34f7cb9d31b req-37513ef2-a238-4c12-afea-315e713d92ea service nova] Releasing lock "refresh_cache-90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:17:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7783c26e-ec61-4375-b191-0ce5caf766c7/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:49 user nova-compute[73078]: INFO nova.compute.manager [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Rebuilding instance
Aug 14 18:17:49 user nova-compute[73078]: DEBUG nova.objects.instance [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lazy-loading 'trusted_certs' on Instance uuid 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:17:49 user nova-compute[73078]: DEBUG nova.compute.manager [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:17:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:17:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:49 user nova-compute[73078]: DEBUG nova.objects.instance [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lazy-loading 'pci_requests' on Instance uuid 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:17:49 user nova-compute[73078]: DEBUG nova.objects.instance [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lazy-loading 'pci_devices' on Instance uuid 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:17:49 user nova-compute[73078]: DEBUG nova.objects.instance [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lazy-loading 'resources' on Instance uuid 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:17:49 user nova-compute[73078]: DEBUG nova.objects.instance [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lazy-loading 'migration_context' on Instance uuid 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:17:49 user nova-compute[73078]: DEBUG nova.objects.instance [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73078) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 14 18:17:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json" returned: 0 in 0.317s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json" returned: 0 in 0.346s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json" returned: 0 in 0.278s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG nova.compute.manager [req-e9d5cbf5-f07b-4c22-b6ec-b798d4cb359e req-e2ca2a94-024c-41ba-832c-2fd51fd4ff7e service nova] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Received event network-vif-unplugged-74bc6a0e-0628-4482-be86-c53122e1363c {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e9d5cbf5-f07b-4c22-b6ec-b798d4cb359e req-e2ca2a94-024c-41ba-832c-2fd51fd4ff7e service nova] Acquiring lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e9d5cbf5-f07b-4c22-b6ec-b798d4cb359e req-e2ca2a94-024c-41ba-832c-2fd51fd4ff7e service nova] Lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e9d5cbf5-f07b-4c22-b6ec-b798d4cb359e req-e2ca2a94-024c-41ba-832c-2fd51fd4ff7e service nova] Lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG nova.compute.manager [req-e9d5cbf5-f07b-4c22-b6ec-b798d4cb359e req-e2ca2a94-024c-41ba-832c-2fd51fd4ff7e service nova] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] No waiting events found dispatching network-vif-unplugged-74bc6a0e-0628-4482-be86-c53122e1363c {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:17:50 user nova-compute[73078]: WARNING nova.compute.manager [req-e9d5cbf5-f07b-4c22-b6ec-b798d4cb359e req-e2ca2a94-024c-41ba-832c-2fd51fd4ff7e service nova] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Received unexpected event network-vif-unplugged-74bc6a0e-0628-4482-be86-c53122e1363c for instance with vm_state active and task_state rebuilding.
Aug 14 18:17:50 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Instance destroyed successfully.
Aug 14 18:17:50 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Instance destroyed successfully.
Aug 14 18:17:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:15:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1987059253',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1497637679',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtJLJQBmgtrDyTBUJe8Q/tiHCzjGEVBxUbvCC7nYOmxztS2QanKQLBPdwFwQyvsPRy+jAfMiHcGMYRvHIAt2urg9izZdbJETz7dtqMJlhiy41t8tSflk18DOHtZARdHFg==',key_name='tempest-keypair-499236215',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:16:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c4b726267e2c49c69b843234bb761f06',ramdisk_id='',reservation_id='r-2u1e60fu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1368753977',owner_user_name='tempest-ServerActionsV293TestJSON-1368753977-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a3800a849fa4c199373454d92aada0a',uuid=90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74bc6a0e-0628-4482-be86-c53122e1363c", "address": "fa:16:3e:f1:45:de", "network": {"id": "f600e59d-4edc-4daa-a017-629c89211580", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-604738940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b726267e2c49c69b843234bb761f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74bc6a0e-06", "ovs_interfaceid": "74bc6a0e-0628-4482-be86-c53122e1363c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Converting VIF {"id": "74bc6a0e-0628-4482-be86-c53122e1363c", "address": "fa:16:3e:f1:45:de", "network": {"id": "f600e59d-4edc-4daa-a017-629c89211580", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-604738940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b726267e2c49c69b843234bb761f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74bc6a0e-06", "ovs_interfaceid": "74bc6a0e-0628-4482-be86-c53122e1363c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:45:de,bridge_name='br-int',has_traffic_filtering=True,id=74bc6a0e-0628-4482-be86-c53122e1363c,network=Network(f600e59d-4edc-4daa-a017-629c89211580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74bc6a0e-06') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG os_vif [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:45:de,bridge_name='br-int',has_traffic_filtering=True,id=74bc6a0e-0628-4482-be86-c53122e1363c,network=Network(f600e59d-4edc-4daa-a017-629c89211580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74bc6a0e-06') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74bc6a0e-06, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:17:50 user nova-compute[73078]: INFO os_vif [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:45:de,bridge_name='br-int',has_traffic_filtering=True,id=74bc6a0e-0628-4482-be86-c53122e1363c,network=Network(f600e59d-4edc-4daa-a017-629c89211580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74bc6a0e-06')
Aug 14 18:17:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgcyazBh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:17:50 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 18:17:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json" returned: 0 in 0.255s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.068s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f53711e-87fb-4e36-aa4b-10dce266c296]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1459c4a3-1e74-4a91-8bee-9475ac4a7d56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafb74cf-1690-42a2-ba52-c6c2f977f1a6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1459c4a3-1e74-4a91-8bee-9475ac4a7d56 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:17:50 user nova-compute[73078]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:17:50 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:17:50 user nova-compute[73078]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)
Aug 14 18:17:50 user nova-compute[73078]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)
Aug 14 18:17:50 user nova-compute[73078]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)
Aug 14 18:17:50 user nova-compute[73078]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1459c4a3-1e74-4a91-8bee-9475ac4a7d56 (non-flash)
Aug 14 18:17:50 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:17:50 user nova-compute[73078]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:17:50 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:17:50 user nova-compute[73078]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)
Aug 14 18:17:50 user nova-compute[73078]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)
Aug 14 18:17:50 user nova-compute[73078]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)
Aug 14 18:17:50 user nova-compute[73078]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1459c4a3-1e74-4a91-8bee-9475ac4a7d56 (non-flash)
Aug 14 18:17:50 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe99373e290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a'): ({'sdd'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Removing single pathed devices sdd {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb47fe7-3cbc-4a28-8768-d0e16c2ef707]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.057s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed7eaa7-ae66-412e-9222-ea994fa1f3e8]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Flushing IO for device /dev/sdd {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.029s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8a0a96-20c8-43b7-a88b-8f5f5669e3a0]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.079s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b27059-47da-4337-8c8f-bd03e065dfa2]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] SCSI volumes sdd have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa2e10e-eccf-4cd2-a408-d80d778ebb9a]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --logout" returned: 0 in 0.103s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bf6b1e-77fd-4abf-a6a5-d39f408f79d1]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a, portal: 172.16.0.220,3260]
Aug 14 18:17:50 user nova-compute[73078]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a, portal: 172.16.0.220,3260] successful.
Aug 14 18:17:50 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d82c702-2814-4f87-a87d-05f9a8a9c8cc]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:17:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.576s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:17:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] <== disconnect_volume: return (578ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:17:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:17:51 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Deleting instance files /opt/stack/data/nova/instances/90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c_del
Aug 14 18:17:51 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Deletion of /opt/stack/data/nova/instances/90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c_del complete
Aug 14 18:17:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:51 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c could not be found.
Aug 14 18:17:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:17:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgcyazBh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:17:51 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 18:17:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:17:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:17:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:17:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:51 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f3c3e7-eb23-493c-a605-689e049dc420]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1459c4a3-1e74-4a91-8bee-9475ac4a7d56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:51 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[790d5cb4-b8fd-41a3-9037-863b9f595814]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1459c4a3-1e74-4a91-8bee-9475ac4a7d56 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:17:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:17:51 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:17:51 user nova-compute[73078]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)
Aug 14 18:17:51 user nova-compute[73078]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)
Aug 14 18:17:51 user nova-compute[73078]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)
Aug 14 18:17:51 user nova-compute[73078]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1459c4a3-1e74-4a91-8bee-9475ac4a7d56 (non-flash)
Aug 14 18:17:51 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:17:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:17:51 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:17:51 user nova-compute[73078]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)
Aug 14 18:17:51 user nova-compute[73078]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)
Aug 14 18:17:51 user nova-compute[73078]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)
Aug 14 18:17:51 user nova-compute[73078]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1459c4a3-1e74-4a91-8bee-9475ac4a7d56 (non-flash)
Aug 14 18:17:51 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:17:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe97879e320>, {}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:17:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Disconnecting from: [] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:17:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.105s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:17:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] <== disconnect_volume: return (107ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:17:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:17:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:17:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:17:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:17:51 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Error from libvirt while getting description of instance-00000011: [Error Code 42] Domain not found: no domain with matching uuid '90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c' (instance-00000011): libvirt.libvirtError: Domain not found: no domain with matching uuid '90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c' (instance-00000011)
Aug 14 18:17:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:52 user nova-compute[73078]: DEBUG nova.compute.manager [req-1f9ecdcf-3037-4161-97e1-2455729e72c3 req-034b2320-0546-4a04-80cc-ee3f6263fc4f service nova] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Received event network-vif-plugged-74bc6a0e-0628-4482-be86-c53122e1363c {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1f9ecdcf-3037-4161-97e1-2455729e72c3 req-034b2320-0546-4a04-80cc-ee3f6263fc4f service nova] Acquiring lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1f9ecdcf-3037-4161-97e1-2455729e72c3 req-034b2320-0546-4a04-80cc-ee3f6263fc4f service nova] Lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1f9ecdcf-3037-4161-97e1-2455729e72c3 req-034b2320-0546-4a04-80cc-ee3f6263fc4f service nova] Lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:52 user nova-compute[73078]: DEBUG nova.compute.manager [req-1f9ecdcf-3037-4161-97e1-2455729e72c3 req-034b2320-0546-4a04-80cc-ee3f6263fc4f service nova] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] No waiting events found dispatching network-vif-plugged-74bc6a0e-0628-4482-be86-c53122e1363c {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:17:52 user nova-compute[73078]: WARNING nova.compute.manager [req-1f9ecdcf-3037-4161-97e1-2455729e72c3 req-034b2320-0546-4a04-80cc-ee3f6263fc4f service nova] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Received unexpected event network-vif-plugged-74bc6a0e-0628-4482-be86-c53122e1363c for instance with vm_state active and task_state rebuilding.
Aug 14 18:17:52 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:17:52 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:17:52 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=7362MB free_disk=25.325454711914062GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:17:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:52 user nova-compute[73078]: DEBUG nova.compute.manager [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Preparing to wait for external event volume-reimaged-d77e8c78-bb17-42b5-a3cd-19258651c57a {{(pid=73078) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 14 18:17:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Acquiring lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:52 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance de80e188-9385-4613-8a6c-aa72b624ad55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:17:52 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 1f88cb97-4f22-439e-99f2-d7cb8d5aff36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:17:52 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 3c840309-9884-4c8a-a6ee-1acd44f32c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:17:52 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:17:52 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 24c00db3-2457-443d-b5ab-7e6ecaa57515 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:17:52 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:17:52 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance ea445c0c-e5a1-4e24-8008-2cd64a679f34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:17:52 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 7783c26e-ec61-4375-b191-0ce5caf766c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:17:52 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 83aca621-7182-49a9-b4b3-8f22dd50f869 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:17:52 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:17:52 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:17:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:53 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:17:53 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:17:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:17:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.740s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:54 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:17:54 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:17:54 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:17:54 user nova-compute[73078]: DEBUG nova.compute.manager [req-539ac5b5-77ec-46ce-ac2a-de7a58f3e9fe req-a3a2ecbc-ec4b-4254-9e11-874d6ea70ab2 service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Received event network-changed-3a008b18-c1c3-4656-9ada-f437888cdee6 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:54 user nova-compute[73078]: DEBUG nova.compute.manager [req-539ac5b5-77ec-46ce-ac2a-de7a58f3e9fe req-a3a2ecbc-ec4b-4254-9e11-874d6ea70ab2 service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Refreshing instance network info cache due to event network-changed-3a008b18-c1c3-4656-9ada-f437888cdee6. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:17:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-539ac5b5-77ec-46ce-ac2a-de7a58f3e9fe req-a3a2ecbc-ec4b-4254-9e11-874d6ea70ab2 service nova] Acquiring lock "refresh_cache-ea445c0c-e5a1-4e24-8008-2cd64a679f34" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:17:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-539ac5b5-77ec-46ce-ac2a-de7a58f3e9fe req-a3a2ecbc-ec4b-4254-9e11-874d6ea70ab2 service nova] Acquired lock "refresh_cache-ea445c0c-e5a1-4e24-8008-2cd64a679f34" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:17:54 user nova-compute[73078]: DEBUG nova.network.neutron [req-539ac5b5-77ec-46ce-ac2a-de7a58f3e9fe req-a3a2ecbc-ec4b-4254-9e11-874d6ea70ab2 service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Refreshing network info cache for port 3a008b18-c1c3-4656-9ada-f437888cdee6 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:17:54 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Didn't find any instances for network info cache update. {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 18:17:54 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:17:54 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:17:54 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:17:54 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:17:54 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:17:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Acquiring lock "e812037c-a0ef-4e60-9041-b382087dc2c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Lock "e812037c-a0ef-4e60-9041-b382087dc2c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:54 user nova-compute[73078]: DEBUG nova.compute.manager [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:17:54 user nova-compute[73078]: DEBUG nova.compute.manager [None req-64b6ec49-7021-4d05-801d-23863af74fdb tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:17:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:54 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:17:54 user nova-compute[73078]: INFO nova.compute.claims [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Claim successful on node user
Aug 14 18:17:54 user nova-compute[73078]: INFO nova.compute.manager [None req-64b6ec49-7021-4d05-801d-23863af74fdb tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] instance snapshotting
Aug 14 18:17:54 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-64b6ec49-7021-4d05-801d-23863af74fdb tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Beginning live snapshot process
Aug 14 18:17:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-64b6ec49-7021-4d05-801d-23863af74fdb tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk --force-share --output=json -f qcow2 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:55 user nova-compute[73078]: DEBUG nova.network.neutron [req-539ac5b5-77ec-46ce-ac2a-de7a58f3e9fe req-a3a2ecbc-ec4b-4254-9e11-874d6ea70ab2 service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Updated VIF entry in instance network info cache for port 3a008b18-c1c3-4656-9ada-f437888cdee6. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:17:55 user nova-compute[73078]: DEBUG nova.network.neutron [req-539ac5b5-77ec-46ce-ac2a-de7a58f3e9fe req-a3a2ecbc-ec4b-4254-9e11-874d6ea70ab2 service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Updating instance_info_cache with network_info: [{"id": "3a008b18-c1c3-4656-9ada-f437888cdee6", "address": "fa:16:3e:a3:fb:e1", "network": {"id": "45b49a52-f99e-437a-aa8d-440f4f6b1099", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1520302261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9a739612a674c5c82fad631a64c57ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a008b18-c1", "ovs_interfaceid": "3a008b18-c1c3-4656-9ada-f437888cdee6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:17:55 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:17:55 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:17:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-539ac5b5-77ec-46ce-ac2a-de7a58f3e9fe req-a3a2ecbc-ec4b-4254-9e11-874d6ea70ab2 service nova] Releasing lock "refresh_cache-ea445c0c-e5a1-4e24-8008-2cd64a679f34" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:17:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.655s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:55 user nova-compute[73078]: DEBUG nova.compute.manager [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:17:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-64b6ec49-7021-4d05-801d-23863af74fdb tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk --force-share --output=json -f qcow2" returned: 0 in 0.262s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-64b6ec49-7021-4d05-801d-23863af74fdb tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk --force-share --output=json -f qcow2 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:55 user nova-compute[73078]: DEBUG nova.compute.manager [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:17:55 user nova-compute[73078]: DEBUG nova.network.neutron [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:17:55 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:17:55 user nova-compute[73078]: DEBUG nova.compute.manager [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:17:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-64b6ec49-7021-4d05-801d-23863af74fdb tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk --force-share --output=json -f qcow2" returned: 0 in 0.239s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-64b6ec49-7021-4d05-801d-23863af74fdb tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:55 user nova-compute[73078]: DEBUG nova.policy [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a04504b65e2645c58456ea8aab0af822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f664e2a18ee487bb2d32fbe1619a7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:17:55 user nova-compute[73078]: DEBUG nova.compute.manager [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:17:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:17:55 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Creating image(s)
Aug 14 18:17:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Acquiring lock "/opt/stack/data/nova/instances/e812037c-a0ef-4e60-9041-b382087dc2c5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Lock "/opt/stack/data/nova/instances/e812037c-a0ef-4e60-9041-b382087dc2c5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Lock "/opt/stack/data/nova/instances/e812037c-a0ef-4e60-9041-b382087dc2c5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-64b6ec49-7021-4d05-801d-23863af74fdb tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.259s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-64b6ec49-7021-4d05-801d-23863af74fdb tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5pmcab1b/114f1917ae9545519390ab2dbf3d1c48.delta 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-64b6ec49-7021-4d05-801d-23863af74fdb tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5pmcab1b/114f1917ae9545519390ab2dbf3d1c48.delta 1073741824" returned: 0 in 0.083s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:56 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-64b6ec49-7021-4d05-801d-23863af74fdb tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 14 18:17:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.279s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.273s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/e812037c-a0ef-4e60-9041-b382087dc2c5/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/e812037c-a0ef-4e60-9041-b382087dc2c5/disk 1073741824" returned: 0 in 0.065s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.346s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.224s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:56 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e812037c-a0ef-4e60-9041-b382087dc2c5/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:17:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e812037c-a0ef-4e60-9041-b382087dc2c5/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:56 user nova-compute[73078]: DEBUG nova.network.neutron [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Successfully created port: c581b8a4-7109-4251-a895-680f7487276f {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:17:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e812037c-a0ef-4e60-9041-b382087dc2c5/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:56 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Cannot resize image /opt/stack/data/nova/instances/e812037c-a0ef-4e60-9041-b382087dc2c5/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:17:56 user nova-compute[73078]: DEBUG nova.objects.instance [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Lazy-loading 'migration_context' on Instance uuid e812037c-a0ef-4e60-9041-b382087dc2c5 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:17:56 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:17:56 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Ensure instance console log exists: /opt/stack/data/nova/instances/e812037c-a0ef-4e60-9041-b382087dc2c5/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:17:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:17:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:17:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:17:57 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-64b6ec49-7021-4d05-801d-23863af74fdb tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=73078) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 18:17:57 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-64b6ec49-7021-4d05-801d-23863af74fdb tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] COPY block job progress, current cursor: 21692416 final cursor: 75563008 {{(pid=73078) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 18:17:57 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG nova.network.neutron [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Successfully updated port: c581b8a4-7109-4251-a895-680f7487276f {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-64b6ec49-7021-4d05-801d-23863af74fdb tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73078) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 18:17:58 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-64b6ec49-7021-4d05-801d-23863af74fdb tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 18:17:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Acquiring lock "refresh_cache-e812037c-a0ef-4e60-9041-b382087dc2c5" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Acquired lock "refresh_cache-e812037c-a0ef-4e60-9041-b382087dc2c5" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG nova.network.neutron [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG nova.compute.manager [req-de3d5f04-f071-4b24-a864-a67fdcc48ef4 req-f5a775c0-9ea6-46cc-bc20-03f6d0c237c8 service nova] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Received event network-changed-c581b8a4-7109-4251-a895-680f7487276f {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG nova.compute.manager [req-de3d5f04-f071-4b24-a864-a67fdcc48ef4 req-f5a775c0-9ea6-46cc-bc20-03f6d0c237c8 service nova] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Refreshing instance network info cache due to event network-changed-c581b8a4-7109-4251-a895-680f7487276f. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-de3d5f04-f071-4b24-a864-a67fdcc48ef4 req-f5a775c0-9ea6-46cc-bc20-03f6d0c237c8 service nova] Acquiring lock "refresh_cache-e812037c-a0ef-4e60-9041-b382087dc2c5" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG nova.network.neutron [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG nova.privsep.utils [None req-64b6ec49-7021-4d05-801d-23863af74fdb tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73078) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-64b6ec49-7021-4d05-801d-23863af74fdb tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5pmcab1b/114f1917ae9545519390ab2dbf3d1c48.delta /opt/stack/data/nova/instances/snapshots/tmp5pmcab1b/114f1917ae9545519390ab2dbf3d1c48 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG nova.network.neutron [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Updating instance_info_cache with network_info: [{"id": "c581b8a4-7109-4251-a895-680f7487276f", "address": "fa:16:3e:c2:99:c4", "network": {"id": "3657c542-8f13-46f0-82ca-76abc904eaee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1405653250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f664e2a18ee487bb2d32fbe1619a7e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc581b8a4-71", "ovs_interfaceid": "c581b8a4-7109-4251-a895-680f7487276f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Releasing lock "refresh_cache-e812037c-a0ef-4e60-9041-b382087dc2c5" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG nova.compute.manager [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Instance network_info: |[{"id": "c581b8a4-7109-4251-a895-680f7487276f", "address": "fa:16:3e:c2:99:c4", "network": {"id": "3657c542-8f13-46f0-82ca-76abc904eaee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1405653250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f664e2a18ee487bb2d32fbe1619a7e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc581b8a4-71", "ovs_interfaceid": "c581b8a4-7109-4251-a895-680f7487276f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-de3d5f04-f071-4b24-a864-a67fdcc48ef4 req-f5a775c0-9ea6-46cc-bc20-03f6d0c237c8 service nova] Acquired lock "refresh_cache-e812037c-a0ef-4e60-9041-b382087dc2c5" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG nova.network.neutron [req-de3d5f04-f071-4b24-a864-a67fdcc48ef4 req-f5a775c0-9ea6-46cc-bc20-03f6d0c237c8 service nova] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Refreshing network info cache for port c581b8a4-7109-4251-a895-680f7487276f {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Start _get_guest_xml network_info=[{"id": "c581b8a4-7109-4251-a895-680f7487276f", "address": "fa:16:3e:c2:99:c4", "network": {"id": "3657c542-8f13-46f0-82ca-76abc904eaee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1405653250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f664e2a18ee487bb2d32fbe1619a7e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc581b8a4-71", "ovs_interfaceid": "c581b8a4-7109-4251-a895-680f7487276f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:17:58 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:17:58 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:17:58 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1371061164',display_name='tempest-VolumesActionsTest-instance-1371061164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1371061164',id=21,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f664e2a18ee487bb2d32fbe1619a7e5',ramdisk_id='',reservation_id='r-100zk8oa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1407236132',owner_user_name='tempest-VolumesActionsTest-1407236132-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:17:56Z,user_data=None,user_id='a04504b65e2645c58456ea8aab0af822',uuid=e812037c-a0ef-4e60-9041-b382087dc2c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c581b8a4-7109-4251-a895-680f7487276f", "address": "fa:16:3e:c2:99:c4", "network": {"id": "3657c542-8f13-46f0-82ca-76abc904eaee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1405653250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f664e2a18ee487bb2d32fbe1619a7e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc581b8a4-71", "ovs_interfaceid": "c581b8a4-7109-4251-a895-680f7487276f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Converting VIF {"id": "c581b8a4-7109-4251-a895-680f7487276f", "address": "fa:16:3e:c2:99:c4", "network": {"id": "3657c542-8f13-46f0-82ca-76abc904eaee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1405653250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f664e2a18ee487bb2d32fbe1619a7e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc581b8a4-71", "ovs_interfaceid": "c581b8a4-7109-4251-a895-680f7487276f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:99:c4,bridge_name='br-int',has_traffic_filtering=True,id=c581b8a4-7109-4251-a895-680f7487276f,network=Network(3657c542-8f13-46f0-82ca-76abc904eaee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc581b8a4-71') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG nova.objects.instance [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Lazy-loading 'pci_devices' on Instance uuid e812037c-a0ef-4e60-9041-b382087dc2c5 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:17:58 user nova-compute[73078]:   <uuid>e812037c-a0ef-4e60-9041-b382087dc2c5</uuid>
Aug 14 18:17:58 user nova-compute[73078]:   <name>instance-00000015</name>
Aug 14 18:17:58 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:17:58 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:17:58 user nova-compute[73078]:   <metadata>
Aug 14 18:17:58 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:17:58 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:17:58 user nova-compute[73078]:       <nova:name>tempest-VolumesActionsTest-instance-1371061164</nova:name>
Aug 14 18:17:58 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:17:58</nova:creationTime>
Aug 14 18:17:58 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:17:58 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:17:58 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:17:58 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:17:58 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:17:58 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:17:58 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:17:58 user nova-compute[73078]:       <nova:owner>
Aug 14 18:17:58 user nova-compute[73078]:         <nova:user uuid="a04504b65e2645c58456ea8aab0af822">tempest-VolumesActionsTest-1407236132-project-member</nova:user>
Aug 14 18:17:58 user nova-compute[73078]:         <nova:project uuid="5f664e2a18ee487bb2d32fbe1619a7e5">tempest-VolumesActionsTest-1407236132</nova:project>
Aug 14 18:17:58 user nova-compute[73078]:       </nova:owner>
Aug 14 18:17:58 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:17:58 user nova-compute[73078]:       <nova:ports>
Aug 14 18:17:58 user nova-compute[73078]:         <nova:port uuid="c581b8a4-7109-4251-a895-680f7487276f">
Aug 14 18:17:58 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 18:17:58 user nova-compute[73078]:         </nova:port>
Aug 14 18:17:58 user nova-compute[73078]:       </nova:ports>
Aug 14 18:17:58 user nova-compute[73078]:     </nova:instance>
Aug 14 18:17:58 user nova-compute[73078]:   </metadata>
Aug 14 18:17:58 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:17:58 user nova-compute[73078]:     <system>
Aug 14 18:17:58 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:17:58 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:17:58 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:17:58 user nova-compute[73078]:       <entry name="serial">e812037c-a0ef-4e60-9041-b382087dc2c5</entry>
Aug 14 18:17:58 user nova-compute[73078]:       <entry name="uuid">e812037c-a0ef-4e60-9041-b382087dc2c5</entry>
Aug 14 18:17:58 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:17:58 user nova-compute[73078]:     </system>
Aug 14 18:17:58 user nova-compute[73078]:   </sysinfo>
Aug 14 18:17:58 user nova-compute[73078]:   <os>
Aug 14 18:17:58 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:17:58 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:17:58 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:17:58 user nova-compute[73078]:   </os>
Aug 14 18:17:58 user nova-compute[73078]:   <features>
Aug 14 18:17:58 user nova-compute[73078]:     <acpi/>
Aug 14 18:17:58 user nova-compute[73078]:     <apic/>
Aug 14 18:17:58 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:17:58 user nova-compute[73078]:   </features>
Aug 14 18:17:58 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:17:58 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:17:58 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:17:58 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:17:58 user nova-compute[73078]:   </clock>
Aug 14 18:17:58 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:17:58 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:17:58 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:17:58 user nova-compute[73078]:   </cpu>
Aug 14 18:17:58 user nova-compute[73078]:   <devices>
Aug 14 18:17:58 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:17:58 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:17:58 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/e812037c-a0ef-4e60-9041-b382087dc2c5/disk"/>
Aug 14 18:17:58 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:17:58 user nova-compute[73078]:     </disk>
Aug 14 18:17:58 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:17:58 user nova-compute[73078]:       <mac address="fa:16:3e:c2:99:c4"/>
Aug 14 18:17:58 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:17:58 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:17:58 user nova-compute[73078]:       <target dev="tapc581b8a4-71"/>
Aug 14 18:17:58 user nova-compute[73078]:     </interface>
Aug 14 18:17:58 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:17:58 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/e812037c-a0ef-4e60-9041-b382087dc2c5/console.log" append="off"/>
Aug 14 18:17:58 user nova-compute[73078]:     </serial>
Aug 14 18:17:58 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:17:58 user nova-compute[73078]:     <video>
Aug 14 18:17:58 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:17:58 user nova-compute[73078]:     </video>
Aug 14 18:17:58 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:17:58 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:17:58 user nova-compute[73078]:     </rng>
Aug 14 18:17:58 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:17:58 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:17:58 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:17:58 user nova-compute[73078]:     </memballoon>
Aug 14 18:17:58 user nova-compute[73078]:   </devices>
Aug 14 18:17:58 user nova-compute[73078]: </domain>
Aug 14 18:17:58 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1371061164',display_name='tempest-VolumesActionsTest-instance-1371061164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1371061164',id=21,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f664e2a18ee487bb2d32fbe1619a7e5',ramdisk_id='',reservation_id='r-100zk8oa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1407236132',owner_user_name='tempest-VolumesActionsTest-1407236132-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:17:56Z,user_data=None,user_id='a04504b65e2645c58456ea8aab0af822',uuid=e812037c-a0ef-4e60-9041-b382087dc2c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c581b8a4-7109-4251-a895-680f7487276f", "address": "fa:16:3e:c2:99:c4", "network": {"id": "3657c542-8f13-46f0-82ca-76abc904eaee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1405653250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f664e2a18ee487bb2d32fbe1619a7e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc581b8a4-71", "ovs_interfaceid": "c581b8a4-7109-4251-a895-680f7487276f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Converting VIF {"id": "c581b8a4-7109-4251-a895-680f7487276f", "address": "fa:16:3e:c2:99:c4", "network": {"id": "3657c542-8f13-46f0-82ca-76abc904eaee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1405653250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f664e2a18ee487bb2d32fbe1619a7e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc581b8a4-71", "ovs_interfaceid": "c581b8a4-7109-4251-a895-680f7487276f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:99:c4,bridge_name='br-int',has_traffic_filtering=True,id=c581b8a4-7109-4251-a895-680f7487276f,network=Network(3657c542-8f13-46f0-82ca-76abc904eaee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc581b8a4-71') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG os_vif [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:99:c4,bridge_name='br-int',has_traffic_filtering=True,id=c581b8a4-7109-4251-a895-680f7487276f,network=Network(3657c542-8f13-46f0-82ca-76abc904eaee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc581b8a4-71') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc581b8a4-71, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc581b8a4-71, col_values=(('external_ids', {'iface-id': 'c581b8a4-7109-4251-a895-680f7487276f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:99:c4', 'vm-uuid': 'e812037c-a0ef-4e60-9041-b382087dc2c5'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:17:58 user nova-compute[73078]: INFO os_vif [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:99:c4,bridge_name='br-int',has_traffic_filtering=True,id=c581b8a4-7109-4251-a895-680f7487276f,network=Network(3657c542-8f13-46f0-82ca-76abc904eaee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc581b8a4-71')
Aug 14 18:17:58 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:17:58 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] No VIF found with MAC fa:16:3e:c2:99:c4, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:17:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-64b6ec49-7021-4d05-801d-23863af74fdb tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5pmcab1b/114f1917ae9545519390ab2dbf3d1c48.delta /opt/stack/data/nova/instances/snapshots/tmp5pmcab1b/114f1917ae9545519390ab2dbf3d1c48" returned: 0 in 1.130s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:17:59 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-64b6ec49-7021-4d05-801d-23863af74fdb tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Snapshot extracted, beginning image upload
Aug 14 18:17:59 user nova-compute[73078]: DEBUG nova.network.neutron [req-de3d5f04-f071-4b24-a864-a67fdcc48ef4 req-f5a775c0-9ea6-46cc-bc20-03f6d0c237c8 service nova] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Updated VIF entry in instance network info cache for port c581b8a4-7109-4251-a895-680f7487276f. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:17:59 user nova-compute[73078]: DEBUG nova.network.neutron [req-de3d5f04-f071-4b24-a864-a67fdcc48ef4 req-f5a775c0-9ea6-46cc-bc20-03f6d0c237c8 service nova] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Updating instance_info_cache with network_info: [{"id": "c581b8a4-7109-4251-a895-680f7487276f", "address": "fa:16:3e:c2:99:c4", "network": {"id": "3657c542-8f13-46f0-82ca-76abc904eaee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1405653250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f664e2a18ee487bb2d32fbe1619a7e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc581b8a4-71", "ovs_interfaceid": "c581b8a4-7109-4251-a895-680f7487276f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:17:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-de3d5f04-f071-4b24-a864-a67fdcc48ef4 req-f5a775c0-9ea6-46cc-bc20-03f6d0c237c8 service nova] Releasing lock "refresh_cache-e812037c-a0ef-4e60-9041-b382087dc2c5" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:18:00 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:00 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:00 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:01 user nova-compute[73078]: DEBUG nova.compute.manager [req-36f48117-8638-4e9b-9b60-5b8de213fdea req-d694b0e7-92e8-4f82-90fd-7d8fc789b6af service nova] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Received event network-vif-plugged-c581b8a4-7109-4251-a895-680f7487276f {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:18:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-36f48117-8638-4e9b-9b60-5b8de213fdea req-d694b0e7-92e8-4f82-90fd-7d8fc789b6af service nova] Acquiring lock "e812037c-a0ef-4e60-9041-b382087dc2c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-36f48117-8638-4e9b-9b60-5b8de213fdea req-d694b0e7-92e8-4f82-90fd-7d8fc789b6af service nova] Lock "e812037c-a0ef-4e60-9041-b382087dc2c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-36f48117-8638-4e9b-9b60-5b8de213fdea req-d694b0e7-92e8-4f82-90fd-7d8fc789b6af service nova] Lock "e812037c-a0ef-4e60-9041-b382087dc2c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:01 user nova-compute[73078]: DEBUG nova.compute.manager [req-36f48117-8638-4e9b-9b60-5b8de213fdea req-d694b0e7-92e8-4f82-90fd-7d8fc789b6af service nova] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] No waiting events found dispatching network-vif-plugged-c581b8a4-7109-4251-a895-680f7487276f {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:18:01 user nova-compute[73078]: WARNING nova.compute.manager [req-36f48117-8638-4e9b-9b60-5b8de213fdea req-d694b0e7-92e8-4f82-90fd-7d8fc789b6af service nova] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Received unexpected event network-vif-plugged-c581b8a4-7109-4251-a895-680f7487276f for instance with vm_state building and task_state spawning.
Aug 14 18:18:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:03 user nova-compute[73078]: DEBUG nova.compute.manager [req-78ac5c2e-b443-4c18-8682-f159d7959b5c req-1bcdc145-acbb-44bb-80f0-233a8a0bd97c service nova] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Received event network-vif-plugged-c581b8a4-7109-4251-a895-680f7487276f {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:18:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-78ac5c2e-b443-4c18-8682-f159d7959b5c req-1bcdc145-acbb-44bb-80f0-233a8a0bd97c service nova] Acquiring lock "e812037c-a0ef-4e60-9041-b382087dc2c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-78ac5c2e-b443-4c18-8682-f159d7959b5c req-1bcdc145-acbb-44bb-80f0-233a8a0bd97c service nova] Lock "e812037c-a0ef-4e60-9041-b382087dc2c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-78ac5c2e-b443-4c18-8682-f159d7959b5c req-1bcdc145-acbb-44bb-80f0-233a8a0bd97c service nova] Lock "e812037c-a0ef-4e60-9041-b382087dc2c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:03 user nova-compute[73078]: DEBUG nova.compute.manager [req-78ac5c2e-b443-4c18-8682-f159d7959b5c req-1bcdc145-acbb-44bb-80f0-233a8a0bd97c service nova] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] No waiting events found dispatching network-vif-plugged-c581b8a4-7109-4251-a895-680f7487276f {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:18:03 user nova-compute[73078]: WARNING nova.compute.manager [req-78ac5c2e-b443-4c18-8682-f159d7959b5c req-1bcdc145-acbb-44bb-80f0-233a8a0bd97c service nova] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Received unexpected event network-vif-plugged-c581b8a4-7109-4251-a895-680f7487276f for instance with vm_state building and task_state spawning.
Aug 14 18:18:03 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-64b6ec49-7021-4d05-801d-23863af74fdb tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Snapshot image upload complete
Aug 14 18:18:03 user nova-compute[73078]: INFO nova.compute.manager [None req-64b6ec49-7021-4d05-801d-23863af74fdb tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Took 8.41 seconds to snapshot the instance on the hypervisor.
Aug 14 18:18:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:04 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037084.03619, e812037c-a0ef-4e60-9041-b382087dc2c5 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:18:04 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] VM Resumed (Lifecycle Event)
Aug 14 18:18:04 user nova-compute[73078]: DEBUG nova.compute.manager [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:18:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:18:04 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Instance spawned successfully.
Aug 14 18:18:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:18:04 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:18:04 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:18:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:18:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:18:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:18:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:18:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:18:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:18:04 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:18:04 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037084.036595, e812037c-a0ef-4e60-9041-b382087dc2c5 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:18:04 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] VM Started (Lifecycle Event)
Aug 14 18:18:04 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:18:04 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:18:04 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:18:04 user nova-compute[73078]: INFO nova.compute.manager [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Took 8.44 seconds to spawn the instance on the hypervisor.
Aug 14 18:18:04 user nova-compute[73078]: DEBUG nova.compute.manager [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:18:04 user nova-compute[73078]: INFO nova.compute.manager [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Took 9.60 seconds to build instance.
Aug 14 18:18:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ac8e4501-89e5-4d9e-9c9c-31f5bc6defd7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Lock "e812037c-a0ef-4e60-9041-b382087dc2c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.869s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:05 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692037070.2855737, 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:18:05 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] VM Stopped (Lifecycle Event)
Aug 14 18:18:05 user nova-compute[73078]: DEBUG nova.compute.manager [None req-91472a6e-8d87-41ab-8387-22f9bc650d08 None None] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:18:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:15 user nova-compute[73078]: DEBUG nova.compute.manager [req-97813158-06c6-4259-80c5-7c4054837227 req-a4d5b510-1c41-4755-9f5f-618b566bab06 service nova] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Received event network-changed-ed5a7452-e05e-4923-b8f3-23a67b426ecd {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:18:15 user nova-compute[73078]: DEBUG nova.compute.manager [req-97813158-06c6-4259-80c5-7c4054837227 req-a4d5b510-1c41-4755-9f5f-618b566bab06 service nova] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Refreshing instance network info cache due to event network-changed-ed5a7452-e05e-4923-b8f3-23a67b426ecd. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:18:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-97813158-06c6-4259-80c5-7c4054837227 req-a4d5b510-1c41-4755-9f5f-618b566bab06 service nova] Acquiring lock "refresh_cache-7783c26e-ec61-4375-b191-0ce5caf766c7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:18:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-97813158-06c6-4259-80c5-7c4054837227 req-a4d5b510-1c41-4755-9f5f-618b566bab06 service nova] Acquired lock "refresh_cache-7783c26e-ec61-4375-b191-0ce5caf766c7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:18:15 user nova-compute[73078]: DEBUG nova.network.neutron [req-97813158-06c6-4259-80c5-7c4054837227 req-a4d5b510-1c41-4755-9f5f-618b566bab06 service nova] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Refreshing network info cache for port ed5a7452-e05e-4923-b8f3-23a67b426ecd {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Acquiring lock "7783c26e-ec61-4375-b191-0ce5caf766c7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "7783c26e-ec61-4375-b191-0ce5caf766c7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG nova.network.neutron [req-97813158-06c6-4259-80c5-7c4054837227 req-a4d5b510-1c41-4755-9f5f-618b566bab06 service nova] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Updated VIF entry in instance network info cache for port ed5a7452-e05e-4923-b8f3-23a67b426ecd. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG nova.network.neutron [req-97813158-06c6-4259-80c5-7c4054837227 req-a4d5b510-1c41-4755-9f5f-618b566bab06 service nova] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Updating instance_info_cache with network_info: [{"id": "ed5a7452-e05e-4923-b8f3-23a67b426ecd", "address": "fa:16:3e:f7:07:98", "network": {"id": "d8856523-a980-4d8a-a541-72e9b88add3e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2086630095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "723522b7563c4ab79e178b31052e2b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped5a7452-e0", "ovs_interfaceid": "ed5a7452-e05e-4923-b8f3-23a67b426ecd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG nova.objects.instance [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lazy-loading 'flavor' on Instance uuid 7783c26e-ec61-4375-b191-0ce5caf766c7 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG nova.compute.manager [req-16a540c0-806a-44a1-897b-f64348fef6be req-8256cf60-be8c-4405-b47a-e63ea6843d60 service nova] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Received event volume-reimaged-d77e8c78-bb17-42b5-a3cd-19258651c57a {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-16a540c0-806a-44a1-897b-f64348fef6be req-8256cf60-be8c-4405-b47a-e63ea6843d60 service nova] Acquiring lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-16a540c0-806a-44a1-897b-f64348fef6be req-8256cf60-be8c-4405-b47a-e63ea6843d60 service nova] Lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-16a540c0-806a-44a1-897b-f64348fef6be req-8256cf60-be8c-4405-b47a-e63ea6843d60 service nova] Lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG nova.compute.manager [req-16a540c0-806a-44a1-897b-f64348fef6be req-8256cf60-be8c-4405-b47a-e63ea6843d60 service nova] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Processing event volume-reimaged-d77e8c78-bb17-42b5-a3cd-19258651c57a {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG nova.compute.manager [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Instance event wait completed in 23 seconds for volume-reimaged {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-97813158-06c6-4259-80c5-7c4054837227 req-a4d5b510-1c41-4755-9f5f-618b566bab06 service nova] Releasing lock "refresh_cache-7783c26e-ec61-4375-b191-0ce5caf766c7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "7783c26e-ec61-4375-b191-0ce5caf766c7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:16 user nova-compute[73078]: INFO nova.virt.block_device [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Booting with volume d77e8c78-bb17-42b5-a3cd-19258651c57a at /dev/vda
Aug 14 18:18:16 user nova-compute[73078]: DEBUG os_brick.utils [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1fd63d-5d3c-49a0-8c09-486218186352]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[35834f06-4a1c-4e3a-bf98-dd622658bb02]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.039s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7d652f-ba3d-446a-bbdc-ae59e1fb41a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[98417860-6ea6-4b88-83d6-3462fa707abe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:18:16 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae5e248-373d-41f7-b33b-c72f8c0773a8]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG os_brick.utils [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Updating existing volume attachment record: e9561be3-af58-4bc2-9ecb-128de2b626d0 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Acquiring lock "7783c26e-ec61-4375-b191-0ce5caf766c7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "7783c26e-ec61-4375-b191-0ce5caf766c7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:16 user nova-compute[73078]: INFO nova.compute.manager [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Attaching volume 2393519f-30c1-49aa-8f58-d922fe5d1275 to /dev/vdb
Aug 14 18:18:16 user nova-compute[73078]: DEBUG os_brick.utils [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e56ff9-0b9f-416e-8bed-252961a666bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce7f3d1-06af-4ce3-9d80-a9ecb4db74a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8927855a-b7f4-4578-9c53-6c412e289303]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25455f8-8bfa-4cc5-a7df-0806a0ff4681]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:18:16 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:18:16 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7396e871-e1c5-458f-9fdc-8e70668e9ed4]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG os_brick.utils [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:18:16 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Updating existing volume attachment record: f46e2c33-8e4f-4629-9c77-c3caa838a803 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:18:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VIwjOaFh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:18:26 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:18:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:18:26 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:18:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:18:26 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d542b005-fb13-44b2-99e7-e8a3a3d66172]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:18:26 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68c4a6b-3c3c-430f-b669-fb480406ccd6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275] added
Aug 14 18:18:26 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b596b29-91de-49e4-896d-d619ef7d1eba]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG nova.compute.manager [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e492d1a4-9100-46e1-9edd-0dbec8621f50]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VIwjOaFh {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VIwjOaFh" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36fcb06-526a-4c1c-a77a-1ee09ee70699]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VIwjOaFh'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[222f1c69-f54a-44d5-87ec-88e6a94c4428]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da1a2b6-6581-4e50-ab59-2a19c500acdb]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:18:26 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:18:26 user nova-compute[73078]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)
Aug 14 18:18:26 user nova-compute[73078]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)
Aug 14 18:18:26 user nova-compute[73078]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)
Aug 14 18:18:26 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:18:26 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:18:26 user nova-compute[73078]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)
Aug 14 18:18:26 user nova-compute[73078]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)
Aug 14 18:18:26 user nova-compute[73078]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)
Aug 14 18:18:26 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:18:26 user nova-compute[73078]: INFO nova.compute.claims [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Claim successful on node user
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d421b6d-b8f0-4b75-9a9c-5ff7444a4407]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275, portal: 172.16.0.220,3260]
Aug 14 18:18:26 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275, portal: 172.16.0.220,3260] successful.
Aug 14 18:18:26 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5883e84f-c8c7-4139-b812-92e922bc6879]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8887bdb-49c2-4e8a-8db5-3d93ea9e7af4]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:18:26 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:18:26 user nova-compute[73078]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)
Aug 14 18:18:26 user nova-compute[73078]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)
Aug 14 18:18:26 user nova-compute[73078]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)
Aug 14 18:18:26 user nova-compute[73078]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 (non-flash)
Aug 14 18:18:26 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:18:26 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:18:26 user nova-compute[73078]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)
Aug 14 18:18:26 user nova-compute[73078]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)
Aug 14 18:18:26 user nova-compute[73078]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)
Aug 14 18:18:26 user nova-compute[73078]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 (non-flash)
Aug 14 18:18:26 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cff9a0d-7184-416d-9cc1-992cdd53fc24]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VIwjOaFh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:18:26 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Creating image(s)
Aug 14 18:18:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Did not create local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Ensure instance console log exists: /opt/stack/data/nova/instances/90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Start _get_guest_xml network_info=[{"id": "74bc6a0e-0628-4482-be86-c53122e1363c", "address": "fa:16:3e:f1:45:de", "network": {"id": "f600e59d-4edc-4daa-a017-629c89211580", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-604738940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b726267e2c49c69b843234bb761f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74bc6a0e-06", "ovs_interfaceid": "74bc6a0e-0628-4482-be86-c53122e1363c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'e9561be3-af58-4bc2-9ecb-128de2b626d0', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgcyazBh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c', 'attached_at': '', 'detached_at': '', 'volume_id': 'd77e8c78-bb17-42b5-a3cd-19258651c57a', 'serial': 'd77e8c78-bb17-42b5-a3cd-19258651c57a'}, 'volume_type': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:18:26 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 14 18:18:26 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 14 18:18:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG nova.objects.instance [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lazy-loading 'vcpu_model' on Instance uuid 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgcyazBh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:18:26 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 18:18:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:18:26 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.531s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG nova.compute.manager [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG nova.compute.manager [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG nova.network.neutron [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:18:27 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:18:27 user nova-compute[73078]: DEBUG nova.compute.manager [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG nova.policy [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b07aecccb704835b6b765325b1d18bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f00de2496804d6eb570f93307f3f088', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG nova.compute.manager [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:18:27 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Creating image(s)
Aug 14 18:18:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "/opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "/opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "/opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.216s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.430s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] <== connect_volume: return (1432ms) {'type': 'block', 'scsi_wwn': '23939626432633236', 'path': '/dev/sdd'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939626432633236', 'path': '/dev/sdd'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.736s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:18:27 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 18:18:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:18:27 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:18:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG nova.objects.instance [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lazy-loading 'flavor' on Instance uuid 7783c26e-ec61-4375-b191-0ce5caf766c7 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260" returned: 21 in 0.033s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b771df0c-7eb3-48ee-8df8-08318c0b32e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:18:27 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 18:18:27 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:18:27 user nova-compute[73078]:   <source dev="/dev/sdd"/>
Aug 14 18:18:27 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:18:27 user nova-compute[73078]:   <serial>2393519f-30c1-49aa-8f58-d922fe5d1275</serial>
Aug 14 18:18:27 user nova-compute[73078]: </disk>
Aug 14 18:18:27 user nova-compute[73078]:  {{(pid=73078) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.185s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f945d8-b57c-487c-b13c-39ebd3a9d15e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a] added
Aug 14 18:18:27 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/disk 1073741824" returned: 0 in 0.075s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecb2142-1a8f-4d6c-8b3b-0f0fbdc11053]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0639ae7e-50b9-473d-8925-774c33bfd5d2]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MgcyazBh {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MgcyazBh" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[131b617d-7dd4-460d-93d2-25087a3c3586]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MgcyazBh'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f166737d-23d8-493d-9ea8-ddd8ed93f3eb]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c4b034-1ff4-442d-b392-2fb086dff246]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:18:27 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:18:27 user nova-compute[73078]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)
Aug 14 18:18:27 user nova-compute[73078]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)
Aug 14 18:18:27 user nova-compute[73078]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)
Aug 14 18:18:27 user nova-compute[73078]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 (non-flash)
Aug 14 18:18:27 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:18:27 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:18:27 user nova-compute[73078]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)
Aug 14 18:18:27 user nova-compute[73078]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)
Aug 14 18:18:27 user nova-compute[73078]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)
Aug 14 18:18:27 user nova-compute[73078]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 (non-flash)
Aug 14 18:18:27 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.185s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0033f3d-1c05-4075-bd7f-045286778cbe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a, portal: 172.16.0.220,3260]
Aug 14 18:18:28 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a, portal: 172.16.0.220,3260] successful.
Aug 14 18:18:28 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d7d16c-c437-43cf-b0a6-101ed218d517]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e7d696-6270-4872-ab3c-00223c6d264f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:18:28 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:18:28 user nova-compute[73078]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)
Aug 14 18:18:28 user nova-compute[73078]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)
Aug 14 18:18:28 user nova-compute[73078]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)
Aug 14 18:18:28 user nova-compute[73078]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 (non-flash)
Aug 14 18:18:28 user nova-compute[73078]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:18:28 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:18:28 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:18:28 user nova-compute[73078]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)
Aug 14 18:18:28 user nova-compute[73078]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)
Aug 14 18:18:28 user nova-compute[73078]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)
Aug 14 18:18:28 user nova-compute[73078]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 (non-flash)
Aug 14 18:18:28 user nova-compute[73078]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:18:28 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.495s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] HCTL ('39', '-', '-', 0) found on session 26 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] No VIF found with MAC fa:16:3e:f7:07:98, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4d846a-7ecb-4669-8a7d-3c281bec2cc0]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Searching for a device in session 26 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgcyazBh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Cannot resize image /opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG nova.objects.instance [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lazy-loading 'migration_context' on Instance uuid 4569b529-5c8f-45ec-94fe-58c60f6bcc8a {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Ensure instance console log exists: /opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-58f541fa-4e3d-441d-bfa8-1bfa11a8ae98 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "7783c26e-ec61-4375-b191-0ce5caf766c7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.952s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:28 user nova-compute[73078]: DEBUG nova.network.neutron [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Successfully created port: 08a212c4-6236-4adc-a3ec-6b76341585b3 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:18:29 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.577s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:18:29 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] <== connect_volume: return (2314ms) {'type': 'block', 'scsi_wwn': '23139643239353833', 'path': '/dev/sdh'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:18:29 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139643239353833', 'path': '/dev/sdh'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:18:29 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T18:15:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1987059253',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1497637679',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtJLJQBmgtrDyTBUJe8Q/tiHCzjGEVBxUbvCC7nYOmxztS2QanKQLBPdwFwQyvsPRy+jAfMiHcGMYRvHIAt2urg9izZdbJETz7dtqMJlhiy41t8tSflk18DOHtZARdHFg==',key_name='tempest-keypair-499236215',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:16:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c4b726267e2c49c69b843234bb761f06',ramdisk_id='',reservation_id='r-2u1e60fu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1368753977',owner_user_name='tempest-ServerActionsV293TestJSON-1368753977-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:18:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a3800a849fa4c199373454d92aada0a',uuid=90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74bc6a0e-0628-4482-be86-c53122e1363c", "address": "fa:16:3e:f1:45:de", "network": {"id": "f600e59d-4edc-4daa-a017-629c89211580", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-604738940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b726267e2c49c69b843234bb761f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74bc6a0e-06", "ovs_interfaceid": "74bc6a0e-0628-4482-be86-c53122e1363c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:18:29 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Converting VIF {"id": "74bc6a0e-0628-4482-be86-c53122e1363c", "address": "fa:16:3e:f1:45:de", "network": {"id": "f600e59d-4edc-4daa-a017-629c89211580", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-604738940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b726267e2c49c69b843234bb761f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74bc6a0e-06", "ovs_interfaceid": "74bc6a0e-0628-4482-be86-c53122e1363c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:18:29 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:45:de,bridge_name='br-int',has_traffic_filtering=True,id=74bc6a0e-0628-4482-be86-c53122e1363c,network=Network(f600e59d-4edc-4daa-a017-629c89211580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74bc6a0e-06') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:18:29 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:18:29 user nova-compute[73078]:   <uuid>90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c</uuid>
Aug 14 18:18:29 user nova-compute[73078]:   <name>instance-00000011</name>
Aug 14 18:18:29 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:18:29 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:18:29 user nova-compute[73078]:   <metadata>
Aug 14 18:18:29 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:18:29 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:18:29 user nova-compute[73078]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1987059253</nova:name>
Aug 14 18:18:29 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:18:26</nova:creationTime>
Aug 14 18:18:29 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:18:29 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:18:29 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:18:29 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:18:29 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:18:29 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:18:29 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:18:29 user nova-compute[73078]:       <nova:owner>
Aug 14 18:18:29 user nova-compute[73078]:         <nova:user uuid="1a3800a849fa4c199373454d92aada0a">tempest-ServerActionsV293TestJSON-1368753977-project-member</nova:user>
Aug 14 18:18:29 user nova-compute[73078]:         <nova:project uuid="c4b726267e2c49c69b843234bb761f06">tempest-ServerActionsV293TestJSON-1368753977</nova:project>
Aug 14 18:18:29 user nova-compute[73078]:       </nova:owner>
Aug 14 18:18:29 user nova-compute[73078]:       <nova:ports>
Aug 14 18:18:29 user nova-compute[73078]:         <nova:port uuid="74bc6a0e-0628-4482-be86-c53122e1363c">
Aug 14 18:18:29 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 14 18:18:29 user nova-compute[73078]:         </nova:port>
Aug 14 18:18:29 user nova-compute[73078]:       </nova:ports>
Aug 14 18:18:29 user nova-compute[73078]:     </nova:instance>
Aug 14 18:18:29 user nova-compute[73078]:   </metadata>
Aug 14 18:18:29 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:18:29 user nova-compute[73078]:     <system>
Aug 14 18:18:29 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:18:29 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:18:29 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:18:29 user nova-compute[73078]:       <entry name="serial">90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c</entry>
Aug 14 18:18:29 user nova-compute[73078]:       <entry name="uuid">90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c</entry>
Aug 14 18:18:29 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:18:29 user nova-compute[73078]:     </system>
Aug 14 18:18:29 user nova-compute[73078]:   </sysinfo>
Aug 14 18:18:29 user nova-compute[73078]:   <os>
Aug 14 18:18:29 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:18:29 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:18:29 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:18:29 user nova-compute[73078]:   </os>
Aug 14 18:18:29 user nova-compute[73078]:   <features>
Aug 14 18:18:29 user nova-compute[73078]:     <acpi/>
Aug 14 18:18:29 user nova-compute[73078]:     <apic/>
Aug 14 18:18:29 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:18:29 user nova-compute[73078]:   </features>
Aug 14 18:18:29 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:18:29 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:18:29 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:18:29 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:18:29 user nova-compute[73078]:   </clock>
Aug 14 18:18:29 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:18:29 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:18:29 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:18:29 user nova-compute[73078]:   </cpu>
Aug 14 18:18:29 user nova-compute[73078]:   <devices>
Aug 14 18:18:29 user nova-compute[73078]:     <disk type="block" device="disk">
Aug 14 18:18:29 user nova-compute[73078]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:18:29 user nova-compute[73078]:       <source dev="/dev/sdh"/>
Aug 14 18:18:29 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:18:29 user nova-compute[73078]:       <serial>d77e8c78-bb17-42b5-a3cd-19258651c57a</serial>
Aug 14 18:18:29 user nova-compute[73078]:     </disk>
Aug 14 18:18:29 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:18:29 user nova-compute[73078]:       <mac address="fa:16:3e:f1:45:de"/>
Aug 14 18:18:29 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:18:29 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:18:29 user nova-compute[73078]:       <target dev="tap74bc6a0e-06"/>
Aug 14 18:18:29 user nova-compute[73078]:     </interface>
Aug 14 18:18:29 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:18:29 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c/console.log" append="off"/>
Aug 14 18:18:29 user nova-compute[73078]:     </serial>
Aug 14 18:18:29 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:18:29 user nova-compute[73078]:     <video>
Aug 14 18:18:29 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:18:29 user nova-compute[73078]:     </video>
Aug 14 18:18:29 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:18:29 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:18:29 user nova-compute[73078]:     </rng>
Aug 14 18:18:29 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:18:29 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:18:29 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:18:29 user nova-compute[73078]:     </memballoon>
Aug 14 18:18:29 user nova-compute[73078]:   </devices>
Aug 14 18:18:29 user nova-compute[73078]: </domain>
Aug 14 18:18:29 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:18:29 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T18:15:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1987059253',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1497637679',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtJLJQBmgtrDyTBUJe8Q/tiHCzjGEVBxUbvCC7nYOmxztS2QanKQLBPdwFwQyvsPRy+jAfMiHcGMYRvHIAt2urg9izZdbJETz7dtqMJlhiy41t8tSflk18DOHtZARdHFg==',key_name='tempest-keypair-499236215',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:16:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c4b726267e2c49c69b843234bb761f06',ramdisk_id='',reservation_id='r-2u1e60fu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1368753977',owner_user_name='tempest-ServerActionsV293TestJSON-1368753977-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:18:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a3800a849fa4c199373454d92aada0a',uuid=90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74bc6a0e-0628-4482-be86-c53122e1363c", "address": "fa:16:3e:f1:45:de", "network": {"id": "f600e59d-4edc-4daa-a017-629c89211580", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-604738940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b726267e2c49c69b843234bb761f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74bc6a0e-06", "ovs_interfaceid": "74bc6a0e-0628-4482-be86-c53122e1363c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:18:29 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Converting VIF {"id": "74bc6a0e-0628-4482-be86-c53122e1363c", "address": "fa:16:3e:f1:45:de", "network": {"id": "f600e59d-4edc-4daa-a017-629c89211580", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-604738940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b726267e2c49c69b843234bb761f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74bc6a0e-06", "ovs_interfaceid": "74bc6a0e-0628-4482-be86-c53122e1363c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:18:29 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:45:de,bridge_name='br-int',has_traffic_filtering=True,id=74bc6a0e-0628-4482-be86-c53122e1363c,network=Network(f600e59d-4edc-4daa-a017-629c89211580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74bc6a0e-06') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:18:29 user nova-compute[73078]: DEBUG os_vif [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:45:de,bridge_name='br-int',has_traffic_filtering=True,id=74bc6a0e-0628-4482-be86-c53122e1363c,network=Network(f600e59d-4edc-4daa-a017-629c89211580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74bc6a0e-06') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:18:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:18:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:18:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74bc6a0e-06, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:18:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap74bc6a0e-06, col_values=(('external_ids', {'iface-id': '74bc6a0e-0628-4482-be86-c53122e1363c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:45:de', 'vm-uuid': '90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:18:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:18:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:29 user nova-compute[73078]: INFO os_vif [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:45:de,bridge_name='br-int',has_traffic_filtering=True,id=74bc6a0e-0628-4482-be86-c53122e1363c,network=Network(f600e59d-4edc-4daa-a017-629c89211580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74bc6a0e-06')
Aug 14 18:18:29 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:18:29 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] No VIF found with MAC fa:16:3e:f1:45:de, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:18:29 user nova-compute[73078]: DEBUG nova.network.neutron [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Successfully updated port: 08a212c4-6236-4adc-a3ec-6b76341585b3 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:18:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "refresh_cache-4569b529-5c8f-45ec-94fe-58c60f6bcc8a" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:18:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquired lock "refresh_cache-4569b529-5c8f-45ec-94fe-58c60f6bcc8a" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:18:29 user nova-compute[73078]: DEBUG nova.network.neutron [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:18:29 user nova-compute[73078]: DEBUG nova.compute.manager [req-ce383731-4d53-4187-9639-193e85681e16 req-5a0450b6-6889-4363-a98f-9f55453b2a24 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Received event network-changed-08a212c4-6236-4adc-a3ec-6b76341585b3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:18:29 user nova-compute[73078]: DEBUG nova.compute.manager [req-ce383731-4d53-4187-9639-193e85681e16 req-5a0450b6-6889-4363-a98f-9f55453b2a24 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Refreshing instance network info cache due to event network-changed-08a212c4-6236-4adc-a3ec-6b76341585b3. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:18:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ce383731-4d53-4187-9639-193e85681e16 req-5a0450b6-6889-4363-a98f-9f55453b2a24 service nova] Acquiring lock "refresh_cache-4569b529-5c8f-45ec-94fe-58c60f6bcc8a" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:18:29 user nova-compute[73078]: DEBUG nova.network.neutron [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG nova.network.neutron [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Updating instance_info_cache with network_info: [{"id": "08a212c4-6236-4adc-a3ec-6b76341585b3", "address": "fa:16:3e:4f:04:0e", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a212c4-62", "ovs_interfaceid": "08a212c4-6236-4adc-a3ec-6b76341585b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Releasing lock "refresh_cache-4569b529-5c8f-45ec-94fe-58c60f6bcc8a" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG nova.compute.manager [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Instance network_info: |[{"id": "08a212c4-6236-4adc-a3ec-6b76341585b3", "address": "fa:16:3e:4f:04:0e", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a212c4-62", "ovs_interfaceid": "08a212c4-6236-4adc-a3ec-6b76341585b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ce383731-4d53-4187-9639-193e85681e16 req-5a0450b6-6889-4363-a98f-9f55453b2a24 service nova] Acquired lock "refresh_cache-4569b529-5c8f-45ec-94fe-58c60f6bcc8a" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG nova.network.neutron [req-ce383731-4d53-4187-9639-193e85681e16 req-5a0450b6-6889-4363-a98f-9f55453b2a24 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Refreshing network info cache for port 08a212c4-6236-4adc-a3ec-6b76341585b3 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Start _get_guest_xml network_info=[{"id": "08a212c4-6236-4adc-a3ec-6b76341585b3", "address": "fa:16:3e:4f:04:0e", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a212c4-62", "ovs_interfaceid": "08a212c4-6236-4adc-a3ec-6b76341585b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:18:30 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:18:30 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:18:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:18:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-747135967',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-747135967',id=22,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBen6FWZ25Rn4AUFT59E6dGpvbFjj5V25k1Dtd5tlTQ8uteSHDv2JBkULY0OdKYhFtwts5/QeT/t58JgQY7L7c1Vp8+VsK8w/J53StMt+e8AdH3CtgsWBpB1AniYT9Ch0w==',key_name='tempest-keypair-452969408',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f00de2496804d6eb570f93307f3f088',ramdisk_id='',reservation_id='r-9qv8yi0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1593185714',owner_user_name='tempest-AttachVolumeShelveTestJSON-1593185714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:18:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b07aecccb704835b6b765325b1d18bf',uuid=4569b529-5c8f-45ec-94fe-58c60f6bcc8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08a212c4-6236-4adc-a3ec-6b76341585b3", "address": "fa:16:3e:4f:04:0e", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a212c4-62", "ovs_interfaceid": "08a212c4-6236-4adc-a3ec-6b76341585b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Converting VIF {"id": "08a212c4-6236-4adc-a3ec-6b76341585b3", "address": "fa:16:3e:4f:04:0e", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a212c4-62", "ovs_interfaceid": "08a212c4-6236-4adc-a3ec-6b76341585b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:04:0e,bridge_name='br-int',has_traffic_filtering=True,id=08a212c4-6236-4adc-a3ec-6b76341585b3,network=Network(a3adc062-ecf8-4c88-84ab-69425b236920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08a212c4-62') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG nova.objects.instance [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lazy-loading 'pci_devices' on Instance uuid 4569b529-5c8f-45ec-94fe-58c60f6bcc8a {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:18:30 user nova-compute[73078]:   <uuid>4569b529-5c8f-45ec-94fe-58c60f6bcc8a</uuid>
Aug 14 18:18:30 user nova-compute[73078]:   <name>instance-00000016</name>
Aug 14 18:18:30 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:18:30 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:18:30 user nova-compute[73078]:   <metadata>
Aug 14 18:18:30 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:18:30 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:18:30 user nova-compute[73078]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-747135967</nova:name>
Aug 14 18:18:30 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:18:30</nova:creationTime>
Aug 14 18:18:30 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:18:30 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:18:30 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:18:30 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:18:30 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:18:30 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:18:30 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:18:30 user nova-compute[73078]:       <nova:owner>
Aug 14 18:18:30 user nova-compute[73078]:         <nova:user uuid="2b07aecccb704835b6b765325b1d18bf">tempest-AttachVolumeShelveTestJSON-1593185714-project-member</nova:user>
Aug 14 18:18:30 user nova-compute[73078]:         <nova:project uuid="5f00de2496804d6eb570f93307f3f088">tempest-AttachVolumeShelveTestJSON-1593185714</nova:project>
Aug 14 18:18:30 user nova-compute[73078]:       </nova:owner>
Aug 14 18:18:30 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:18:30 user nova-compute[73078]:       <nova:ports>
Aug 14 18:18:30 user nova-compute[73078]:         <nova:port uuid="08a212c4-6236-4adc-a3ec-6b76341585b3">
Aug 14 18:18:30 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 14 18:18:30 user nova-compute[73078]:         </nova:port>
Aug 14 18:18:30 user nova-compute[73078]:       </nova:ports>
Aug 14 18:18:30 user nova-compute[73078]:     </nova:instance>
Aug 14 18:18:30 user nova-compute[73078]:   </metadata>
Aug 14 18:18:30 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:18:30 user nova-compute[73078]:     <system>
Aug 14 18:18:30 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:18:30 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:18:30 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:18:30 user nova-compute[73078]:       <entry name="serial">4569b529-5c8f-45ec-94fe-58c60f6bcc8a</entry>
Aug 14 18:18:30 user nova-compute[73078]:       <entry name="uuid">4569b529-5c8f-45ec-94fe-58c60f6bcc8a</entry>
Aug 14 18:18:30 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:18:30 user nova-compute[73078]:     </system>
Aug 14 18:18:30 user nova-compute[73078]:   </sysinfo>
Aug 14 18:18:30 user nova-compute[73078]:   <os>
Aug 14 18:18:30 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:18:30 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:18:30 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:18:30 user nova-compute[73078]:   </os>
Aug 14 18:18:30 user nova-compute[73078]:   <features>
Aug 14 18:18:30 user nova-compute[73078]:     <acpi/>
Aug 14 18:18:30 user nova-compute[73078]:     <apic/>
Aug 14 18:18:30 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:18:30 user nova-compute[73078]:   </features>
Aug 14 18:18:30 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:18:30 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:18:30 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:18:30 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:18:30 user nova-compute[73078]:   </clock>
Aug 14 18:18:30 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:18:30 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:18:30 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:18:30 user nova-compute[73078]:   </cpu>
Aug 14 18:18:30 user nova-compute[73078]:   <devices>
Aug 14 18:18:30 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:18:30 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:18:30 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/disk"/>
Aug 14 18:18:30 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:18:30 user nova-compute[73078]:     </disk>
Aug 14 18:18:30 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:18:30 user nova-compute[73078]:       <mac address="fa:16:3e:4f:04:0e"/>
Aug 14 18:18:30 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:18:30 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:18:30 user nova-compute[73078]:       <target dev="tap08a212c4-62"/>
Aug 14 18:18:30 user nova-compute[73078]:     </interface>
Aug 14 18:18:30 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:18:30 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/console.log" append="off"/>
Aug 14 18:18:30 user nova-compute[73078]:     </serial>
Aug 14 18:18:30 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:18:30 user nova-compute[73078]:     <video>
Aug 14 18:18:30 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:18:30 user nova-compute[73078]:     </video>
Aug 14 18:18:30 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:18:30 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:18:30 user nova-compute[73078]:     </rng>
Aug 14 18:18:30 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:18:30 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:18:30 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:18:30 user nova-compute[73078]:     </memballoon>
Aug 14 18:18:30 user nova-compute[73078]:   </devices>
Aug 14 18:18:30 user nova-compute[73078]: </domain>
Aug 14 18:18:30 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:18:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-747135967',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-747135967',id=22,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBen6FWZ25Rn4AUFT59E6dGpvbFjj5V25k1Dtd5tlTQ8uteSHDv2JBkULY0OdKYhFtwts5/QeT/t58JgQY7L7c1Vp8+VsK8w/J53StMt+e8AdH3CtgsWBpB1AniYT9Ch0w==',key_name='tempest-keypair-452969408',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f00de2496804d6eb570f93307f3f088',ramdisk_id='',reservation_id='r-9qv8yi0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1593185714',owner_user_name='tempest-AttachVolumeShelveTestJSON-1593185714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:18:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b07aecccb704835b6b765325b1d18bf',uuid=4569b529-5c8f-45ec-94fe-58c60f6bcc8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08a212c4-6236-4adc-a3ec-6b76341585b3", "address": "fa:16:3e:4f:04:0e", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a212c4-62", "ovs_interfaceid": "08a212c4-6236-4adc-a3ec-6b76341585b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Converting VIF {"id": "08a212c4-6236-4adc-a3ec-6b76341585b3", "address": "fa:16:3e:4f:04:0e", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a212c4-62", "ovs_interfaceid": "08a212c4-6236-4adc-a3ec-6b76341585b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:04:0e,bridge_name='br-int',has_traffic_filtering=True,id=08a212c4-6236-4adc-a3ec-6b76341585b3,network=Network(a3adc062-ecf8-4c88-84ab-69425b236920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08a212c4-62') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG os_vif [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:04:0e,bridge_name='br-int',has_traffic_filtering=True,id=08a212c4-6236-4adc-a3ec-6b76341585b3,network=Network(a3adc062-ecf8-4c88-84ab-69425b236920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08a212c4-62') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08a212c4-62, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap08a212c4-62, col_values=(('external_ids', {'iface-id': '08a212c4-6236-4adc-a3ec-6b76341585b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:04:0e', 'vm-uuid': '4569b529-5c8f-45ec-94fe-58c60f6bcc8a'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:30 user nova-compute[73078]: INFO os_vif [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:04:0e,bridge_name='br-int',has_traffic_filtering=True,id=08a212c4-6236-4adc-a3ec-6b76341585b3,network=Network(a3adc062-ecf8-4c88-84ab-69425b236920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08a212c4-62')
Aug 14 18:18:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] No VIF found with MAC fa:16:3e:4f:04:0e, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:31 user nova-compute[73078]: DEBUG nova.network.neutron [req-ce383731-4d53-4187-9639-193e85681e16 req-5a0450b6-6889-4363-a98f-9f55453b2a24 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Updated VIF entry in instance network info cache for port 08a212c4-6236-4adc-a3ec-6b76341585b3. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:18:31 user nova-compute[73078]: DEBUG nova.network.neutron [req-ce383731-4d53-4187-9639-193e85681e16 req-5a0450b6-6889-4363-a98f-9f55453b2a24 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Updating instance_info_cache with network_info: [{"id": "08a212c4-6236-4adc-a3ec-6b76341585b3", "address": "fa:16:3e:4f:04:0e", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a212c4-62", "ovs_interfaceid": "08a212c4-6236-4adc-a3ec-6b76341585b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:18:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ce383731-4d53-4187-9639-193e85681e16 req-5a0450b6-6889-4363-a98f-9f55453b2a24 service nova] Releasing lock "refresh_cache-4569b529-5c8f-45ec-94fe-58c60f6bcc8a" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:18:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:31 user nova-compute[73078]: DEBUG nova.compute.manager [req-4cb36fed-aa14-47e1-b90b-41bd8dc685d1 req-844eb4d4-a6f4-459e-8b44-71733e72df7d service nova] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Received event network-vif-plugged-74bc6a0e-0628-4482-be86-c53122e1363c {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:18:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4cb36fed-aa14-47e1-b90b-41bd8dc685d1 req-844eb4d4-a6f4-459e-8b44-71733e72df7d service nova] Acquiring lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4cb36fed-aa14-47e1-b90b-41bd8dc685d1 req-844eb4d4-a6f4-459e-8b44-71733e72df7d service nova] Lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4cb36fed-aa14-47e1-b90b-41bd8dc685d1 req-844eb4d4-a6f4-459e-8b44-71733e72df7d service nova] Lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:31 user nova-compute[73078]: DEBUG nova.compute.manager [req-4cb36fed-aa14-47e1-b90b-41bd8dc685d1 req-844eb4d4-a6f4-459e-8b44-71733e72df7d service nova] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] No waiting events found dispatching network-vif-plugged-74bc6a0e-0628-4482-be86-c53122e1363c {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:18:31 user nova-compute[73078]: WARNING nova.compute.manager [req-4cb36fed-aa14-47e1-b90b-41bd8dc685d1 req-844eb4d4-a6f4-459e-8b44-71733e72df7d service nova] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Received unexpected event network-vif-plugged-74bc6a0e-0628-4482-be86-c53122e1363c for instance with vm_state active and task_state rebuild_spawning.
Aug 14 18:18:31 user nova-compute[73078]: DEBUG nova.compute.manager [req-4cb36fed-aa14-47e1-b90b-41bd8dc685d1 req-844eb4d4-a6f4-459e-8b44-71733e72df7d service nova] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Received event network-vif-plugged-74bc6a0e-0628-4482-be86-c53122e1363c {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:18:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4cb36fed-aa14-47e1-b90b-41bd8dc685d1 req-844eb4d4-a6f4-459e-8b44-71733e72df7d service nova] Acquiring lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4cb36fed-aa14-47e1-b90b-41bd8dc685d1 req-844eb4d4-a6f4-459e-8b44-71733e72df7d service nova] Lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4cb36fed-aa14-47e1-b90b-41bd8dc685d1 req-844eb4d4-a6f4-459e-8b44-71733e72df7d service nova] Lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:31 user nova-compute[73078]: DEBUG nova.compute.manager [req-4cb36fed-aa14-47e1-b90b-41bd8dc685d1 req-844eb4d4-a6f4-459e-8b44-71733e72df7d service nova] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] No waiting events found dispatching network-vif-plugged-74bc6a0e-0628-4482-be86-c53122e1363c {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:18:31 user nova-compute[73078]: WARNING nova.compute.manager [req-4cb36fed-aa14-47e1-b90b-41bd8dc685d1 req-844eb4d4-a6f4-459e-8b44-71733e72df7d service nova] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Received unexpected event network-vif-plugged-74bc6a0e-0628-4482-be86-c53122e1363c for instance with vm_state active and task_state rebuild_spawning.
Aug 14 18:18:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:32 user nova-compute[73078]: DEBUG nova.compute.manager [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:18:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:32 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:18:32 user nova-compute[73078]: INFO nova.compute.claims [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Claim successful on node user
Aug 14 18:18:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Acquiring lock "7783c26e-ec61-4375-b191-0ce5caf766c7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "7783c26e-ec61-4375-b191-0ce5caf766c7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG nova.objects.instance [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lazy-loading 'flavor' on Instance uuid 7783c26e-ec61-4375-b191-0ce5caf766c7 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "7783c26e-ec61-4375-b191-0ce5caf766c7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Acquiring lock "7783c26e-ec61-4375-b191-0ce5caf766c7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "7783c26e-ec61-4375-b191-0ce5caf766c7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:33 user nova-compute[73078]: INFO nova.compute.manager [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Attaching volume 1f6c1459-af42-46ce-947e-9866de0be93b to /dev/vdc
Aug 14 18:18:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG os_brick.utils [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.730s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG nova.compute.manager [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acbb9ac-f6f0-4093-bdc1-c174050cbbf6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c3330f-02f6-402a-9e10-b03f52b2ab1f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG nova.compute.manager [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG nova.network.neutron [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a067fddc-a8e8-4e08-bf03-0bbedc987e2b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da805ff-8814-4990-851f-8f65a75b0df3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:18:33 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:18:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG nova.compute.manager [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:18:33 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:18:33 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1148d3f6-f56a-434c-96e5-a57ae9f6bf7b]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG os_brick.utils [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Updating existing volume attachment record: aec7d9ec-d431-4239-8915-dceddb83edfb {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG nova.compute.manager [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:18:33 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Creating image(s)
Aug 14 18:18:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "/opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "/opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "/opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "a25ee279ecedc5aaaa5279e162d8199454606a0e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "a25ee279ecedc5aaaa5279e162d8199454606a0e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:33 user nova-compute[73078]: DEBUG nova.policy [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6ffd9b3d18374103918d71165106f131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6461284f1d491c9cd726d8550a445b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:18:34 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a25ee279ecedc5aaaa5279e162d8199454606a0e.part --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:34 user nova-compute[73078]: DEBUG nova.compute.manager [req-94f1a8fc-ec30-4832-b2f2-a55d8c91ab48 req-88c3a932-b4b4-4b7b-8cda-3981d15c111b service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Received event network-vif-plugged-08a212c4-6236-4adc-a3ec-6b76341585b3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:18:34 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-94f1a8fc-ec30-4832-b2f2-a55d8c91ab48 req-88c3a932-b4b4-4b7b-8cda-3981d15c111b service nova] Acquiring lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:34 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-94f1a8fc-ec30-4832-b2f2-a55d8c91ab48 req-88c3a932-b4b4-4b7b-8cda-3981d15c111b service nova] Lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:34 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-94f1a8fc-ec30-4832-b2f2-a55d8c91ab48 req-88c3a932-b4b4-4b7b-8cda-3981d15c111b service nova] Lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:34 user nova-compute[73078]: DEBUG nova.compute.manager [req-94f1a8fc-ec30-4832-b2f2-a55d8c91ab48 req-88c3a932-b4b4-4b7b-8cda-3981d15c111b service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] No waiting events found dispatching network-vif-plugged-08a212c4-6236-4adc-a3ec-6b76341585b3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:18:34 user nova-compute[73078]: WARNING nova.compute.manager [req-94f1a8fc-ec30-4832-b2f2-a55d8c91ab48 req-88c3a932-b4b4-4b7b-8cda-3981d15c111b service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Received unexpected event network-vif-plugged-08a212c4-6236-4adc-a3ec-6b76341585b3 for instance with vm_state building and task_state spawning.
Aug 14 18:18:34 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a25ee279ecedc5aaaa5279e162d8199454606a0e.part --force-share --output=json" returned: 0 in 0.231s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:34 user nova-compute[73078]: DEBUG nova.virt.images [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] 5e7413b1-16bd-4339-a215-31981164558b was qcow2, converting to raw {{(pid=73078) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 18:18:34 user nova-compute[73078]: DEBUG nova.privsep.utils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73078) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 18:18:34 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a25ee279ecedc5aaaa5279e162d8199454606a0e.part /opt/stack/data/nova/instances/_base/a25ee279ecedc5aaaa5279e162d8199454606a0e.converted {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:34 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037114.8113973, 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:18:34 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] VM Resumed (Lifecycle Event)
Aug 14 18:18:34 user nova-compute[73078]: DEBUG nova.compute.manager [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:18:34 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:18:34 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Instance spawned successfully.
Aug 14 18:18:34 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:18:34 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:18:34 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:18:34 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:18:34 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:18:34 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:18:34 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:18:34 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:18:34 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:18:35 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 14 18:18:35 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037114.8380415, 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:18:35 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] VM Started (Lifecycle Event)
Aug 14 18:18:35 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:18:35 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:18:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a25ee279ecedc5aaaa5279e162d8199454606a0e.part /opt/stack/data/nova/instances/_base/a25ee279ecedc5aaaa5279e162d8199454606a0e.converted" returned: 0 in 0.423s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:35 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 14 18:18:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a25ee279ecedc5aaaa5279e162d8199454606a0e.converted --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:35 user nova-compute[73078]: DEBUG nova.compute.manager [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:18:35 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037115.3488646, 4569b529-5c8f-45ec-94fe-58c60f6bcc8a => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:18:35 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] VM Resumed (Lifecycle Event)
Aug 14 18:18:35 user nova-compute[73078]: DEBUG nova.compute.manager [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:18:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:18:35 user nova-compute[73078]: DEBUG nova.network.neutron [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Successfully created port: 183ecc4d-2001-4254-9f1b-af3a43c362dc {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:18:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:35 user nova-compute[73078]: DEBUG nova.objects.instance [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73078) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 14 18:18:35 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:18:35 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Instance spawned successfully.
Aug 14 18:18:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:18:35 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:18:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a25ee279ecedc5aaaa5279e162d8199454606a0e.converted --force-share --output=json" returned: 0 in 0.219s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "a25ee279ecedc5aaaa5279e162d8199454606a0e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.555s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a25ee279ecedc5aaaa5279e162d8199454606a0e --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:35 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:18:35 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037115.3499427, 4569b529-5c8f-45ec-94fe-58c60f6bcc8a => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:18:35 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] VM Started (Lifecycle Event)
Aug 14 18:18:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:18:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:18:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:18:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:18:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:18:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:18:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-16a540c0-806a-44a1-897b-f64348fef6be tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.132s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:35 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:18:35 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:18:35 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:18:35 user nova-compute[73078]: INFO nova.compute.manager [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Took 8.32 seconds to spawn the instance on the hypervisor.
Aug 14 18:18:35 user nova-compute[73078]: DEBUG nova.compute.manager [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:18:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a25ee279ecedc5aaaa5279e162d8199454606a0e --force-share --output=json" returned: 0 in 0.241s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "a25ee279ecedc5aaaa5279e162d8199454606a0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "a25ee279ecedc5aaaa5279e162d8199454606a0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a25ee279ecedc5aaaa5279e162d8199454606a0e --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:35 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:35 user nova-compute[73078]: INFO nova.compute.manager [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Took 9.27 seconds to build instance.
Aug 14 18:18:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-57d9e7df-5943-428e-9c5c-dd5a14c5a14f tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.461s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a25ee279ecedc5aaaa5279e162d8199454606a0e --force-share --output=json" returned: 0 in 0.225s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a25ee279ecedc5aaaa5279e162d8199454606a0e,backing_fmt=raw /opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a25ee279ecedc5aaaa5279e162d8199454606a0e,backing_fmt=raw /opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk 1073741824" returned: 0 in 0.075s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "a25ee279ecedc5aaaa5279e162d8199454606a0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a25ee279ecedc5aaaa5279e162d8199454606a0e --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:36 user nova-compute[73078]: DEBUG nova.compute.manager [req-68894fa8-1c0c-4f03-b7cc-a45b288c19e6 req-073d3643-3250-446b-8832-2b86fdd57a52 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Received event network-vif-plugged-08a212c4-6236-4adc-a3ec-6b76341585b3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:18:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-68894fa8-1c0c-4f03-b7cc-a45b288c19e6 req-073d3643-3250-446b-8832-2b86fdd57a52 service nova] Acquiring lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-68894fa8-1c0c-4f03-b7cc-a45b288c19e6 req-073d3643-3250-446b-8832-2b86fdd57a52 service nova] Lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-68894fa8-1c0c-4f03-b7cc-a45b288c19e6 req-073d3643-3250-446b-8832-2b86fdd57a52 service nova] Lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:36 user nova-compute[73078]: DEBUG nova.compute.manager [req-68894fa8-1c0c-4f03-b7cc-a45b288c19e6 req-073d3643-3250-446b-8832-2b86fdd57a52 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] No waiting events found dispatching network-vif-plugged-08a212c4-6236-4adc-a3ec-6b76341585b3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:18:36 user nova-compute[73078]: WARNING nova.compute.manager [req-68894fa8-1c0c-4f03-b7cc-a45b288c19e6 req-073d3643-3250-446b-8832-2b86fdd57a52 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Received unexpected event network-vif-plugged-08a212c4-6236-4adc-a3ec-6b76341585b3 for instance with vm_state active and task_state None.
Aug 14 18:18:36 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a25ee279ecedc5aaaa5279e162d8199454606a0e --force-share --output=json" returned: 0 in 0.228s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:36 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:18:36 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:36 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk --force-share --output=json" returned: 0 in 0.387s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:36 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Cannot resize image /opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:18:36 user nova-compute[73078]: DEBUG nova.objects.instance [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lazy-loading 'migration_context' on Instance uuid f61b5dc6-4b63-439b-9b3d-62ee0a4056d3 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:18:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:18:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Ensure instance console log exists: /opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:18:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:37 user nova-compute[73078]: DEBUG nova.network.neutron [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Successfully updated port: 183ecc4d-2001-4254-9f1b-af3a43c362dc {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:18:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "refresh_cache-f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:18:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquired lock "refresh_cache-f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:18:37 user nova-compute[73078]: DEBUG nova.network.neutron [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:18:37 user nova-compute[73078]: DEBUG nova.network.neutron [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:18:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG nova.network.neutron [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Updating instance_info_cache with network_info: [{"id": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "address": "fa:16:3e:4a:28:05", "network": {"id": "4c337404-9329-43e7-bed1-7b5dc32f6cd9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-902748542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6461284f1d491c9cd726d8550a445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183ecc4d-20", "ovs_interfaceid": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Releasing lock "refresh_cache-f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG nova.compute.manager [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Instance network_info: |[{"id": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "address": "fa:16:3e:4a:28:05", "network": {"id": "4c337404-9329-43e7-bed1-7b5dc32f6cd9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-902748542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6461284f1d491c9cd726d8550a445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183ecc4d-20", "ovs_interfaceid": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Start _get_guest_xml network_info=[{"id": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "address": "fa:16:3e:4a:28:05", "network": {"id": "4c337404-9329-43e7-bed1-7b5dc32f6cd9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-902748542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6461284f1d491c9cd726d8550a445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183ecc4d-20", "ovs_interfaceid": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:18:29Z,direct_url=<?>,disk_format='qcow2',id=5e7413b1-16bd-4339-a215-31981164558b,min_disk=0,min_ram=0,name='tempest-scenario-img--1588394466',owner='7d6461284f1d491c9cd726d8550a445b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:18:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '5e7413b1-16bd-4339-a215-31981164558b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:18:38 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:18:38 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:18:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:18:29Z,direct_url=<?>,disk_format='qcow2',id=5e7413b1-16bd-4339-a215-31981164558b,min_disk=0,min_ram=0,name='tempest-scenario-img--1588394466',owner='7d6461284f1d491c9cd726d8550a445b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:18:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:18:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1957182722',display_name='tempest-TestMinimumBasicScenario-server-1957182722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1957182722',id=23,image_ref='5e7413b1-16bd-4339-a215-31981164558b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjJC77llA3l7SUHq/hdkyC+9XFeVKxXNkUb+w5/DdLo+f1BeNe0yWHGVzXJxkhWwKbQcpDIu12NoXM5bJGoIURQlOaFuP0tnE3q8Bzd1rGOHAZD4ANRxT9WAGQT7bMi9A==',key_name='tempest-TestMinimumBasicScenario-1154723146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d6461284f1d491c9cd726d8550a445b',ramdisk_id='',reservation_id='r-dghlbzh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e7413b1-16bd-4339-a215-31981164558b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-703150932',owner_user_name='tempest-TestMinimumBasicScenario-703150932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:18:34Z,user_data=None,user_id='6ffd9b3d18374103918d71165106f131',uuid=f61b5dc6-4b63-439b-9b3d-62ee0a4056d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "address": "fa:16:3e:4a:28:05", "network": {"id": "4c337404-9329-43e7-bed1-7b5dc32f6cd9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-902748542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6461284f1d491c9cd726d8550a445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183ecc4d-20", "ovs_interfaceid": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Converting VIF {"id": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "address": "fa:16:3e:4a:28:05", "network": {"id": "4c337404-9329-43e7-bed1-7b5dc32f6cd9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-902748542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6461284f1d491c9cd726d8550a445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183ecc4d-20", "ovs_interfaceid": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:28:05,bridge_name='br-int',has_traffic_filtering=True,id=183ecc4d-2001-4254-9f1b-af3a43c362dc,network=Network(4c337404-9329-43e7-bed1-7b5dc32f6cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183ecc4d-20') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG nova.objects.instance [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lazy-loading 'pci_devices' on Instance uuid f61b5dc6-4b63-439b-9b3d-62ee0a4056d3 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:18:38 user nova-compute[73078]:   <uuid>f61b5dc6-4b63-439b-9b3d-62ee0a4056d3</uuid>
Aug 14 18:18:38 user nova-compute[73078]:   <name>instance-00000017</name>
Aug 14 18:18:38 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:18:38 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:18:38 user nova-compute[73078]:   <metadata>
Aug 14 18:18:38 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:18:38 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:18:38 user nova-compute[73078]:       <nova:name>tempest-TestMinimumBasicScenario-server-1957182722</nova:name>
Aug 14 18:18:38 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:18:38</nova:creationTime>
Aug 14 18:18:38 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:18:38 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:18:38 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:18:38 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:18:38 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:18:38 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:18:38 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:18:38 user nova-compute[73078]:       <nova:owner>
Aug 14 18:18:38 user nova-compute[73078]:         <nova:user uuid="6ffd9b3d18374103918d71165106f131">tempest-TestMinimumBasicScenario-703150932-project-member</nova:user>
Aug 14 18:18:38 user nova-compute[73078]:         <nova:project uuid="7d6461284f1d491c9cd726d8550a445b">tempest-TestMinimumBasicScenario-703150932</nova:project>
Aug 14 18:18:38 user nova-compute[73078]:       </nova:owner>
Aug 14 18:18:38 user nova-compute[73078]:       <nova:root type="image" uuid="5e7413b1-16bd-4339-a215-31981164558b"/>
Aug 14 18:18:38 user nova-compute[73078]:       <nova:ports>
Aug 14 18:18:38 user nova-compute[73078]:         <nova:port uuid="183ecc4d-2001-4254-9f1b-af3a43c362dc">
Aug 14 18:18:38 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 14 18:18:38 user nova-compute[73078]:         </nova:port>
Aug 14 18:18:38 user nova-compute[73078]:       </nova:ports>
Aug 14 18:18:38 user nova-compute[73078]:     </nova:instance>
Aug 14 18:18:38 user nova-compute[73078]:   </metadata>
Aug 14 18:18:38 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:18:38 user nova-compute[73078]:     <system>
Aug 14 18:18:38 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:18:38 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:18:38 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:18:38 user nova-compute[73078]:       <entry name="serial">f61b5dc6-4b63-439b-9b3d-62ee0a4056d3</entry>
Aug 14 18:18:38 user nova-compute[73078]:       <entry name="uuid">f61b5dc6-4b63-439b-9b3d-62ee0a4056d3</entry>
Aug 14 18:18:38 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:18:38 user nova-compute[73078]:     </system>
Aug 14 18:18:38 user nova-compute[73078]:   </sysinfo>
Aug 14 18:18:38 user nova-compute[73078]:   <os>
Aug 14 18:18:38 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:18:38 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:18:38 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:18:38 user nova-compute[73078]:   </os>
Aug 14 18:18:38 user nova-compute[73078]:   <features>
Aug 14 18:18:38 user nova-compute[73078]:     <acpi/>
Aug 14 18:18:38 user nova-compute[73078]:     <apic/>
Aug 14 18:18:38 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:18:38 user nova-compute[73078]:   </features>
Aug 14 18:18:38 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:18:38 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:18:38 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:18:38 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:18:38 user nova-compute[73078]:   </clock>
Aug 14 18:18:38 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:18:38 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:18:38 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:18:38 user nova-compute[73078]:   </cpu>
Aug 14 18:18:38 user nova-compute[73078]:   <devices>
Aug 14 18:18:38 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:18:38 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:18:38 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk"/>
Aug 14 18:18:38 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:18:38 user nova-compute[73078]:     </disk>
Aug 14 18:18:38 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:18:38 user nova-compute[73078]:       <mac address="fa:16:3e:4a:28:05"/>
Aug 14 18:18:38 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:18:38 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:18:38 user nova-compute[73078]:       <target dev="tap183ecc4d-20"/>
Aug 14 18:18:38 user nova-compute[73078]:     </interface>
Aug 14 18:18:38 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:18:38 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/console.log" append="off"/>
Aug 14 18:18:38 user nova-compute[73078]:     </serial>
Aug 14 18:18:38 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:18:38 user nova-compute[73078]:     <video>
Aug 14 18:18:38 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:18:38 user nova-compute[73078]:     </video>
Aug 14 18:18:38 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:18:38 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:18:38 user nova-compute[73078]:     </rng>
Aug 14 18:18:38 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:18:38 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:18:38 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:18:38 user nova-compute[73078]:     </memballoon>
Aug 14 18:18:38 user nova-compute[73078]:   </devices>
Aug 14 18:18:38 user nova-compute[73078]: </domain>
Aug 14 18:18:38 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:18:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1957182722',display_name='tempest-TestMinimumBasicScenario-server-1957182722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1957182722',id=23,image_ref='5e7413b1-16bd-4339-a215-31981164558b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjJC77llA3l7SUHq/hdkyC+9XFeVKxXNkUb+w5/DdLo+f1BeNe0yWHGVzXJxkhWwKbQcpDIu12NoXM5bJGoIURQlOaFuP0tnE3q8Bzd1rGOHAZD4ANRxT9WAGQT7bMi9A==',key_name='tempest-TestMinimumBasicScenario-1154723146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d6461284f1d491c9cd726d8550a445b',ramdisk_id='',reservation_id='r-dghlbzh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e7413b1-16bd-4339-a215-31981164558b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-703150932',owner_user_name='tempest-TestMinimumBasicScenario-703150932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:18:34Z,user_data=None,user_id='6ffd9b3d18374103918d71165106f131',uuid=f61b5dc6-4b63-439b-9b3d-62ee0a4056d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "address": "fa:16:3e:4a:28:05", "network": {"id": "4c337404-9329-43e7-bed1-7b5dc32f6cd9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-902748542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6461284f1d491c9cd726d8550a445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183ecc4d-20", "ovs_interfaceid": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Converting VIF {"id": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "address": "fa:16:3e:4a:28:05", "network": {"id": "4c337404-9329-43e7-bed1-7b5dc32f6cd9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-902748542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6461284f1d491c9cd726d8550a445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183ecc4d-20", "ovs_interfaceid": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:28:05,bridge_name='br-int',has_traffic_filtering=True,id=183ecc4d-2001-4254-9f1b-af3a43c362dc,network=Network(4c337404-9329-43e7-bed1-7b5dc32f6cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183ecc4d-20') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG os_vif [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:28:05,bridge_name='br-int',has_traffic_filtering=True,id=183ecc4d-2001-4254-9f1b-af3a43c362dc,network=Network(4c337404-9329-43e7-bed1-7b5dc32f6cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183ecc4d-20') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap183ecc4d-20, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap183ecc4d-20, col_values=(('external_ids', {'iface-id': '183ecc4d-2001-4254-9f1b-af3a43c362dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:28:05', 'vm-uuid': 'f61b5dc6-4b63-439b-9b3d-62ee0a4056d3'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:38 user nova-compute[73078]: INFO os_vif [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:28:05,bridge_name='br-int',has_traffic_filtering=True,id=183ecc4d-2001-4254-9f1b-af3a43c362dc,network=Network(4c337404-9329-43e7-bed1-7b5dc32f6cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183ecc4d-20')
Aug 14 18:18:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] No VIF found with MAC fa:16:3e:4a:28:05, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG nova.compute.manager [req-689a6cae-03f0-4e72-a67c-cc22abb06286 req-ce2bb7fe-f5bc-4d2f-80b4-8823144e5382 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Received event network-changed-183ecc4d-2001-4254-9f1b-af3a43c362dc {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG nova.compute.manager [req-689a6cae-03f0-4e72-a67c-cc22abb06286 req-ce2bb7fe-f5bc-4d2f-80b4-8823144e5382 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Refreshing instance network info cache due to event network-changed-183ecc4d-2001-4254-9f1b-af3a43c362dc. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-689a6cae-03f0-4e72-a67c-cc22abb06286 req-ce2bb7fe-f5bc-4d2f-80b4-8823144e5382 service nova] Acquiring lock "refresh_cache-f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-689a6cae-03f0-4e72-a67c-cc22abb06286 req-ce2bb7fe-f5bc-4d2f-80b4-8823144e5382 service nova] Acquired lock "refresh_cache-f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:18:38 user nova-compute[73078]: DEBUG nova.network.neutron [req-689a6cae-03f0-4e72-a67c-cc22abb06286 req-ce2bb7fe-f5bc-4d2f-80b4-8823144e5382 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Refreshing network info cache for port 183ecc4d-2001-4254-9f1b-af3a43c362dc {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:18:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:39 user nova-compute[73078]: DEBUG nova.network.neutron [req-689a6cae-03f0-4e72-a67c-cc22abb06286 req-ce2bb7fe-f5bc-4d2f-80b4-8823144e5382 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Updated VIF entry in instance network info cache for port 183ecc4d-2001-4254-9f1b-af3a43c362dc. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:18:39 user nova-compute[73078]: DEBUG nova.network.neutron [req-689a6cae-03f0-4e72-a67c-cc22abb06286 req-ce2bb7fe-f5bc-4d2f-80b4-8823144e5382 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Updating instance_info_cache with network_info: [{"id": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "address": "fa:16:3e:4a:28:05", "network": {"id": "4c337404-9329-43e7-bed1-7b5dc32f6cd9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-902748542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6461284f1d491c9cd726d8550a445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183ecc4d-20", "ovs_interfaceid": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:18:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-689a6cae-03f0-4e72-a67c-cc22abb06286 req-ce2bb7fe-f5bc-4d2f-80b4-8823144e5382 service nova] Releasing lock "refresh_cache-f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:18:40 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:40 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:40 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:40 user nova-compute[73078]: DEBUG nova.compute.manager [req-60ef4b4a-27c4-4ffe-b05b-0b1c232f69b5 req-f4608dd0-30b8-4001-bb7c-16065634abe4 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Received event network-vif-plugged-183ecc4d-2001-4254-9f1b-af3a43c362dc {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:18:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-60ef4b4a-27c4-4ffe-b05b-0b1c232f69b5 req-f4608dd0-30b8-4001-bb7c-16065634abe4 service nova] Acquiring lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-60ef4b4a-27c4-4ffe-b05b-0b1c232f69b5 req-f4608dd0-30b8-4001-bb7c-16065634abe4 service nova] Lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-60ef4b4a-27c4-4ffe-b05b-0b1c232f69b5 req-f4608dd0-30b8-4001-bb7c-16065634abe4 service nova] Lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:40 user nova-compute[73078]: DEBUG nova.compute.manager [req-60ef4b4a-27c4-4ffe-b05b-0b1c232f69b5 req-f4608dd0-30b8-4001-bb7c-16065634abe4 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] No waiting events found dispatching network-vif-plugged-183ecc4d-2001-4254-9f1b-af3a43c362dc {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:18:40 user nova-compute[73078]: WARNING nova.compute.manager [req-60ef4b4a-27c4-4ffe-b05b-0b1c232f69b5 req-f4608dd0-30b8-4001-bb7c-16065634abe4 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Received unexpected event network-vif-plugged-183ecc4d-2001-4254-9f1b-af3a43c362dc for instance with vm_state building and task_state spawning.
Aug 14 18:18:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:42 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037122.6599183, f61b5dc6-4b63-439b-9b3d-62ee0a4056d3 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:18:42 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] VM Resumed (Lifecycle Event)
Aug 14 18:18:42 user nova-compute[73078]: DEBUG nova.compute.manager [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:18:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:18:42 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Instance spawned successfully.
Aug 14 18:18:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:18:42 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:18:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:18:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:18:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:18:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:18:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:18:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:18:42 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:18:42 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:18:42 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037122.6632023, f61b5dc6-4b63-439b-9b3d-62ee0a4056d3 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:18:42 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] VM Started (Lifecycle Event)
Aug 14 18:18:42 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:18:42 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:18:42 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:18:42 user nova-compute[73078]: INFO nova.compute.manager [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Took 8.93 seconds to spawn the instance on the hypervisor.
Aug 14 18:18:42 user nova-compute[73078]: DEBUG nova.compute.manager [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:18:42 user nova-compute[73078]: DEBUG nova.compute.manager [req-21cd19f7-42cc-458f-aa52-7121e7265c77 req-2636f42c-c9b4-42f8-a484-9a8c15c62aa8 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Received event network-vif-plugged-183ecc4d-2001-4254-9f1b-af3a43c362dc {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:18:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-21cd19f7-42cc-458f-aa52-7121e7265c77 req-2636f42c-c9b4-42f8-a484-9a8c15c62aa8 service nova] Acquiring lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-21cd19f7-42cc-458f-aa52-7121e7265c77 req-2636f42c-c9b4-42f8-a484-9a8c15c62aa8 service nova] Lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-21cd19f7-42cc-458f-aa52-7121e7265c77 req-2636f42c-c9b4-42f8-a484-9a8c15c62aa8 service nova] Lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:42 user nova-compute[73078]: DEBUG nova.compute.manager [req-21cd19f7-42cc-458f-aa52-7121e7265c77 req-2636f42c-c9b4-42f8-a484-9a8c15c62aa8 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] No waiting events found dispatching network-vif-plugged-183ecc4d-2001-4254-9f1b-af3a43c362dc {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:18:42 user nova-compute[73078]: WARNING nova.compute.manager [req-21cd19f7-42cc-458f-aa52-7121e7265c77 req-2636f42c-c9b4-42f8-a484-9a8c15c62aa8 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Received unexpected event network-vif-plugged-183ecc4d-2001-4254-9f1b-af3a43c362dc for instance with vm_state building and task_state spawning.
Aug 14 18:18:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:42 user nova-compute[73078]: INFO nova.compute.manager [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Took 10.09 seconds to build instance.
Aug 14 18:18:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-684fbf09-feac-402e-a8b7-44f6b6b91cf1 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.205s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:43 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CjoSegxs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:18:45 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:18:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:18:45 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:18:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:18:45 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:18:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3718dd29-d2f9-439a-80d5-485ec9948f2b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:18:45 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc35a35-bee3-4e41-bf3f-05402d552123]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b] added
Aug 14 18:18:45 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[60077064-cb1a-47ae-9815-795a7b5dbe7f]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c756f9-b5a7-4215-b86a-cbb95b64d24e]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CjoSegxs {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CjoSegxs" returned: 0 in 0.031s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb8965d-a50d-4e11-bda7-960bb12fe825]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CjoSegxs'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.098s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c68241-6de0-44ae-b24d-89b39c8279d5]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18dd878-41b9-4399-be03-ce8b75170458]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:18:45 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:18:45 user nova-compute[73078]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)
Aug 14 18:18:45 user nova-compute[73078]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)
Aug 14 18:18:45 user nova-compute[73078]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)
Aug 14 18:18:45 user nova-compute[73078]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 (non-flash)
Aug 14 18:18:45 user nova-compute[73078]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:18:45 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:18:45 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:18:45 user nova-compute[73078]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)
Aug 14 18:18:45 user nova-compute[73078]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)
Aug 14 18:18:45 user nova-compute[73078]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)
Aug 14 18:18:45 user nova-compute[73078]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 (non-flash)
Aug 14 18:18:45 user nova-compute[73078]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:18:45 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG nova.compute.manager [req-09fdbd88-f980-430f-95da-14bbfe936f4a req-479fd516-3b16-4bb9-a3c8-c057a5ce71b1 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-changed-9f1350b2-c0dd-4818-a941-22f37f92e610 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG nova.compute.manager [req-09fdbd88-f980-430f-95da-14bbfe936f4a req-479fd516-3b16-4bb9-a3c8-c057a5ce71b1 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Refreshing instance network info cache due to event network-changed-9f1350b2-c0dd-4818-a941-22f37f92e610. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-09fdbd88-f980-430f-95da-14bbfe936f4a req-479fd516-3b16-4bb9-a3c8-c057a5ce71b1 service nova] Acquiring lock "refresh_cache-83aca621-7182-49a9-b4b3-8f22dd50f869" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-09fdbd88-f980-430f-95da-14bbfe936f4a req-479fd516-3b16-4bb9-a3c8-c057a5ce71b1 service nova] Acquired lock "refresh_cache-83aca621-7182-49a9-b4b3-8f22dd50f869" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG nova.network.neutron [req-09fdbd88-f980-430f-95da-14bbfe936f4a req-479fd516-3b16-4bb9-a3c8-c057a5ce71b1 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Refreshing network info cache for port 9f1350b2-c0dd-4818-a941-22f37f92e610 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b -p 172.16.0.220:3260 --login" returned: 0 in 0.120s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cb9a52-b28d-47d3-b50f-f727f56eb594]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b, portal: 172.16.0.220,3260]
Aug 14 18:18:45 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b, portal: 172.16.0.220,3260] successful.
Aug 14 18:18:45 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c893400d-cffd-4e55-bac7-0648cbd6d96d]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfa47b9-fca6-4808-8219-7c9ca5079837]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:18:45 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:18:45 user nova-compute[73078]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)
Aug 14 18:18:45 user nova-compute[73078]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)
Aug 14 18:18:45 user nova-compute[73078]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)
Aug 14 18:18:45 user nova-compute[73078]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 (non-flash)
Aug 14 18:18:45 user nova-compute[73078]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:18:45 user nova-compute[73078]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b (non-flash)
Aug 14 18:18:45 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:18:45 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:18:45 user nova-compute[73078]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)
Aug 14 18:18:45 user nova-compute[73078]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)
Aug 14 18:18:45 user nova-compute[73078]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)
Aug 14 18:18:45 user nova-compute[73078]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 (non-flash)
Aug 14 18:18:45 user nova-compute[73078]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:18:45 user nova-compute[73078]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b (non-flash)
Aug 14 18:18:45 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.540s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] HCTL ('40', '-', '-', 0) found on session 27 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fde88ef-55d7-415a-89b0-39d506f2fce3]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Searching for a device in session 27 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:18:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CjoSegxs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:18:46 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:18:46 user nova-compute[73078]: DEBUG nova.network.neutron [req-09fdbd88-f980-430f-95da-14bbfe936f4a req-479fd516-3b16-4bb9-a3c8-c057a5ce71b1 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Updated VIF entry in instance network info cache for port 9f1350b2-c0dd-4818-a941-22f37f92e610. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:18:46 user nova-compute[73078]: DEBUG nova.network.neutron [req-09fdbd88-f980-430f-95da-14bbfe936f4a req-479fd516-3b16-4bb9-a3c8-c057a5ce71b1 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Updating instance_info_cache with network_info: [{"id": "9f1350b2-c0dd-4818-a941-22f37f92e610", "address": "fa:16:3e:6a:9a:37", "network": {"id": "aefa1b37-86f6-4b56-a958-52e56c6af504", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-370961776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1350b2-c0", "ovs_interfaceid": "9f1350b2-c0dd-4818-a941-22f37f92e610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd713ad0-5a38-4d0e-8f2c-2c388a9f6849", "address": "fa:16:3e:f2:47:21", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd713ad0-5a", "ovs_interfaceid": "fd713ad0-5a38-4d0e-8f2c-2c388a9f6849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "62809f7b-d1f3-4cae-9685-107e5008c9eb", "address": "fa:16:3e:94:eb:d7", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62809f7b-d1", "ovs_interfaceid": "62809f7b-d1f3-4cae-9685-107e5008c9eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1054bcf2-2aa6-4112-bd95-9d471c3f63cd", "address": "fa:16:3e:79:2c:7b", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1054bcf2-2a", "ovs_interfaceid": "1054bcf2-2aa6-4112-bd95-9d471c3f63cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10e5877a-b0ba-449a-81db-1ecf3e760851", "address": "fa:16:3e:ec:f7:8e", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e5877a-b0", "ovs_interfaceid": "10e5877a-b0ba-449a-81db-1ecf3e760851", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc245bed-0f7e-49a7-a6af-71072040d109", "address": "fa:16:3e:f9:96:4c", "network": {"id": "5a386415-85db-4304-a0f0-65460a1f8308", "bridge": "br-int", "label": "tempest-device-tagging-net2-529646808", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc245bed-0f", "ovs_interfaceid": "dc245bed-0f7e-49a7-a6af-71072040d109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ebbf2bd-0d73-4374-a69e-0f0c3e018c85", "address": "fa:16:3e:ee:37:9e", "network": {"id": "5a386415-85db-4304-a0f0-65460a1f8308", "bridge": "br-int", "label": "tempest-device-tagging-net2-529646808", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ebbf2bd-0d", "ovs_interfaceid": "1ebbf2bd-0d73-4374-a69e-0f0c3e018c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:18:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-09fdbd88-f980-430f-95da-14bbfe936f4a req-479fd516-3b16-4bb9-a3c8-c057a5ce71b1 service nova] Releasing lock "refresh_cache-83aca621-7182-49a9-b4b3-8f22dd50f869" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:18:46 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.591s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:18:46 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] <== connect_volume: return (1593ms) {'type': 'block', 'scsi_wwn': '23366376639633863', 'path': '/dev/sdi'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:18:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366376639633863', 'path': '/dev/sdi'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:18:46 user nova-compute[73078]: DEBUG nova.objects.instance [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lazy-loading 'flavor' on Instance uuid 7783c26e-ec61-4375-b191-0ce5caf766c7 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:18:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 18:18:46 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:18:46 user nova-compute[73078]:   <source dev="/dev/sdi"/>
Aug 14 18:18:46 user nova-compute[73078]:   <target dev="vdc" bus="virtio"/>
Aug 14 18:18:46 user nova-compute[73078]:   <serial>1f6c1459-af42-46ce-947e-9866de0be93b</serial>
Aug 14 18:18:46 user nova-compute[73078]: </disk>
Aug 14 18:18:46 user nova-compute[73078]:  {{(pid=73078) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 18:18:47 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:18:47 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:18:47 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:18:47 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Rebuilding the list of instances to heal {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 18:18:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-de80e188-9385-4613-8a6c-aa72b624ad55" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:18:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-de80e188-9385-4613-8a6c-aa72b624ad55" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:18:47 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:18:47 user nova-compute[73078]: DEBUG nova.objects.instance [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lazy-loading 'info_cache' on Instance uuid de80e188-9385-4613-8a6c-aa72b624ad55 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:18:47 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:18:47 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:18:47 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:18:47 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] No VIF found with MAC fa:16:3e:f7:07:98, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:18:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ba8d2e09-1b8e-4d89-8e00-05ea488b16e4 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "7783c26e-ec61-4375-b191-0ce5caf766c7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.987s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:47 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Updating instance_info_cache with network_info: [{"id": "2afe973c-46fa-4336-996f-b5dcd374c96e", "address": "fa:16:3e:5d:60:2f", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe973c-46", "ovs_interfaceid": "2afe973c-46fa-4336-996f-b5dcd374c96e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:18:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-de80e188-9385-4613-8a6c-aa72b624ad55" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:18:47 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:18:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-afba1884-4970-4dd7-a51f-f66fbfb41eed tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Acquiring lock "7783c26e-ec61-4375-b191-0ce5caf766c7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-afba1884-4970-4dd7-a51f-f66fbfb41eed tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "7783c26e-ec61-4375-b191-0ce5caf766c7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:48 user nova-compute[73078]: INFO nova.compute.manager [None req-afba1884-4970-4dd7-a51f-f66fbfb41eed tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Detaching volume 1f6c1459-af42-46ce-947e-9866de0be93b
Aug 14 18:18:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Acquiring lock "83aca621-7182-49a9-b4b3-8f22dd50f869" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Acquiring lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:48 user nova-compute[73078]: INFO nova.compute.manager [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Terminating instance
Aug 14 18:18:48 user nova-compute[73078]: INFO nova.virt.block_device [None req-afba1884-4970-4dd7-a51f-f66fbfb41eed tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Attempting to driver detach volume 1f6c1459-af42-46ce-947e-9866de0be93b from mountpoint /dev/vdc
Aug 14 18:18:48 user nova-compute[73078]: DEBUG nova.compute.manager [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-afba1884-4970-4dd7-a51f-f66fbfb41eed tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Attempting to detach device vdc from instance 7783c26e-ec61-4375-b191-0ce5caf766c7 from the persistent domain config. {{(pid=73078) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-afba1884-4970-4dd7-a51f-f66fbfb41eed tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:18:48 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:18:48 user nova-compute[73078]:   <source dev="/dev/sdi"/>
Aug 14 18:18:48 user nova-compute[73078]:   <target dev="vdc" bus="virtio"/>
Aug 14 18:18:48 user nova-compute[73078]:   <serial>1f6c1459-af42-46ce-947e-9866de0be93b</serial>
Aug 14 18:18:48 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 18:18:48 user nova-compute[73078]: </disk>
Aug 14 18:18:48 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:18:48 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-afba1884-4970-4dd7-a51f-f66fbfb41eed tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Successfully detached device vdc from instance 7783c26e-ec61-4375-b191-0ce5caf766c7 from the persistent domain config.
Aug 14 18:18:48 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-afba1884-4970-4dd7-a51f-f66fbfb41eed tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 7783c26e-ec61-4375-b191-0ce5caf766c7 from the live domain config. {{(pid=73078) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-afba1884-4970-4dd7-a51f-f66fbfb41eed tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:18:48 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:18:48 user nova-compute[73078]:   <source dev="/dev/sdi"/>
Aug 14 18:18:48 user nova-compute[73078]:   <target dev="vdc" bus="virtio"/>
Aug 14 18:18:48 user nova-compute[73078]:   <serial>1f6c1459-af42-46ce-947e-9866de0be93b</serial>
Aug 14 18:18:48 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 18:18:48 user nova-compute[73078]: </disk>
Aug 14 18:18:48 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Received event <DeviceRemovedEvent: 1692037128.8309758, 7783c26e-ec61-4375-b191-0ce5caf766c7 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73078) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-afba1884-4970-4dd7-a51f-f66fbfb41eed tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 7783c26e-ec61-4375-b191-0ce5caf766c7 {{(pid=73078) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 18:18:48 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-afba1884-4970-4dd7-a51f-f66fbfb41eed tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Successfully detached device vdc from instance 7783c26e-ec61-4375-b191-0ce5caf766c7 from the live domain config.
Aug 14 18:18:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afba1884-4970-4dd7-a51f-f66fbfb41eed tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-afba1884-4970-4dd7-a51f-f66fbfb41eed tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CjoSegxs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:18:48 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-afba1884-4970-4dd7-a51f-f66fbfb41eed tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:18:48 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-afba1884-4970-4dd7-a51f-f66fbfb41eed tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-afba1884-4970-4dd7-a51f-f66fbfb41eed tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-afba1884-4970-4dd7-a51f-f66fbfb41eed tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.049s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b524f364-de62-4520-b2d9-93b04d1549cc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG nova.compute.manager [req-c39f45b9-0e7b-49eb-8cca-4e60c2b07871 req-bf233732-92ae-40ef-8141-ce871545ee27 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-unplugged-fd713ad0-5a38-4d0e-8f2c-2c388a9f6849 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-c39f45b9-0e7b-49eb-8cca-4e60c2b07871 req-bf233732-92ae-40ef-8141-ce871545ee27 service nova] Acquiring lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-c39f45b9-0e7b-49eb-8cca-4e60c2b07871 req-bf233732-92ae-40ef-8141-ce871545ee27 service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-c39f45b9-0e7b-49eb-8cca-4e60c2b07871 req-bf233732-92ae-40ef-8141-ce871545ee27 service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG nova.compute.manager [req-c39f45b9-0e7b-49eb-8cca-4e60c2b07871 req-bf233732-92ae-40ef-8141-ce871545ee27 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] No waiting events found dispatching network-vif-unplugged-fd713ad0-5a38-4d0e-8f2c-2c388a9f6849 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG nova.compute.manager [req-c39f45b9-0e7b-49eb-8cca-4e60c2b07871 req-bf233732-92ae-40ef-8141-ce871545ee27 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-unplugged-fd713ad0-5a38-4d0e-8f2c-2c388a9f6849 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:18:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.053s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9f27e9-939c-43ec-b151-9c0ff8b8ceaa]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-afba1884-4970-4dd7-a51f-f66fbfb41eed tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:18:49 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:18:49 user nova-compute[73078]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)
Aug 14 18:18:49 user nova-compute[73078]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)
Aug 14 18:18:49 user nova-compute[73078]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)
Aug 14 18:18:49 user nova-compute[73078]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 (non-flash)
Aug 14 18:18:49 user nova-compute[73078]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:18:49 user nova-compute[73078]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b (non-flash)
Aug 14 18:18:49 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-afba1884-4970-4dd7-a51f-f66fbfb41eed tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:18:49 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:18:49 user nova-compute[73078]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)
Aug 14 18:18:49 user nova-compute[73078]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)
Aug 14 18:18:49 user nova-compute[73078]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)
Aug 14 18:18:49 user nova-compute[73078]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 (non-flash)
Aug 14 18:18:49 user nova-compute[73078]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:18:49 user nova-compute[73078]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b (non-flash)
Aug 14 18:18:49 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-afba1884-4970-4dd7-a51f-f66fbfb41eed tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9781c8310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b'): ({'sdi'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-afba1884-4970-4dd7-a51f-f66fbfb41eed tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Removing single pathed devices sdi {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG nova.compute.manager [req-48c6844b-166b-4390-ab2c-a086bd6c0c31 req-43ff5ea1-560f-4fbc-b449-76cecfac159b service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-unplugged-9f1350b2-c0dd-4818-a941-22f37f92e610 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-48c6844b-166b-4390-ab2c-a086bd6c0c31 req-43ff5ea1-560f-4fbc-b449-76cecfac159b service nova] Acquiring lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-48c6844b-166b-4390-ab2c-a086bd6c0c31 req-43ff5ea1-560f-4fbc-b449-76cecfac159b service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-48c6844b-166b-4390-ab2c-a086bd6c0c31 req-43ff5ea1-560f-4fbc-b449-76cecfac159b service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG nova.compute.manager [req-48c6844b-166b-4390-ab2c-a086bd6c0c31 req-43ff5ea1-560f-4fbc-b449-76cecfac159b service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] No waiting events found dispatching network-vif-unplugged-9f1350b2-c0dd-4818-a941-22f37f92e610 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG nova.compute.manager [req-48c6844b-166b-4390-ab2c-a086bd6c0c31 req-43ff5ea1-560f-4fbc-b449-76cecfac159b service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-unplugged-9f1350b2-c0dd-4818-a941-22f37f92e610 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.052s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b359ff-167a-4e75-8347-c1e992325e58]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.047s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c6704d-77c0-4790-af6c-c44898864a8b]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-afba1884-4970-4dd7-a51f-f66fbfb41eed tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Flushing IO for device /dev/sdi {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.034s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bef31ed-1a3f-4edc-a576-884aac777d87]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-afba1884-4970-4dd7-a51f-f66fbfb41eed tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.075s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[928baf5c-7cf9-4537-829a-daef4d0cdc38]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-afba1884-4970-4dd7-a51f-f66fbfb41eed tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-afba1884-4970-4dd7-a51f-f66fbfb41eed tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] SCSI volumes sdi have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-afba1884-4970-4dd7-a51f-f66fbfb41eed tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.040s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[682afbb9-af06-43dc-bf78-a127107677af]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-afba1884-4970-4dd7-a51f-f66fbfb41eed tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b -p 172.16.0.220:3260 --logout" returned: 0 in 0.110s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0d5d55-fe67-4be6-8895-e165a4894254]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-afba1884-4970-4dd7-a51f-f66fbfb41eed tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b, portal: 172.16.0.220,3260]
Aug 14 18:18:49 user nova-compute[73078]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b, portal: 172.16.0.220,3260] successful.
Aug 14 18:18:49 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f6c1459-af42-46ce-947e-9866de0be93b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c95e056-718d-4a1d-921b-d8649c59668c]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-afba1884-4970-4dd7-a51f-f66fbfb41eed tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-afba1884-4970-4dd7-a51f-f66fbfb41eed tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.624s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-afba1884-4970-4dd7-a51f-f66fbfb41eed tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] <== disconnect_volume: return (626ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afba1884-4970-4dd7-a51f-f66fbfb41eed tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:18:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e812037c-a0ef-4e60-9041-b382087dc2c5/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-a5086e18-af36-4c07-be95-35a2918cd9b2 req-e012ef9c-020f-4f12-8ed5-21f100b19261 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-plugged-fd713ad0-5a38-4d0e-8f2c-2c388a9f6849 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a5086e18-af36-4c07-be95-35a2918cd9b2 req-e012ef9c-020f-4f12-8ed5-21f100b19261 service nova] Acquiring lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a5086e18-af36-4c07-be95-35a2918cd9b2 req-e012ef9c-020f-4f12-8ed5-21f100b19261 service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a5086e18-af36-4c07-be95-35a2918cd9b2 req-e012ef9c-020f-4f12-8ed5-21f100b19261 service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-a5086e18-af36-4c07-be95-35a2918cd9b2 req-e012ef9c-020f-4f12-8ed5-21f100b19261 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] No waiting events found dispatching network-vif-plugged-fd713ad0-5a38-4d0e-8f2c-2c388a9f6849 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:18:51 user nova-compute[73078]: WARNING nova.compute.manager [req-a5086e18-af36-4c07-be95-35a2918cd9b2 req-e012ef9c-020f-4f12-8ed5-21f100b19261 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received unexpected event network-vif-plugged-fd713ad0-5a38-4d0e-8f2c-2c388a9f6849 for instance with vm_state active and task_state deleting.
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-a5086e18-af36-4c07-be95-35a2918cd9b2 req-e012ef9c-020f-4f12-8ed5-21f100b19261 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-unplugged-1054bcf2-2aa6-4112-bd95-9d471c3f63cd {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a5086e18-af36-4c07-be95-35a2918cd9b2 req-e012ef9c-020f-4f12-8ed5-21f100b19261 service nova] Acquiring lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a5086e18-af36-4c07-be95-35a2918cd9b2 req-e012ef9c-020f-4f12-8ed5-21f100b19261 service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a5086e18-af36-4c07-be95-35a2918cd9b2 req-e012ef9c-020f-4f12-8ed5-21f100b19261 service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-a5086e18-af36-4c07-be95-35a2918cd9b2 req-e012ef9c-020f-4f12-8ed5-21f100b19261 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] No waiting events found dispatching network-vif-unplugged-1054bcf2-2aa6-4112-bd95-9d471c3f63cd {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-a5086e18-af36-4c07-be95-35a2918cd9b2 req-e012ef9c-020f-4f12-8ed5-21f100b19261 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-unplugged-1054bcf2-2aa6-4112-bd95-9d471c3f63cd for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-a5086e18-af36-4c07-be95-35a2918cd9b2 req-e012ef9c-020f-4f12-8ed5-21f100b19261 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-plugged-1054bcf2-2aa6-4112-bd95-9d471c3f63cd {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a5086e18-af36-4c07-be95-35a2918cd9b2 req-e012ef9c-020f-4f12-8ed5-21f100b19261 service nova] Acquiring lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a5086e18-af36-4c07-be95-35a2918cd9b2 req-e012ef9c-020f-4f12-8ed5-21f100b19261 service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a5086e18-af36-4c07-be95-35a2918cd9b2 req-e012ef9c-020f-4f12-8ed5-21f100b19261 service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-a5086e18-af36-4c07-be95-35a2918cd9b2 req-e012ef9c-020f-4f12-8ed5-21f100b19261 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] No waiting events found dispatching network-vif-plugged-1054bcf2-2aa6-4112-bd95-9d471c3f63cd {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:18:51 user nova-compute[73078]: WARNING nova.compute.manager [req-a5086e18-af36-4c07-be95-35a2918cd9b2 req-e012ef9c-020f-4f12-8ed5-21f100b19261 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received unexpected event network-vif-plugged-1054bcf2-2aa6-4112-bd95-9d471c3f63cd for instance with vm_state active and task_state deleting.
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-a5086e18-af36-4c07-be95-35a2918cd9b2 req-e012ef9c-020f-4f12-8ed5-21f100b19261 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-unplugged-10e5877a-b0ba-449a-81db-1ecf3e760851 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a5086e18-af36-4c07-be95-35a2918cd9b2 req-e012ef9c-020f-4f12-8ed5-21f100b19261 service nova] Acquiring lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a5086e18-af36-4c07-be95-35a2918cd9b2 req-e012ef9c-020f-4f12-8ed5-21f100b19261 service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a5086e18-af36-4c07-be95-35a2918cd9b2 req-e012ef9c-020f-4f12-8ed5-21f100b19261 service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-a5086e18-af36-4c07-be95-35a2918cd9b2 req-e012ef9c-020f-4f12-8ed5-21f100b19261 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] No waiting events found dispatching network-vif-unplugged-10e5877a-b0ba-449a-81db-1ecf3e760851 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-a5086e18-af36-4c07-be95-35a2918cd9b2 req-e012ef9c-020f-4f12-8ed5-21f100b19261 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-unplugged-10e5877a-b0ba-449a-81db-1ecf3e760851 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-a5086e18-af36-4c07-be95-35a2918cd9b2 req-e012ef9c-020f-4f12-8ed5-21f100b19261 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-plugged-10e5877a-b0ba-449a-81db-1ecf3e760851 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a5086e18-af36-4c07-be95-35a2918cd9b2 req-e012ef9c-020f-4f12-8ed5-21f100b19261 service nova] Acquiring lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a5086e18-af36-4c07-be95-35a2918cd9b2 req-e012ef9c-020f-4f12-8ed5-21f100b19261 service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a5086e18-af36-4c07-be95-35a2918cd9b2 req-e012ef9c-020f-4f12-8ed5-21f100b19261 service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-a5086e18-af36-4c07-be95-35a2918cd9b2 req-e012ef9c-020f-4f12-8ed5-21f100b19261 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] No waiting events found dispatching network-vif-plugged-10e5877a-b0ba-449a-81db-1ecf3e760851 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:18:51 user nova-compute[73078]: WARNING nova.compute.manager [req-a5086e18-af36-4c07-be95-35a2918cd9b2 req-e012ef9c-020f-4f12-8ed5-21f100b19261 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received unexpected event network-vif-plugged-10e5877a-b0ba-449a-81db-1ecf3e760851 for instance with vm_state active and task_state deleting.
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-a5086e18-af36-4c07-be95-35a2918cd9b2 req-e012ef9c-020f-4f12-8ed5-21f100b19261 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-unplugged-1ebbf2bd-0d73-4374-a69e-0f0c3e018c85 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a5086e18-af36-4c07-be95-35a2918cd9b2 req-e012ef9c-020f-4f12-8ed5-21f100b19261 service nova] Acquiring lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a5086e18-af36-4c07-be95-35a2918cd9b2 req-e012ef9c-020f-4f12-8ed5-21f100b19261 service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a5086e18-af36-4c07-be95-35a2918cd9b2 req-e012ef9c-020f-4f12-8ed5-21f100b19261 service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-a5086e18-af36-4c07-be95-35a2918cd9b2 req-e012ef9c-020f-4f12-8ed5-21f100b19261 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] No waiting events found dispatching network-vif-unplugged-1ebbf2bd-0d73-4374-a69e-0f0c3e018c85 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-a5086e18-af36-4c07-be95-35a2918cd9b2 req-e012ef9c-020f-4f12-8ed5-21f100b19261 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-unplugged-1ebbf2bd-0d73-4374-a69e-0f0c3e018c85 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:18:51 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Instance destroyed successfully.
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.objects.instance [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Lazy-loading 'resources' on Instance uuid 83aca621-7182-49a9-b4b3-8f22dd50f869 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-37430151-ceaf-4327-a746-0bdbf50987b9 req-6bd36ac4-26f0-450f-9641-1ce4d52791ca service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-plugged-9f1350b2-c0dd-4818-a941-22f37f92e610 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-37430151-ceaf-4327-a746-0bdbf50987b9 req-6bd36ac4-26f0-450f-9641-1ce4d52791ca service nova] Acquiring lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-37430151-ceaf-4327-a746-0bdbf50987b9 req-6bd36ac4-26f0-450f-9641-1ce4d52791ca service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-37430151-ceaf-4327-a746-0bdbf50987b9 req-6bd36ac4-26f0-450f-9641-1ce4d52791ca service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-37430151-ceaf-4327-a746-0bdbf50987b9 req-6bd36ac4-26f0-450f-9641-1ce4d52791ca service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] No waiting events found dispatching network-vif-plugged-9f1350b2-c0dd-4818-a941-22f37f92e610 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:18:51 user nova-compute[73078]: WARNING nova.compute.manager [req-37430151-ceaf-4327-a746-0bdbf50987b9 req-6bd36ac4-26f0-450f-9641-1ce4d52791ca service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received unexpected event network-vif-plugged-9f1350b2-c0dd-4818-a941-22f37f92e610 for instance with vm_state active and task_state deleting.
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-37430151-ceaf-4327-a746-0bdbf50987b9 req-6bd36ac4-26f0-450f-9641-1ce4d52791ca service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-unplugged-62809f7b-d1f3-4cae-9685-107e5008c9eb {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-37430151-ceaf-4327-a746-0bdbf50987b9 req-6bd36ac4-26f0-450f-9641-1ce4d52791ca service nova] Acquiring lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-37430151-ceaf-4327-a746-0bdbf50987b9 req-6bd36ac4-26f0-450f-9641-1ce4d52791ca service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-37430151-ceaf-4327-a746-0bdbf50987b9 req-6bd36ac4-26f0-450f-9641-1ce4d52791ca service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-37430151-ceaf-4327-a746-0bdbf50987b9 req-6bd36ac4-26f0-450f-9641-1ce4d52791ca service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] No waiting events found dispatching network-vif-unplugged-62809f7b-d1f3-4cae-9685-107e5008c9eb {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-37430151-ceaf-4327-a746-0bdbf50987b9 req-6bd36ac4-26f0-450f-9641-1ce4d52791ca service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-unplugged-62809f7b-d1f3-4cae-9685-107e5008c9eb for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-37430151-ceaf-4327-a746-0bdbf50987b9 req-6bd36ac4-26f0-450f-9641-1ce4d52791ca service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-plugged-62809f7b-d1f3-4cae-9685-107e5008c9eb {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-37430151-ceaf-4327-a746-0bdbf50987b9 req-6bd36ac4-26f0-450f-9641-1ce4d52791ca service nova] Acquiring lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-37430151-ceaf-4327-a746-0bdbf50987b9 req-6bd36ac4-26f0-450f-9641-1ce4d52791ca service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-37430151-ceaf-4327-a746-0bdbf50987b9 req-6bd36ac4-26f0-450f-9641-1ce4d52791ca service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-37430151-ceaf-4327-a746-0bdbf50987b9 req-6bd36ac4-26f0-450f-9641-1ce4d52791ca service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] No waiting events found dispatching network-vif-plugged-62809f7b-d1f3-4cae-9685-107e5008c9eb {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:18:51 user nova-compute[73078]: WARNING nova.compute.manager [req-37430151-ceaf-4327-a746-0bdbf50987b9 req-6bd36ac4-26f0-450f-9641-1ce4d52791ca service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received unexpected event network-vif-plugged-62809f7b-d1f3-4cae-9685-107e5008c9eb for instance with vm_state active and task_state deleting.
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-37430151-ceaf-4327-a746-0bdbf50987b9 req-6bd36ac4-26f0-450f-9641-1ce4d52791ca service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-unplugged-dc245bed-0f7e-49a7-a6af-71072040d109 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-37430151-ceaf-4327-a746-0bdbf50987b9 req-6bd36ac4-26f0-450f-9641-1ce4d52791ca service nova] Acquiring lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-37430151-ceaf-4327-a746-0bdbf50987b9 req-6bd36ac4-26f0-450f-9641-1ce4d52791ca service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-37430151-ceaf-4327-a746-0bdbf50987b9 req-6bd36ac4-26f0-450f-9641-1ce4d52791ca service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-37430151-ceaf-4327-a746-0bdbf50987b9 req-6bd36ac4-26f0-450f-9641-1ce4d52791ca service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] No waiting events found dispatching network-vif-unplugged-dc245bed-0f7e-49a7-a6af-71072040d109 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-37430151-ceaf-4327-a746-0bdbf50987b9 req-6bd36ac4-26f0-450f-9641-1ce4d52791ca service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-unplugged-dc245bed-0f7e-49a7-a6af-71072040d109 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-37430151-ceaf-4327-a746-0bdbf50987b9 req-6bd36ac4-26f0-450f-9641-1ce4d52791ca service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-plugged-dc245bed-0f7e-49a7-a6af-71072040d109 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-37430151-ceaf-4327-a746-0bdbf50987b9 req-6bd36ac4-26f0-450f-9641-1ce4d52791ca service nova] Acquiring lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-37430151-ceaf-4327-a746-0bdbf50987b9 req-6bd36ac4-26f0-450f-9641-1ce4d52791ca service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-37430151-ceaf-4327-a746-0bdbf50987b9 req-6bd36ac4-26f0-450f-9641-1ce4d52791ca service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-37430151-ceaf-4327-a746-0bdbf50987b9 req-6bd36ac4-26f0-450f-9641-1ce4d52791ca service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] No waiting events found dispatching network-vif-plugged-dc245bed-0f7e-49a7-a6af-71072040d109 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:18:51 user nova-compute[73078]: WARNING nova.compute.manager [req-37430151-ceaf-4327-a746-0bdbf50987b9 req-6bd36ac4-26f0-450f-9641-1ce4d52791ca service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received unexpected event network-vif-plugged-dc245bed-0f7e-49a7-a6af-71072040d109 for instance with vm_state active and task_state deleting.
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-443983221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-443983221',id=20,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHd9bG/5KkbQ9FbKOJ/d6gIa527ZUD7wURLK3IAXPNF94fE9wh+JxFHpVmaAMdvABr+vLMBrDq+zluqLpRUFR9/dqQ1SI0JVgXG+rXidtHm8tRYydztbckUOre9Kg1WkCw==',key_name='tempest-keypair-228573238',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:17:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ed67729880341ffb35e2e668fd80e95',ramdisk_id='',reservation_id='r-q4nnps0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-95949371',owner_user_name='tempest-TaggedBootDevicesTest_v242-95949371-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:17:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aced5b7859ff428ba065909862c08da0',uuid=83aca621-7182-49a9-b4b3-8f22dd50f869,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f1350b2-c0dd-4818-a941-22f37f92e610", "address": "fa:16:3e:6a:9a:37", "network": {"id": "aefa1b37-86f6-4b56-a958-52e56c6af504", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-370961776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1350b2-c0", "ovs_interfaceid": "9f1350b2-c0dd-4818-a941-22f37f92e610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converting VIF {"id": "9f1350b2-c0dd-4818-a941-22f37f92e610", "address": "fa:16:3e:6a:9a:37", "network": {"id": "aefa1b37-86f6-4b56-a958-52e56c6af504", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-370961776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1350b2-c0", "ovs_interfaceid": "9f1350b2-c0dd-4818-a941-22f37f92e610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:9a:37,bridge_name='br-int',has_traffic_filtering=True,id=9f1350b2-c0dd-4818-a941-22f37f92e610,network=Network(aefa1b37-86f6-4b56-a958-52e56c6af504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f1350b2-c0') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG os_vif [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:9a:37,bridge_name='br-int',has_traffic_filtering=True,id=9f1350b2-c0dd-4818-a941-22f37f92e610,network=Network(aefa1b37-86f6-4b56-a958-52e56c6af504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f1350b2-c0') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e812037c-a0ef-4e60-9041-b382087dc2c5/disk --force-share --output=json" returned: 0 in 0.316s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f1350b2-c0, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e812037c-a0ef-4e60-9041-b382087dc2c5/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:51 user nova-compute[73078]: INFO os_vif [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:9a:37,bridge_name='br-int',has_traffic_filtering=True,id=9f1350b2-c0dd-4818-a941-22f37f92e610,network=Network(aefa1b37-86f6-4b56-a958-52e56c6af504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f1350b2-c0')
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-443983221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-443983221',id=20,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHd9bG/5KkbQ9FbKOJ/d6gIa527ZUD7wURLK3IAXPNF94fE9wh+JxFHpVmaAMdvABr+vLMBrDq+zluqLpRUFR9/dqQ1SI0JVgXG+rXidtHm8tRYydztbckUOre9Kg1WkCw==',key_name='tempest-keypair-228573238',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:17:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ed67729880341ffb35e2e668fd80e95',ramdisk_id='',reservation_id='r-q4nnps0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-95949371',owner_user_name='tempest-TaggedBootDevicesTest_v242-95949371-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:17:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aced5b7859ff428ba065909862c08da0',uuid=83aca621-7182-49a9-b4b3-8f22dd50f869,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd713ad0-5a38-4d0e-8f2c-2c388a9f6849", "address": "fa:16:3e:f2:47:21", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd713ad0-5a", "ovs_interfaceid": "fd713ad0-5a38-4d0e-8f2c-2c388a9f6849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converting VIF {"id": "fd713ad0-5a38-4d0e-8f2c-2c388a9f6849", "address": "fa:16:3e:f2:47:21", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd713ad0-5a", "ovs_interfaceid": "fd713ad0-5a38-4d0e-8f2c-2c388a9f6849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:47:21,bridge_name='br-int',has_traffic_filtering=True,id=fd713ad0-5a38-4d0e-8f2c-2c388a9f6849,network=Network(7eb2af8e-a61c-4a54-9b96-5be2573c5e65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd713ad0-5a') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG os_vif [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:47:21,bridge_name='br-int',has_traffic_filtering=True,id=fd713ad0-5a38-4d0e-8f2c-2c388a9f6849,network=Network(7eb2af8e-a61c-4a54-9b96-5be2573c5e65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd713ad0-5a') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd713ad0-5a, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:51 user nova-compute[73078]: INFO os_vif [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:47:21,bridge_name='br-int',has_traffic_filtering=True,id=fd713ad0-5a38-4d0e-8f2c-2c388a9f6849,network=Network(7eb2af8e-a61c-4a54-9b96-5be2573c5e65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd713ad0-5a')
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-443983221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-443983221',id=20,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHd9bG/5KkbQ9FbKOJ/d6gIa527ZUD7wURLK3IAXPNF94fE9wh+JxFHpVmaAMdvABr+vLMBrDq+zluqLpRUFR9/dqQ1SI0JVgXG+rXidtHm8tRYydztbckUOre9Kg1WkCw==',key_name='tempest-keypair-228573238',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:17:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ed67729880341ffb35e2e668fd80e95',ramdisk_id='',reservation_id='r-q4nnps0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-95949371',owner_user_name='tempest-TaggedBootDevicesTest_v242-95949371-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:17:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aced5b7859ff428ba065909862c08da0',uuid=83aca621-7182-49a9-b4b3-8f22dd50f869,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62809f7b-d1f3-4cae-9685-107e5008c9eb", "address": "fa:16:3e:94:eb:d7", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62809f7b-d1", "ovs_interfaceid": "62809f7b-d1f3-4cae-9685-107e5008c9eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converting VIF {"id": "62809f7b-d1f3-4cae-9685-107e5008c9eb", "address": "fa:16:3e:94:eb:d7", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62809f7b-d1", "ovs_interfaceid": "62809f7b-d1f3-4cae-9685-107e5008c9eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:eb:d7,bridge_name='br-int',has_traffic_filtering=True,id=62809f7b-d1f3-4cae-9685-107e5008c9eb,network=Network(7eb2af8e-a61c-4a54-9b96-5be2573c5e65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap62809f7b-d1') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG os_vif [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:eb:d7,bridge_name='br-int',has_traffic_filtering=True,id=62809f7b-d1f3-4cae-9685-107e5008c9eb,network=Network(7eb2af8e-a61c-4a54-9b96-5be2573c5e65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap62809f7b-d1') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62809f7b-d1, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:51 user nova-compute[73078]: INFO os_vif [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:eb:d7,bridge_name='br-int',has_traffic_filtering=True,id=62809f7b-d1f3-4cae-9685-107e5008c9eb,network=Network(7eb2af8e-a61c-4a54-9b96-5be2573c5e65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap62809f7b-d1')
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-443983221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-443983221',id=20,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHd9bG/5KkbQ9FbKOJ/d6gIa527ZUD7wURLK3IAXPNF94fE9wh+JxFHpVmaAMdvABr+vLMBrDq+zluqLpRUFR9/dqQ1SI0JVgXG+rXidtHm8tRYydztbckUOre9Kg1WkCw==',key_name='tempest-keypair-228573238',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:17:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ed67729880341ffb35e2e668fd80e95',ramdisk_id='',reservation_id='r-q4nnps0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-95949371',owner_user_name='tempest-TaggedBootDevicesTest_v242-95949371-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:17:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aced5b7859ff428ba065909862c08da0',uuid=83aca621-7182-49a9-b4b3-8f22dd50f869,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1054bcf2-2aa6-4112-bd95-9d471c3f63cd", "address": "fa:16:3e:79:2c:7b", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1054bcf2-2a", "ovs_interfaceid": "1054bcf2-2aa6-4112-bd95-9d471c3f63cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converting VIF {"id": "1054bcf2-2aa6-4112-bd95-9d471c3f63cd", "address": "fa:16:3e:79:2c:7b", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1054bcf2-2a", "ovs_interfaceid": "1054bcf2-2aa6-4112-bd95-9d471c3f63cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:2c:7b,bridge_name='br-int',has_traffic_filtering=True,id=1054bcf2-2aa6-4112-bd95-9d471c3f63cd,network=Network(7eb2af8e-a61c-4a54-9b96-5be2573c5e65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1054bcf2-2a') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG os_vif [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:2c:7b,bridge_name='br-int',has_traffic_filtering=True,id=1054bcf2-2aa6-4112-bd95-9d471c3f63cd,network=Network(7eb2af8e-a61c-4a54-9b96-5be2573c5e65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1054bcf2-2a') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1054bcf2-2a, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e812037c-a0ef-4e60-9041-b382087dc2c5/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:51 user nova-compute[73078]: INFO os_vif [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:2c:7b,bridge_name='br-int',has_traffic_filtering=True,id=1054bcf2-2aa6-4112-bd95-9d471c3f63cd,network=Network(7eb2af8e-a61c-4a54-9b96-5be2573c5e65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1054bcf2-2a')
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-443983221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-443983221',id=20,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHd9bG/5KkbQ9FbKOJ/d6gIa527ZUD7wURLK3IAXPNF94fE9wh+JxFHpVmaAMdvABr+vLMBrDq+zluqLpRUFR9/dqQ1SI0JVgXG+rXidtHm8tRYydztbckUOre9Kg1WkCw==',key_name='tempest-keypair-228573238',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:17:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ed67729880341ffb35e2e668fd80e95',ramdisk_id='',reservation_id='r-q4nnps0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-95949371',owner_user_name='tempest-TaggedBootDevicesTest_v242-95949371-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:17:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aced5b7859ff428ba065909862c08da0',uuid=83aca621-7182-49a9-b4b3-8f22dd50f869,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10e5877a-b0ba-449a-81db-1ecf3e760851", "address": "fa:16:3e:ec:f7:8e", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e5877a-b0", "ovs_interfaceid": "10e5877a-b0ba-449a-81db-1ecf3e760851", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converting VIF {"id": "10e5877a-b0ba-449a-81db-1ecf3e760851", "address": "fa:16:3e:ec:f7:8e", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e5877a-b0", "ovs_interfaceid": "10e5877a-b0ba-449a-81db-1ecf3e760851", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:f7:8e,bridge_name='br-int',has_traffic_filtering=True,id=10e5877a-b0ba-449a-81db-1ecf3e760851,network=Network(7eb2af8e-a61c-4a54-9b96-5be2573c5e65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e5877a-b0') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG os_vif [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:f7:8e,bridge_name='br-int',has_traffic_filtering=True,id=10e5877a-b0ba-449a-81db-1ecf3e760851,network=Network(7eb2af8e-a61c-4a54-9b96-5be2573c5e65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e5877a-b0') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10e5877a-b0, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7783c26e-ec61-4375-b191-0ce5caf766c7/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:51 user nova-compute[73078]: INFO os_vif [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:f7:8e,bridge_name='br-int',has_traffic_filtering=True,id=10e5877a-b0ba-449a-81db-1ecf3e760851,network=Network(7eb2af8e-a61c-4a54-9b96-5be2573c5e65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e5877a-b0')
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-443983221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-443983221',id=20,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHd9bG/5KkbQ9FbKOJ/d6gIa527ZUD7wURLK3IAXPNF94fE9wh+JxFHpVmaAMdvABr+vLMBrDq+zluqLpRUFR9/dqQ1SI0JVgXG+rXidtHm8tRYydztbckUOre9Kg1WkCw==',key_name='tempest-keypair-228573238',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:17:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ed67729880341ffb35e2e668fd80e95',ramdisk_id='',reservation_id='r-q4nnps0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-95949371',owner_user_name='tempest-TaggedBootDevicesTest_v242-95949371-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:17:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aced5b7859ff428ba065909862c08da0',uuid=83aca621-7182-49a9-b4b3-8f22dd50f869,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc245bed-0f7e-49a7-a6af-71072040d109", "address": "fa:16:3e:f9:96:4c", "network": {"id": "5a386415-85db-4304-a0f0-65460a1f8308", "bridge": "br-int", "label": "tempest-device-tagging-net2-529646808", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc245bed-0f", "ovs_interfaceid": "dc245bed-0f7e-49a7-a6af-71072040d109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converting VIF {"id": "dc245bed-0f7e-49a7-a6af-71072040d109", "address": "fa:16:3e:f9:96:4c", "network": {"id": "5a386415-85db-4304-a0f0-65460a1f8308", "bridge": "br-int", "label": "tempest-device-tagging-net2-529646808", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc245bed-0f", "ovs_interfaceid": "dc245bed-0f7e-49a7-a6af-71072040d109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:96:4c,bridge_name='br-int',has_traffic_filtering=True,id=dc245bed-0f7e-49a7-a6af-71072040d109,network=Network(5a386415-85db-4304-a0f0-65460a1f8308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc245bed-0f') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG os_vif [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:96:4c,bridge_name='br-int',has_traffic_filtering=True,id=dc245bed-0f7e-49a7-a6af-71072040d109,network=Network(5a386415-85db-4304-a0f0-65460a1f8308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc245bed-0f') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc245bed-0f, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:51 user nova-compute[73078]: INFO os_vif [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:96:4c,bridge_name='br-int',has_traffic_filtering=True,id=dc245bed-0f7e-49a7-a6af-71072040d109,network=Network(5a386415-85db-4304-a0f0-65460a1f8308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc245bed-0f')
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T18:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-443983221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-443983221',id=20,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHd9bG/5KkbQ9FbKOJ/d6gIa527ZUD7wURLK3IAXPNF94fE9wh+JxFHpVmaAMdvABr+vLMBrDq+zluqLpRUFR9/dqQ1SI0JVgXG+rXidtHm8tRYydztbckUOre9Kg1WkCw==',key_name='tempest-keypair-228573238',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:17:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ed67729880341ffb35e2e668fd80e95',ramdisk_id='',reservation_id='r-q4nnps0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-95949371',owner_user_name='tempest-TaggedBootDevicesTest_v242-95949371-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:17:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aced5b7859ff428ba065909862c08da0',uuid=83aca621-7182-49a9-b4b3-8f22dd50f869,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ebbf2bd-0d73-4374-a69e-0f0c3e018c85", "address": "fa:16:3e:ee:37:9e", "network": {"id": "5a386415-85db-4304-a0f0-65460a1f8308", "bridge": "br-int", "label": "tempest-device-tagging-net2-529646808", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ebbf2bd-0d", "ovs_interfaceid": "1ebbf2bd-0d73-4374-a69e-0f0c3e018c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converting VIF {"id": "1ebbf2bd-0d73-4374-a69e-0f0c3e018c85", "address": "fa:16:3e:ee:37:9e", "network": {"id": "5a386415-85db-4304-a0f0-65460a1f8308", "bridge": "br-int", "label": "tempest-device-tagging-net2-529646808", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ebbf2bd-0d", "ovs_interfaceid": "1ebbf2bd-0d73-4374-a69e-0f0c3e018c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:37:9e,bridge_name='br-int',has_traffic_filtering=True,id=1ebbf2bd-0d73-4374-a69e-0f0c3e018c85,network=Network(5a386415-85db-4304-a0f0-65460a1f8308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ebbf2bd-0d') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG os_vif [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:37:9e,bridge_name='br-int',has_traffic_filtering=True,id=1ebbf2bd-0d73-4374-a69e-0f0c3e018c85,network=Network(5a386415-85db-4304-a0f0-65460a1f8308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ebbf2bd-0d') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ebbf2bd-0d, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:51 user nova-compute[73078]: INFO os_vif [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:37:9e,bridge_name='br-int',has_traffic_filtering=True,id=1ebbf2bd-0d73-4374-a69e-0f0c3e018c85,network=Network(5a386415-85db-4304-a0f0-65460a1f8308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ebbf2bd-0d')
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'srPiadgv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:18:51 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:18:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.objects.instance [None req-afba1884-4970-4dd7-a51f-f66fbfb41eed tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lazy-loading 'flavor' on Instance uuid 7783c26e-ec61-4375-b191-0ce5caf766c7 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1cc642-d719-434f-a30d-830eb27f461a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-afba1884-4970-4dd7-a51f-f66fbfb41eed tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "7783c26e-ec61-4375-b191-0ce5caf766c7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.571s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37d2b35-cfd3-42cb-b518-ae9edd8517d7]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:18:51 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:18:51 user nova-compute[73078]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)
Aug 14 18:18:51 user nova-compute[73078]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)
Aug 14 18:18:51 user nova-compute[73078]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)
Aug 14 18:18:51 user nova-compute[73078]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 (non-flash)
Aug 14 18:18:51 user nova-compute[73078]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:18:51 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:18:51 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:18:51 user nova-compute[73078]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a (non-flash)
Aug 14 18:18:51 user nova-compute[73078]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)
Aug 14 18:18:51 user nova-compute[73078]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)
Aug 14 18:18:51 user nova-compute[73078]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 (non-flash)
Aug 14 18:18:51 user nova-compute[73078]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:18:51 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe97879d510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a'): ({'sde'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Removing single pathed devices sde {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7783c26e-ec61-4375-b191-0ce5caf766c7/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7783c26e-ec61-4375-b191-0ce5caf766c7/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1024b660-eef8-4429-bcff-8023b5d570c2]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69bf12a-9b69-4cee-9c28-ae089f82cbe7]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Flushing IO for device /dev/sde {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9a828a-9e54-42b5-9dc9-2ff020ff06e3]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de16b50-cfa5-46c1-b613-e7a6b507fbbc]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] SCSI volumes sde have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d101b0-5351-47b1-8f15-ba3d82ecae6e]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7783c26e-ec61-4375-b191-0ce5caf766c7/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:18:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d9bd5e-5dd5-489b-975a-555d32bc21bc]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a, portal: 172.16.0.220,3260]
Aug 14 18:18:52 user nova-compute[73078]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a, portal: 172.16.0.220,3260] successful.
Aug 14 18:18:52 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d451bb3-f3ac-4eee-ae2e-722f3db4887a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7572ef2-b5e4-4d4b-9050-b8340e76a114]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.409s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] <== disconnect_volume: return (411ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'agyfqtiw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:18:52 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2442366c-d333-49df-98d4-f8e769caebf3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97c4522-5ccc-4a26-bcd8-1c630e979dd9]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:18:52 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:18:52 user nova-compute[73078]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)
Aug 14 18:18:52 user nova-compute[73078]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)
Aug 14 18:18:52 user nova-compute[73078]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 (non-flash)
Aug 14 18:18:52 user nova-compute[73078]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:18:52 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:18:52 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:18:52 user nova-compute[73078]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a (non-flash)
Aug 14 18:18:52 user nova-compute[73078]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)
Aug 14 18:18:52 user nova-compute[73078]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 (non-flash)
Aug 14 18:18:52 user nova-compute[73078]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:18:52 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9782f68c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a'): ({'sdf'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Removing single pathed devices sdf {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f85826-880a-4d17-9115-70fb653e5b34]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[12aa24fa-ce5a-4b63-9ec0-82362612faf2]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Flushing IO for device /dev/sdf {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a65ec7-e972-4f79-92a3-a68c368a62de]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.062s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a647de19-461e-46d9-9974-1e25673342d9]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] SCSI volumes sdf have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabd17f0-3a28-46e2-a2c3-f97bc9bb2bbf]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9105dfe4-5886-4644-9ca9-fc4b017d352b]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a, portal: 172.16.0.220,3260]
Aug 14 18:18:52 user nova-compute[73078]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a, portal: 172.16.0.220,3260] successful.
Aug 14 18:18:52 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8454ec2f-377b-4ee8-8336-b663cb778b9a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d548e7-42f9-4116-86b4-bb7bf395ec99]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.414s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] <== disconnect_volume: return (416ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CnaYhpRj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:18:52 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5293e4ab-c5e6-4833-98d4-10d430dc2279]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25d923b-1014-4ca8-9321-21373c043862]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:18:52 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:18:52 user nova-compute[73078]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)
Aug 14 18:18:52 user nova-compute[73078]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 (non-flash)
Aug 14 18:18:52 user nova-compute[73078]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:18:52 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:18:52 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:18:52 user nova-compute[73078]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 (non-flash)
Aug 14 18:18:52 user nova-compute[73078]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 (non-flash)
Aug 14 18:18:52 user nova-compute[73078]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:18:52 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9782f68c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147'): ({'sdg'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Removing single pathed devices sdg {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5012055-929e-4d57-811d-2f59e58c9473]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Acquiring lock "ef110d5f-afb5-415c-9590-29da006734a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lock "ef110d5f-afb5-415c-9590-29da006734a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ce15af-514e-41d0-afcd-937b8d631ce2]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Flushing IO for device /dev/sdg {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d369140-c68a-41e4-ad59-eb852d5ec847]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG nova.compute.manager [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.055s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[616e1e8b-1d50-46af-88b7-d8183b8e7a3b]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] SCSI volumes sdg have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fe8a9d-d174-44de-aa2c-ab8f9fb87b36]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:18:52 user nova-compute[73078]: INFO nova.compute.claims [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Claim successful on node user
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[296bd025-2071-4325-a393-c145e74b3987]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147, portal: 172.16.0.220,3260]
Aug 14 18:18:52 user nova-compute[73078]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147, portal: 172.16.0.220,3260] successful.
Aug 14 18:18:52 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b41a12c-4452-402b-a744-4d9d2f5f1147 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b10a682-b585-44e3-b176-1cf48b8fc3c6]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] <== disconnect_volume: return (384ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:18:52 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Deleting instance files /opt/stack/data/nova/instances/83aca621-7182-49a9-b4b3-8f22dd50f869_del
Aug 14 18:18:52 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Deletion of /opt/stack/data/nova/instances/83aca621-7182-49a9-b4b3-8f22dd50f869_del complete
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:53 user nova-compute[73078]: INFO nova.compute.manager [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Took 4.78 seconds to destroy the instance on the hypervisor.
Aug 14 18:18:53 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG nova.compute.manager [req-6b65f3de-2000-4662-8cc9-ddce498253ac req-8f3b7a11-1b26-4cf2-bd83-2105ec0a6e2b service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-plugged-1ebbf2bd-0d73-4374-a69e-0f0c3e018c85 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6b65f3de-2000-4662-8cc9-ddce498253ac req-8f3b7a11-1b26-4cf2-bd83-2105ec0a6e2b service nova] Acquiring lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6b65f3de-2000-4662-8cc9-ddce498253ac req-8f3b7a11-1b26-4cf2-bd83-2105ec0a6e2b service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6b65f3de-2000-4662-8cc9-ddce498253ac req-8f3b7a11-1b26-4cf2-bd83-2105ec0a6e2b service nova] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG nova.compute.manager [req-6b65f3de-2000-4662-8cc9-ddce498253ac req-8f3b7a11-1b26-4cf2-bd83-2105ec0a6e2b service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] No waiting events found dispatching network-vif-plugged-1ebbf2bd-0d73-4374-a69e-0f0c3e018c85 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:18:53 user nova-compute[73078]: WARNING nova.compute.manager [req-6b65f3de-2000-4662-8cc9-ddce498253ac req-8f3b7a11-1b26-4cf2-bd83-2105ec0a6e2b service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received unexpected event network-vif-plugged-1ebbf2bd-0d73-4374-a69e-0f0c3e018c85 for instance with vm_state active and task_state deleting.
Aug 14 18:18:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:53 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Error from libvirt while getting description of instance-00000014: [Error Code 42] Domain not found: no domain with matching uuid '83aca621-7182-49a9-b4b3-8f22dd50f869' (instance-00000014): libvirt.libvirtError: Domain not found: no domain with matching uuid '83aca621-7182-49a9-b4b3-8f22dd50f869' (instance-00000014)
Aug 14 18:18:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.740s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG nova.compute.manager [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG nova.compute.manager [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG nova.network.neutron [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:18:53 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:18:53 user nova-compute[73078]: DEBUG nova.compute.manager [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:18:53 user nova-compute[73078]: INFO nova.virt.block_device [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Booting with volume a26fa6ac-06c8-4563-bcc9-ea19c5604eac at /dev/vda
Aug 14 18:18:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG os_brick.utils [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[08462d69-43a1-4c92-97cb-f39d7731c65a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[588ce7c1-7f9e-4ef1-ab66-710f21f16ab5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e5454e-43f6-4279-ba7f-258380c05f41]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b909b0a-029f-4ad4-b633-b729859e3148]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:18:53 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:18:53 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d481afb3-b4bb-472e-ab18-365b51dae2d9]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG os_brick.utils [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Updating existing volume attachment record: 0296c68b-0ee8-4cc3-81a4-3c93ecb96348 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:18:54 user nova-compute[73078]: DEBUG nova.policy [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '006108eda23a45df96d06af8cc7c3b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a97c5c314a94a52b01778d69561d862', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:18:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:18:55 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:18:55 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:18:55 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=6865MB free_disk=25.313282012939453GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:18:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:18:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:18:55 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance de80e188-9385-4613-8a6c-aa72b624ad55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:18:55 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 1f88cb97-4f22-439e-99f2-d7cb8d5aff36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:18:55 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 3c840309-9884-4c8a-a6ee-1acd44f32c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:18:55 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:18:55 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 24c00db3-2457-443d-b5ab-7e6ecaa57515 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:18:55 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:18:55 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance ea445c0c-e5a1-4e24-8008-2cd64a679f34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:18:55 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 7783c26e-ec61-4375-b191-0ce5caf766c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:18:55 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 83aca621-7182-49a9-b4b3-8f22dd50f869 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:18:55 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance e812037c-a0ef-4e60-9041-b382087dc2c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:18:55 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 4569b529-5c8f-45ec-94fe-58c60f6bcc8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:18:55 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance f61b5dc6-4b63-439b-9b3d-62ee0a4056d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:18:55 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance ef110d5f-afb5-415c-9590-29da006734a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:18:55 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:18:55 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:18:55 user nova-compute[73078]: DEBUG nova.network.neutron [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Successfully created port: 6adf2de6-8801-4cc9-ab39-9a521201ca8a {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:18:55 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:18:55 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:18:55 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:18:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.587s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:18:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:56 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:18:56 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:18:56 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:18:56 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:18:56 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:18:56 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:18:57 user nova-compute[73078]: DEBUG nova.network.neutron [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Successfully updated port: 6adf2de6-8801-4cc9-ab39-9a521201ca8a {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:18:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Acquiring lock "refresh_cache-ef110d5f-afb5-415c-9590-29da006734a9" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:18:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Acquired lock "refresh_cache-ef110d5f-afb5-415c-9590-29da006734a9" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:18:57 user nova-compute[73078]: DEBUG nova.network.neutron [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:18:57 user nova-compute[73078]: DEBUG nova.compute.manager [req-e0eeebaa-cfd8-4edb-a6ef-a84b878ffa43 req-038c7611-4f2d-4f7f-b1ac-9decb23e7915 service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Received event network-changed-6adf2de6-8801-4cc9-ab39-9a521201ca8a {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:18:57 user nova-compute[73078]: DEBUG nova.compute.manager [req-e0eeebaa-cfd8-4edb-a6ef-a84b878ffa43 req-038c7611-4f2d-4f7f-b1ac-9decb23e7915 service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Refreshing instance network info cache due to event network-changed-6adf2de6-8801-4cc9-ab39-9a521201ca8a. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:18:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e0eeebaa-cfd8-4edb-a6ef-a84b878ffa43 req-038c7611-4f2d-4f7f-b1ac-9decb23e7915 service nova] Acquiring lock "refresh_cache-ef110d5f-afb5-415c-9590-29da006734a9" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:18:57 user nova-compute[73078]: DEBUG nova.network.neutron [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:18:57 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:18:58 user nova-compute[73078]: DEBUG nova.network.neutron [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Updating instance_info_cache with network_info: [{"id": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "address": "fa:16:3e:b7:d1:09", "network": {"id": "7ba1366f-4346-4830-ae29-621591ee55ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-525338528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a97c5c314a94a52b01778d69561d862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6adf2de6-88", "ovs_interfaceid": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:18:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Releasing lock "refresh_cache-ef110d5f-afb5-415c-9590-29da006734a9" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:18:58 user nova-compute[73078]: DEBUG nova.compute.manager [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Instance network_info: |[{"id": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "address": "fa:16:3e:b7:d1:09", "network": {"id": "7ba1366f-4346-4830-ae29-621591ee55ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-525338528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a97c5c314a94a52b01778d69561d862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6adf2de6-88", "ovs_interfaceid": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:18:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e0eeebaa-cfd8-4edb-a6ef-a84b878ffa43 req-038c7611-4f2d-4f7f-b1ac-9decb23e7915 service nova] Acquired lock "refresh_cache-ef110d5f-afb5-415c-9590-29da006734a9" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:18:58 user nova-compute[73078]: DEBUG nova.network.neutron [req-e0eeebaa-cfd8-4edb-a6ef-a84b878ffa43 req-038c7611-4f2d-4f7f-b1ac-9decb23e7915 service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Refreshing network info cache for port 6adf2de6-8801-4cc9-ab39-9a521201ca8a {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:18:59 user nova-compute[73078]: DEBUG nova.network.neutron [req-e0eeebaa-cfd8-4edb-a6ef-a84b878ffa43 req-038c7611-4f2d-4f7f-b1ac-9decb23e7915 service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Updated VIF entry in instance network info cache for port 6adf2de6-8801-4cc9-ab39-9a521201ca8a. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:18:59 user nova-compute[73078]: DEBUG nova.network.neutron [req-e0eeebaa-cfd8-4edb-a6ef-a84b878ffa43 req-038c7611-4f2d-4f7f-b1ac-9decb23e7915 service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Updating instance_info_cache with network_info: [{"id": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "address": "fa:16:3e:b7:d1:09", "network": {"id": "7ba1366f-4346-4830-ae29-621591ee55ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-525338528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a97c5c314a94a52b01778d69561d862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6adf2de6-88", "ovs_interfaceid": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:18:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e0eeebaa-cfd8-4edb-a6ef-a84b878ffa43 req-038c7611-4f2d-4f7f-b1ac-9decb23e7915 service nova] Releasing lock "refresh_cache-ef110d5f-afb5-415c-9590-29da006734a9" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:18:59 user nova-compute[73078]: DEBUG nova.compute.manager [req-76cddcb7-3cca-4ffd-8cf3-a9a9bb2e57b3 req-1eb51afc-6501-47a9-9f6d-1879f8cf40e0 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-deleted-9f1350b2-c0dd-4818-a941-22f37f92e610 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:18:59 user nova-compute[73078]: INFO nova.compute.manager [req-76cddcb7-3cca-4ffd-8cf3-a9a9bb2e57b3 req-1eb51afc-6501-47a9-9f6d-1879f8cf40e0 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Neutron deleted interface 9f1350b2-c0dd-4818-a941-22f37f92e610; detaching it from the instance and deleting it from the info cache
Aug 14 18:18:59 user nova-compute[73078]: DEBUG nova.network.neutron [req-76cddcb7-3cca-4ffd-8cf3-a9a9bb2e57b3 req-1eb51afc-6501-47a9-9f6d-1879f8cf40e0 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Updating instance_info_cache with network_info: [{"id": "fd713ad0-5a38-4d0e-8f2c-2c388a9f6849", "address": "fa:16:3e:f2:47:21", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd713ad0-5a", "ovs_interfaceid": "fd713ad0-5a38-4d0e-8f2c-2c388a9f6849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "62809f7b-d1f3-4cae-9685-107e5008c9eb", "address": "fa:16:3e:94:eb:d7", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62809f7b-d1", "ovs_interfaceid": "62809f7b-d1f3-4cae-9685-107e5008c9eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1054bcf2-2aa6-4112-bd95-9d471c3f63cd", "address": "fa:16:3e:79:2c:7b", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1054bcf2-2a", "ovs_interfaceid": "1054bcf2-2aa6-4112-bd95-9d471c3f63cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10e5877a-b0ba-449a-81db-1ecf3e760851", "address": "fa:16:3e:ec:f7:8e", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e5877a-b0", "ovs_interfaceid": "10e5877a-b0ba-449a-81db-1ecf3e760851", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc245bed-0f7e-49a7-a6af-71072040d109", "address": "fa:16:3e:f9:96:4c", "network": {"id": "5a386415-85db-4304-a0f0-65460a1f8308", "bridge": "br-int", "label": "tempest-device-tagging-net2-529646808", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc245bed-0f", "ovs_interfaceid": "dc245bed-0f7e-49a7-a6af-71072040d109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ebbf2bd-0d73-4374-a69e-0f0c3e018c85", "address": "fa:16:3e:ee:37:9e", "network": {"id": "5a386415-85db-4304-a0f0-65460a1f8308", "bridge": "br-int", "label": "tempest-device-tagging-net2-529646808", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ebbf2bd-0d", "ovs_interfaceid": "1ebbf2bd-0d73-4374-a69e-0f0c3e018c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:18:59 user nova-compute[73078]: DEBUG nova.compute.manager [req-76cddcb7-3cca-4ffd-8cf3-a9a9bb2e57b3 req-1eb51afc-6501-47a9-9f6d-1879f8cf40e0 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Detach interface failed, port_id=9f1350b2-c0dd-4818-a941-22f37f92e610, reason: Instance 83aca621-7182-49a9-b4b3-8f22dd50f869 could not be found. {{(pid=73078) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 18:18:59 user nova-compute[73078]: DEBUG nova.compute.manager [req-76cddcb7-3cca-4ffd-8cf3-a9a9bb2e57b3 req-1eb51afc-6501-47a9-9f6d-1879f8cf40e0 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-deleted-dc245bed-0f7e-49a7-a6af-71072040d109 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:18:59 user nova-compute[73078]: INFO nova.compute.manager [req-76cddcb7-3cca-4ffd-8cf3-a9a9bb2e57b3 req-1eb51afc-6501-47a9-9f6d-1879f8cf40e0 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Neutron deleted interface dc245bed-0f7e-49a7-a6af-71072040d109; detaching it from the instance and deleting it from the info cache
Aug 14 18:18:59 user nova-compute[73078]: DEBUG nova.network.neutron [req-76cddcb7-3cca-4ffd-8cf3-a9a9bb2e57b3 req-1eb51afc-6501-47a9-9f6d-1879f8cf40e0 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Updating instance_info_cache with network_info: [{"id": "fd713ad0-5a38-4d0e-8f2c-2c388a9f6849", "address": "fa:16:3e:f2:47:21", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd713ad0-5a", "ovs_interfaceid": "fd713ad0-5a38-4d0e-8f2c-2c388a9f6849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "62809f7b-d1f3-4cae-9685-107e5008c9eb", "address": "fa:16:3e:94:eb:d7", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62809f7b-d1", "ovs_interfaceid": "62809f7b-d1f3-4cae-9685-107e5008c9eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1054bcf2-2aa6-4112-bd95-9d471c3f63cd", "address": "fa:16:3e:79:2c:7b", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1054bcf2-2a", "ovs_interfaceid": "1054bcf2-2aa6-4112-bd95-9d471c3f63cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10e5877a-b0ba-449a-81db-1ecf3e760851", "address": "fa:16:3e:ec:f7:8e", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e5877a-b0", "ovs_interfaceid": "10e5877a-b0ba-449a-81db-1ecf3e760851", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ebbf2bd-0d73-4374-a69e-0f0c3e018c85", "address": "fa:16:3e:ee:37:9e", "network": {"id": "5a386415-85db-4304-a0f0-65460a1f8308", "bridge": "br-int", "label": "tempest-device-tagging-net2-529646808", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ebbf2bd-0d", "ovs_interfaceid": "1ebbf2bd-0d73-4374-a69e-0f0c3e018c85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:18:59 user nova-compute[73078]: DEBUG nova.compute.manager [req-76cddcb7-3cca-4ffd-8cf3-a9a9bb2e57b3 req-1eb51afc-6501-47a9-9f6d-1879f8cf40e0 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Detach interface failed, port_id=dc245bed-0f7e-49a7-a6af-71072040d109, reason: Instance 83aca621-7182-49a9-b4b3-8f22dd50f869 could not be found. {{(pid=73078) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 18:18:59 user nova-compute[73078]: DEBUG nova.compute.manager [req-76cddcb7-3cca-4ffd-8cf3-a9a9bb2e57b3 req-1eb51afc-6501-47a9-9f6d-1879f8cf40e0 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-deleted-1ebbf2bd-0d73-4374-a69e-0f0c3e018c85 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:18:59 user nova-compute[73078]: INFO nova.compute.manager [req-76cddcb7-3cca-4ffd-8cf3-a9a9bb2e57b3 req-1eb51afc-6501-47a9-9f6d-1879f8cf40e0 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Neutron deleted interface 1ebbf2bd-0d73-4374-a69e-0f0c3e018c85; detaching it from the instance and deleting it from the info cache
Aug 14 18:18:59 user nova-compute[73078]: DEBUG nova.network.neutron [req-76cddcb7-3cca-4ffd-8cf3-a9a9bb2e57b3 req-1eb51afc-6501-47a9-9f6d-1879f8cf40e0 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Updating instance_info_cache with network_info: [{"id": "fd713ad0-5a38-4d0e-8f2c-2c388a9f6849", "address": "fa:16:3e:f2:47:21", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd713ad0-5a", "ovs_interfaceid": "fd713ad0-5a38-4d0e-8f2c-2c388a9f6849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "62809f7b-d1f3-4cae-9685-107e5008c9eb", "address": "fa:16:3e:94:eb:d7", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62809f7b-d1", "ovs_interfaceid": "62809f7b-d1f3-4cae-9685-107e5008c9eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1054bcf2-2aa6-4112-bd95-9d471c3f63cd", "address": "fa:16:3e:79:2c:7b", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1054bcf2-2a", "ovs_interfaceid": "1054bcf2-2aa6-4112-bd95-9d471c3f63cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10e5877a-b0ba-449a-81db-1ecf3e760851", "address": "fa:16:3e:ec:f7:8e", "network": {"id": "7eb2af8e-a61c-4a54-9b96-5be2573c5e65", "bridge": "br-int", "label": "tempest-device-tagging-net1-2024818443", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ed67729880341ffb35e2e668fd80e95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e5877a-b0", "ovs_interfaceid": "10e5877a-b0ba-449a-81db-1ecf3e760851", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:18:59 user nova-compute[73078]: DEBUG nova.compute.manager [req-76cddcb7-3cca-4ffd-8cf3-a9a9bb2e57b3 req-1eb51afc-6501-47a9-9f6d-1879f8cf40e0 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Detach interface failed, port_id=1ebbf2bd-0d73-4374-a69e-0f0c3e018c85, reason: Instance 83aca621-7182-49a9-b4b3-8f22dd50f869 could not be found. {{(pid=73078) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 18:19:00 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:19:00 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Took 7.57 seconds to deallocate network for instance.
Aug 14 18:19:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:01 user nova-compute[73078]: DEBUG nova.compute.manager [req-f93564c5-ae1a-4894-8287-82652f79cade req-f819bda4-31e1-4e95-857c-f8684989f986 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-deleted-1054bcf2-2aa6-4112-bd95-9d471c3f63cd {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:19:01 user nova-compute[73078]: DEBUG nova.compute.manager [req-f93564c5-ae1a-4894-8287-82652f79cade req-f819bda4-31e1-4e95-857c-f8684989f986 service nova] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Received event network-vif-deleted-10e5877a-b0ba-449a-81db-1ecf3e760851 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:19:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:02 user nova-compute[73078]: INFO nova.compute.manager [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Took 2.32 seconds to detach 3 volumes for instance.
Aug 14 18:19:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:19:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:19:03 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:19:03 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:19:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.409s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:19:03 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Deleted allocations for instance 83aca621-7182-49a9-b4b3-8f22dd50f869
Aug 14 18:19:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-982e7890-0fb2-4e70-9f7b-a4f571e01342 tempest-TaggedBootDevicesTest_v242-95949371 tempest-TaggedBootDevicesTest_v242-95949371-project-member] Lock "83aca621-7182-49a9-b4b3-8f22dd50f869" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.282s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG nova.compute.manager [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:19:04 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Creating image(s)
Aug 14 18:19:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Did not create local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Ensure instance console log exists: /opt/stack/data/nova/instances/ef110d5f-afb5-415c-9590-29da006734a9/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Start _get_guest_xml network_info=[{"id": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "address": "fa:16:3e:b7:d1:09", "network": {"id": "7ba1366f-4346-4830-ae29-621591ee55ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-525338528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a97c5c314a94a52b01778d69561d862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6adf2de6-88", "ovs_interfaceid": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '0296c68b-0ee8-4cc3-81a4-3c93ecb96348', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bCVKUxwE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ef110d5f-afb5-415c-9590-29da006734a9', 'attached_at': '', 'detached_at': '', 'volume_id': 'a26fa6ac-06c8-4563-bcc9-ea19c5604eac', 'serial': 'a26fa6ac-06c8-4563-bcc9-ea19c5604eac'}, 'volume_type': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:19:04 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:19:04 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:19:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bCVKUxwE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:19:04 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:19:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:19:04 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:19:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:19:04 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:19:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fef884c-a6a9-4282-97b3-91cfbea75a35]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:19:04 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e15ed8-c49a-47f4-a206-db60d9aa1f04]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac] added
Aug 14 18:19:04 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19e14fe-5187-44d7-a59a-096796acd47f]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0450977c-15a2-4a28-b1ee-fe8398ec7aa7]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bCVKUxwE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bCVKUxwE" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[741cd38b-523d-4eda-b514-20b1cca02aab]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bCVKUxwE'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e9d98d-7441-4ac8-85d8-4d4f94d9f571]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ace4993-70fb-4663-a72b-04d9b6ac6185]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:19:04 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:19:04 user nova-compute[73078]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 (non-flash)
Aug 14 18:19:04 user nova-compute[73078]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:19:04 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:19:04 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:19:04 user nova-compute[73078]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 (non-flash)
Aug 14 18:19:04 user nova-compute[73078]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:19:04 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2c60aa-5394-4ae1-90ff-c602a826168e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac, portal: 172.16.0.220,3260]
Aug 14 18:19:04 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac, portal: 172.16.0.220,3260] successful.
Aug 14 18:19:04 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a003b2-57cf-4de8-bbbe-eece1fa9a267]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f23acc2-eb26-44a5-a31d-b41378c1970d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:19:04 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:19:04 user nova-compute[73078]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 (non-flash)
Aug 14 18:19:04 user nova-compute[73078]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:19:04 user nova-compute[73078]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:19:04 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:19:04 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:19:04 user nova-compute[73078]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 (non-flash)
Aug 14 18:19:04 user nova-compute[73078]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:19:04 user nova-compute[73078]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:19:04 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.360s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d5dc15-5642-4171-b501-30f3a0a175af]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:04 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: None {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:19:05 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:19:05 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bCVKUxwE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:19:05 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:19:05 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '23563636336326533', 'path': '/dev/sde'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:19:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563636336326533', 'path': '/dev/sde'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:19:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:18:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1130985749',display_name='tempest-TestShelveInstance-server-1130985749',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1130985749',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1reYlKMKDhreiCvN3W7qUj0UlbkG5KSoN3QC/382Ndyb3kjNdbjplmq8LyPXLlg05YViPAovHDAOEaQZ24+ExLMyfMwYR4qnV7J8GNCTl9uyhPqp6oJkqxxApcu8exrw==',key_name='tempest-TestShelveInstance-979618800',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a97c5c314a94a52b01778d69561d862',ramdisk_id='',reservation_id='r-lm0zi19n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1474594410',owner_user_name='tempest-TestShelveInstance-1474594410-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:18:54Z,user_data=None,user_id='006108eda23a45df96d06af8cc7c3b42',uuid=ef110d5f-afb5-415c-9590-29da006734a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "address": "fa:16:3e:b7:d1:09", "network": {"id": "7ba1366f-4346-4830-ae29-621591ee55ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-525338528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a97c5c314a94a52b01778d69561d862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6adf2de6-88", "ovs_interfaceid": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:19:05 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Converting VIF {"id": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "address": "fa:16:3e:b7:d1:09", "network": {"id": "7ba1366f-4346-4830-ae29-621591ee55ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-525338528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a97c5c314a94a52b01778d69561d862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6adf2de6-88", "ovs_interfaceid": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:19:05 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:d1:09,bridge_name='br-int',has_traffic_filtering=True,id=6adf2de6-8801-4cc9-ab39-9a521201ca8a,network=Network(7ba1366f-4346-4830-ae29-621591ee55ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6adf2de6-88') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:19:05 user nova-compute[73078]: DEBUG nova.objects.instance [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lazy-loading 'pci_devices' on Instance uuid ef110d5f-afb5-415c-9590-29da006734a9 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:19:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:19:05 user nova-compute[73078]:   <uuid>ef110d5f-afb5-415c-9590-29da006734a9</uuid>
Aug 14 18:19:05 user nova-compute[73078]:   <name>instance-00000018</name>
Aug 14 18:19:05 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:19:05 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:19:05 user nova-compute[73078]:   <metadata>
Aug 14 18:19:05 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:19:05 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:19:05 user nova-compute[73078]:       <nova:name>tempest-TestShelveInstance-server-1130985749</nova:name>
Aug 14 18:19:05 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:19:04</nova:creationTime>
Aug 14 18:19:05 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:19:05 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:19:05 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:19:05 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:19:05 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:19:05 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:19:05 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:19:05 user nova-compute[73078]:       <nova:owner>
Aug 14 18:19:05 user nova-compute[73078]:         <nova:user uuid="006108eda23a45df96d06af8cc7c3b42">tempest-TestShelveInstance-1474594410-project-member</nova:user>
Aug 14 18:19:05 user nova-compute[73078]:         <nova:project uuid="4a97c5c314a94a52b01778d69561d862">tempest-TestShelveInstance-1474594410</nova:project>
Aug 14 18:19:05 user nova-compute[73078]:       </nova:owner>
Aug 14 18:19:05 user nova-compute[73078]:       <nova:ports>
Aug 14 18:19:05 user nova-compute[73078]:         <nova:port uuid="6adf2de6-8801-4cc9-ab39-9a521201ca8a">
Aug 14 18:19:05 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 18:19:05 user nova-compute[73078]:         </nova:port>
Aug 14 18:19:05 user nova-compute[73078]:       </nova:ports>
Aug 14 18:19:05 user nova-compute[73078]:     </nova:instance>
Aug 14 18:19:05 user nova-compute[73078]:   </metadata>
Aug 14 18:19:05 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:19:05 user nova-compute[73078]:     <system>
Aug 14 18:19:05 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:19:05 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:19:05 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:19:05 user nova-compute[73078]:       <entry name="serial">ef110d5f-afb5-415c-9590-29da006734a9</entry>
Aug 14 18:19:05 user nova-compute[73078]:       <entry name="uuid">ef110d5f-afb5-415c-9590-29da006734a9</entry>
Aug 14 18:19:05 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:19:05 user nova-compute[73078]:     </system>
Aug 14 18:19:05 user nova-compute[73078]:   </sysinfo>
Aug 14 18:19:05 user nova-compute[73078]:   <os>
Aug 14 18:19:05 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:19:05 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:19:05 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:19:05 user nova-compute[73078]:   </os>
Aug 14 18:19:05 user nova-compute[73078]:   <features>
Aug 14 18:19:05 user nova-compute[73078]:     <acpi/>
Aug 14 18:19:05 user nova-compute[73078]:     <apic/>
Aug 14 18:19:05 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:19:05 user nova-compute[73078]:   </features>
Aug 14 18:19:05 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:19:05 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:19:05 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:19:05 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:19:05 user nova-compute[73078]:   </clock>
Aug 14 18:19:05 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:19:05 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:19:05 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:19:05 user nova-compute[73078]:   </cpu>
Aug 14 18:19:05 user nova-compute[73078]:   <devices>
Aug 14 18:19:05 user nova-compute[73078]:     <disk type="block" device="disk">
Aug 14 18:19:05 user nova-compute[73078]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:19:05 user nova-compute[73078]:       <source dev="/dev/sde"/>
Aug 14 18:19:05 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:19:05 user nova-compute[73078]:       <serial>a26fa6ac-06c8-4563-bcc9-ea19c5604eac</serial>
Aug 14 18:19:05 user nova-compute[73078]:     </disk>
Aug 14 18:19:05 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:19:05 user nova-compute[73078]:       <mac address="fa:16:3e:b7:d1:09"/>
Aug 14 18:19:05 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:19:05 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:19:05 user nova-compute[73078]:       <target dev="tap6adf2de6-88"/>
Aug 14 18:19:05 user nova-compute[73078]:     </interface>
Aug 14 18:19:05 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:19:05 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/ef110d5f-afb5-415c-9590-29da006734a9/console.log" append="off"/>
Aug 14 18:19:05 user nova-compute[73078]:     </serial>
Aug 14 18:19:05 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:19:05 user nova-compute[73078]:     <video>
Aug 14 18:19:05 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:19:05 user nova-compute[73078]:     </video>
Aug 14 18:19:05 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:19:05 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:19:05 user nova-compute[73078]:     </rng>
Aug 14 18:19:05 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:19:05 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:19:05 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:19:05 user nova-compute[73078]:     </memballoon>
Aug 14 18:19:05 user nova-compute[73078]:   </devices>
Aug 14 18:19:05 user nova-compute[73078]: </domain>
Aug 14 18:19:05 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:19:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:18:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1130985749',display_name='tempest-TestShelveInstance-server-1130985749',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1130985749',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1reYlKMKDhreiCvN3W7qUj0UlbkG5KSoN3QC/382Ndyb3kjNdbjplmq8LyPXLlg05YViPAovHDAOEaQZ24+ExLMyfMwYR4qnV7J8GNCTl9uyhPqp6oJkqxxApcu8exrw==',key_name='tempest-TestShelveInstance-979618800',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a97c5c314a94a52b01778d69561d862',ramdisk_id='',reservation_id='r-lm0zi19n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1474594410',owner_user_name='tempest-TestShelveInstance-1474594410-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:18:54Z,user_data=None,user_id='006108eda23a45df96d06af8cc7c3b42',uuid=ef110d5f-afb5-415c-9590-29da006734a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "address": "fa:16:3e:b7:d1:09", "network": {"id": "7ba1366f-4346-4830-ae29-621591ee55ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-525338528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a97c5c314a94a52b01778d69561d862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6adf2de6-88", "ovs_interfaceid": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:19:05 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Converting VIF {"id": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "address": "fa:16:3e:b7:d1:09", "network": {"id": "7ba1366f-4346-4830-ae29-621591ee55ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-525338528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a97c5c314a94a52b01778d69561d862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6adf2de6-88", "ovs_interfaceid": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:19:05 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:d1:09,bridge_name='br-int',has_traffic_filtering=True,id=6adf2de6-8801-4cc9-ab39-9a521201ca8a,network=Network(7ba1366f-4346-4830-ae29-621591ee55ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6adf2de6-88') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:19:05 user nova-compute[73078]: DEBUG os_vif [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:d1:09,bridge_name='br-int',has_traffic_filtering=True,id=6adf2de6-8801-4cc9-ab39-9a521201ca8a,network=Network(7ba1366f-4346-4830-ae29-621591ee55ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6adf2de6-88') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:19:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:19:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:19:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6adf2de6-88, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:19:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6adf2de6-88, col_values=(('external_ids', {'iface-id': '6adf2de6-8801-4cc9-ab39-9a521201ca8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:d1:09', 'vm-uuid': 'ef110d5f-afb5-415c-9590-29da006734a9'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:19:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:19:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:05 user nova-compute[73078]: INFO os_vif [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:d1:09,bridge_name='br-int',has_traffic_filtering=True,id=6adf2de6-8801-4cc9-ab39-9a521201ca8a,network=Network(7ba1366f-4346-4830-ae29-621591ee55ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6adf2de6-88')
Aug 14 18:19:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:19:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] No VIF found with MAC fa:16:3e:b7:d1:09, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:19:06 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692037131.0899596, 83aca621-7182-49a9-b4b3-8f22dd50f869 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:19:06 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] VM Stopped (Lifecycle Event)
Aug 14 18:19:06 user nova-compute[73078]: DEBUG nova.compute.manager [None req-2261e9e9-8d2f-4b3c-8bb3-a01725551769 None None] [instance: 83aca621-7182-49a9-b4b3-8f22dd50f869] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:19:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:07 user nova-compute[73078]: DEBUG nova.compute.manager [req-378c3566-836c-4f01-8576-fadf6b9ba2f7 req-c1a6e538-4baa-4382-8594-4a2d02d7cfbb service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Received event network-vif-plugged-6adf2de6-8801-4cc9-ab39-9a521201ca8a {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:19:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-378c3566-836c-4f01-8576-fadf6b9ba2f7 req-c1a6e538-4baa-4382-8594-4a2d02d7cfbb service nova] Acquiring lock "ef110d5f-afb5-415c-9590-29da006734a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:19:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-378c3566-836c-4f01-8576-fadf6b9ba2f7 req-c1a6e538-4baa-4382-8594-4a2d02d7cfbb service nova] Lock "ef110d5f-afb5-415c-9590-29da006734a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:19:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-378c3566-836c-4f01-8576-fadf6b9ba2f7 req-c1a6e538-4baa-4382-8594-4a2d02d7cfbb service nova] Lock "ef110d5f-afb5-415c-9590-29da006734a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:19:07 user nova-compute[73078]: DEBUG nova.compute.manager [req-378c3566-836c-4f01-8576-fadf6b9ba2f7 req-c1a6e538-4baa-4382-8594-4a2d02d7cfbb service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] No waiting events found dispatching network-vif-plugged-6adf2de6-8801-4cc9-ab39-9a521201ca8a {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:19:07 user nova-compute[73078]: WARNING nova.compute.manager [req-378c3566-836c-4f01-8576-fadf6b9ba2f7 req-c1a6e538-4baa-4382-8594-4a2d02d7cfbb service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Received unexpected event network-vif-plugged-6adf2de6-8801-4cc9-ab39-9a521201ca8a for instance with vm_state building and task_state spawning.
Aug 14 18:19:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:09 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037149.487321, ef110d5f-afb5-415c-9590-29da006734a9 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:19:09 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ef110d5f-afb5-415c-9590-29da006734a9] VM Resumed (Lifecycle Event)
Aug 14 18:19:09 user nova-compute[73078]: DEBUG nova.compute.manager [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:19:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:19:09 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Instance spawned successfully.
Aug 14 18:19:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:19:09 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:19:09 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:19:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:19:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:19:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:19:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:19:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:19:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:19:09 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ef110d5f-afb5-415c-9590-29da006734a9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:19:09 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037149.4886951, ef110d5f-afb5-415c-9590-29da006734a9 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:19:09 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ef110d5f-afb5-415c-9590-29da006734a9] VM Started (Lifecycle Event)
Aug 14 18:19:09 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:19:09 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:19:09 user nova-compute[73078]: DEBUG nova.compute.manager [req-b8d8e2e6-dec8-4677-a5dc-44d443d5cc2e req-a3109bee-102c-48e7-868c-a4fe91d10a5e service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Received event network-vif-plugged-6adf2de6-8801-4cc9-ab39-9a521201ca8a {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:19:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b8d8e2e6-dec8-4677-a5dc-44d443d5cc2e req-a3109bee-102c-48e7-868c-a4fe91d10a5e service nova] Acquiring lock "ef110d5f-afb5-415c-9590-29da006734a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:19:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b8d8e2e6-dec8-4677-a5dc-44d443d5cc2e req-a3109bee-102c-48e7-868c-a4fe91d10a5e service nova] Lock "ef110d5f-afb5-415c-9590-29da006734a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:19:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b8d8e2e6-dec8-4677-a5dc-44d443d5cc2e req-a3109bee-102c-48e7-868c-a4fe91d10a5e service nova] Lock "ef110d5f-afb5-415c-9590-29da006734a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:19:09 user nova-compute[73078]: DEBUG nova.compute.manager [req-b8d8e2e6-dec8-4677-a5dc-44d443d5cc2e req-a3109bee-102c-48e7-868c-a4fe91d10a5e service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] No waiting events found dispatching network-vif-plugged-6adf2de6-8801-4cc9-ab39-9a521201ca8a {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:19:09 user nova-compute[73078]: WARNING nova.compute.manager [req-b8d8e2e6-dec8-4677-a5dc-44d443d5cc2e req-a3109bee-102c-48e7-868c-a4fe91d10a5e service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Received unexpected event network-vif-plugged-6adf2de6-8801-4cc9-ab39-9a521201ca8a for instance with vm_state building and task_state spawning.
Aug 14 18:19:09 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ef110d5f-afb5-415c-9590-29da006734a9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:19:09 user nova-compute[73078]: INFO nova.compute.manager [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Took 5.35 seconds to spawn the instance on the hypervisor.
Aug 14 18:19:09 user nova-compute[73078]: DEBUG nova.compute.manager [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:19:09 user nova-compute[73078]: INFO nova.compute.manager [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Took 17.01 seconds to build instance.
Aug 14 18:19:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-78da61a5-ba57-4806-8097-c6196382aacc tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lock "ef110d5f-afb5-415c-9590-29da006734a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.133s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:19:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:20 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:25 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "a99aa211-c2a1-4240-90cc-2df068d4f669" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:19:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "a99aa211-c2a1-4240-90cc-2df068d4f669" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:19:29 user nova-compute[73078]: DEBUG nova.compute.manager [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:19:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:19:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:19:30 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:19:30 user nova-compute[73078]: INFO nova.compute.claims [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Claim successful on node user
Aug 14 18:19:30 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:19:30 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:19:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.505s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:19:30 user nova-compute[73078]: DEBUG nova.compute.manager [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:19:30 user nova-compute[73078]: DEBUG nova.compute.manager [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:19:30 user nova-compute[73078]: DEBUG nova.network.neutron [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:19:30 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:19:30 user nova-compute[73078]: DEBUG nova.compute.manager [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:19:30 user nova-compute[73078]: DEBUG nova.policy [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd25ecea70e9e481e8a1957a94d79edfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec53c6018ee44b09ee31ba712a789aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:19:30 user nova-compute[73078]: DEBUG nova.compute.manager [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:19:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:19:30 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Creating image(s)
Aug 14 18:19:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "/opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:19:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "/opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:19:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "/opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:19:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.182s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:19:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:19:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.223s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk 1073741824" returned: 0 in 0.051s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:19:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:31 user nova-compute[73078]: DEBUG nova.network.neutron [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Successfully created port: 5262c4ac-db58-4c3d-9546-7252ee76c730 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:19:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.209s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:31 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:19:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:31 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Cannot resize image /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:19:31 user nova-compute[73078]: DEBUG nova.objects.instance [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lazy-loading 'migration_context' on Instance uuid a99aa211-c2a1-4240-90cc-2df068d4f669 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:19:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:19:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Ensure instance console log exists: /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:19:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:19:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:19:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG nova.network.neutron [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Successfully updated port: 5262c4ac-db58-4c3d-9546-7252ee76c730 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "refresh_cache-a99aa211-c2a1-4240-90cc-2df068d4f669" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquired lock "refresh_cache-a99aa211-c2a1-4240-90cc-2df068d4f669" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG nova.network.neutron [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG nova.compute.manager [req-2104f01b-aa91-4942-90c9-3706733fbbac req-84f071c0-54d1-4f37-a9ff-6dc910330def service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Received event network-changed-5262c4ac-db58-4c3d-9546-7252ee76c730 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG nova.compute.manager [req-2104f01b-aa91-4942-90c9-3706733fbbac req-84f071c0-54d1-4f37-a9ff-6dc910330def service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Refreshing instance network info cache due to event network-changed-5262c4ac-db58-4c3d-9546-7252ee76c730. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-2104f01b-aa91-4942-90c9-3706733fbbac req-84f071c0-54d1-4f37-a9ff-6dc910330def service nova] Acquiring lock "refresh_cache-a99aa211-c2a1-4240-90cc-2df068d4f669" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG nova.network.neutron [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG nova.network.neutron [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Updating instance_info_cache with network_info: [{"id": "5262c4ac-db58-4c3d-9546-7252ee76c730", "address": "fa:16:3e:e4:7f:9e", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5262c4ac-db", "ovs_interfaceid": "5262c4ac-db58-4c3d-9546-7252ee76c730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Releasing lock "refresh_cache-a99aa211-c2a1-4240-90cc-2df068d4f669" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG nova.compute.manager [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Instance network_info: |[{"id": "5262c4ac-db58-4c3d-9546-7252ee76c730", "address": "fa:16:3e:e4:7f:9e", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5262c4ac-db", "ovs_interfaceid": "5262c4ac-db58-4c3d-9546-7252ee76c730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-2104f01b-aa91-4942-90c9-3706733fbbac req-84f071c0-54d1-4f37-a9ff-6dc910330def service nova] Acquired lock "refresh_cache-a99aa211-c2a1-4240-90cc-2df068d4f669" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG nova.network.neutron [req-2104f01b-aa91-4942-90c9-3706733fbbac req-84f071c0-54d1-4f37-a9ff-6dc910330def service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Refreshing network info cache for port 5262c4ac-db58-4c3d-9546-7252ee76c730 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Start _get_guest_xml network_info=[{"id": "5262c4ac-db58-4c3d-9546-7252ee76c730", "address": "fa:16:3e:e4:7f:9e", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5262c4ac-db", "ovs_interfaceid": "5262c4ac-db58-4c3d-9546-7252ee76c730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:19:32 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:19:32 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:19:32 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:19:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-391026567',display_name='tempest-ServerRescueNegativeTestJSON-server-391026567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-391026567',id=25,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWtpI0Guw6dmfBFh+LNsyjK/cmY45/WcllmcWyUt0PCxUIaiQz+xX3JbwPmvtFUfJzH0RmBBZEoBqMCiWdkUa7DqGP74ubN/fbpvYzVQHcC/SGLQJev3eWyf6MGKwsstA==',key_name='tempest-keypair-1566952768',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ec53c6018ee44b09ee31ba712a789aa',ramdisk_id='',reservation_id='r-2hs1fgeo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-38557121',owner_user_name='tempest-ServerRescueNegativeTestJSON-38557121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:19:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d25ecea70e9e481e8a1957a94d79edfc',uuid=a99aa211-c2a1-4240-90cc-2df068d4f669,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5262c4ac-db58-4c3d-9546-7252ee76c730", "address": "fa:16:3e:e4:7f:9e", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5262c4ac-db", "ovs_interfaceid": "5262c4ac-db58-4c3d-9546-7252ee76c730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Converting VIF {"id": "5262c4ac-db58-4c3d-9546-7252ee76c730", "address": "fa:16:3e:e4:7f:9e", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5262c4ac-db", "ovs_interfaceid": "5262c4ac-db58-4c3d-9546-7252ee76c730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:7f:9e,bridge_name='br-int',has_traffic_filtering=True,id=5262c4ac-db58-4c3d-9546-7252ee76c730,network=Network(33518dc6-7963-4995-b4c7-86d60b44a22f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5262c4ac-db') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG nova.objects.instance [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lazy-loading 'pci_devices' on Instance uuid a99aa211-c2a1-4240-90cc-2df068d4f669 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:19:32 user nova-compute[73078]:   <uuid>a99aa211-c2a1-4240-90cc-2df068d4f669</uuid>
Aug 14 18:19:32 user nova-compute[73078]:   <name>instance-00000019</name>
Aug 14 18:19:32 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:19:32 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:19:32 user nova-compute[73078]:   <metadata>
Aug 14 18:19:32 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:19:32 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:19:32 user nova-compute[73078]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-391026567</nova:name>
Aug 14 18:19:32 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:19:32</nova:creationTime>
Aug 14 18:19:32 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:19:32 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:19:32 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:19:32 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:19:32 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:19:32 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:19:32 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:19:32 user nova-compute[73078]:       <nova:owner>
Aug 14 18:19:32 user nova-compute[73078]:         <nova:user uuid="d25ecea70e9e481e8a1957a94d79edfc">tempest-ServerRescueNegativeTestJSON-38557121-project-member</nova:user>
Aug 14 18:19:32 user nova-compute[73078]:         <nova:project uuid="4ec53c6018ee44b09ee31ba712a789aa">tempest-ServerRescueNegativeTestJSON-38557121</nova:project>
Aug 14 18:19:32 user nova-compute[73078]:       </nova:owner>
Aug 14 18:19:32 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:19:32 user nova-compute[73078]:       <nova:ports>
Aug 14 18:19:32 user nova-compute[73078]:         <nova:port uuid="5262c4ac-db58-4c3d-9546-7252ee76c730">
Aug 14 18:19:32 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 18:19:32 user nova-compute[73078]:         </nova:port>
Aug 14 18:19:32 user nova-compute[73078]:       </nova:ports>
Aug 14 18:19:32 user nova-compute[73078]:     </nova:instance>
Aug 14 18:19:32 user nova-compute[73078]:   </metadata>
Aug 14 18:19:32 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:19:32 user nova-compute[73078]:     <system>
Aug 14 18:19:32 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:19:32 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:19:32 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:19:32 user nova-compute[73078]:       <entry name="serial">a99aa211-c2a1-4240-90cc-2df068d4f669</entry>
Aug 14 18:19:32 user nova-compute[73078]:       <entry name="uuid">a99aa211-c2a1-4240-90cc-2df068d4f669</entry>
Aug 14 18:19:32 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:19:32 user nova-compute[73078]:     </system>
Aug 14 18:19:32 user nova-compute[73078]:   </sysinfo>
Aug 14 18:19:32 user nova-compute[73078]:   <os>
Aug 14 18:19:32 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:19:32 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:19:32 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:19:32 user nova-compute[73078]:   </os>
Aug 14 18:19:32 user nova-compute[73078]:   <features>
Aug 14 18:19:32 user nova-compute[73078]:     <acpi/>
Aug 14 18:19:32 user nova-compute[73078]:     <apic/>
Aug 14 18:19:32 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:19:32 user nova-compute[73078]:   </features>
Aug 14 18:19:32 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:19:32 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:19:32 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:19:32 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:19:32 user nova-compute[73078]:   </clock>
Aug 14 18:19:32 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:19:32 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:19:32 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:19:32 user nova-compute[73078]:   </cpu>
Aug 14 18:19:32 user nova-compute[73078]:   <devices>
Aug 14 18:19:32 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:19:32 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:19:32 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk"/>
Aug 14 18:19:32 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:19:32 user nova-compute[73078]:     </disk>
Aug 14 18:19:32 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:19:32 user nova-compute[73078]:       <mac address="fa:16:3e:e4:7f:9e"/>
Aug 14 18:19:32 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:19:32 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:19:32 user nova-compute[73078]:       <target dev="tap5262c4ac-db"/>
Aug 14 18:19:32 user nova-compute[73078]:     </interface>
Aug 14 18:19:32 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:19:32 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/console.log" append="off"/>
Aug 14 18:19:32 user nova-compute[73078]:     </serial>
Aug 14 18:19:32 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:19:32 user nova-compute[73078]:     <video>
Aug 14 18:19:32 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:19:32 user nova-compute[73078]:     </video>
Aug 14 18:19:32 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:19:32 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:19:32 user nova-compute[73078]:     </rng>
Aug 14 18:19:32 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:19:32 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:19:32 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:19:32 user nova-compute[73078]:     </memballoon>
Aug 14 18:19:32 user nova-compute[73078]:   </devices>
Aug 14 18:19:32 user nova-compute[73078]: </domain>
Aug 14 18:19:32 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:19:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-391026567',display_name='tempest-ServerRescueNegativeTestJSON-server-391026567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-391026567',id=25,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWtpI0Guw6dmfBFh+LNsyjK/cmY45/WcllmcWyUt0PCxUIaiQz+xX3JbwPmvtFUfJzH0RmBBZEoBqMCiWdkUa7DqGP74ubN/fbpvYzVQHcC/SGLQJev3eWyf6MGKwsstA==',key_name='tempest-keypair-1566952768',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ec53c6018ee44b09ee31ba712a789aa',ramdisk_id='',reservation_id='r-2hs1fgeo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-38557121',owner_user_name='tempest-ServerRescueNegativeTestJSON-38557121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:19:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d25ecea70e9e481e8a1957a94d79edfc',uuid=a99aa211-c2a1-4240-90cc-2df068d4f669,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5262c4ac-db58-4c3d-9546-7252ee76c730", "address": "fa:16:3e:e4:7f:9e", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5262c4ac-db", "ovs_interfaceid": "5262c4ac-db58-4c3d-9546-7252ee76c730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Converting VIF {"id": "5262c4ac-db58-4c3d-9546-7252ee76c730", "address": "fa:16:3e:e4:7f:9e", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5262c4ac-db", "ovs_interfaceid": "5262c4ac-db58-4c3d-9546-7252ee76c730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:7f:9e,bridge_name='br-int',has_traffic_filtering=True,id=5262c4ac-db58-4c3d-9546-7252ee76c730,network=Network(33518dc6-7963-4995-b4c7-86d60b44a22f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5262c4ac-db') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG os_vif [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:7f:9e,bridge_name='br-int',has_traffic_filtering=True,id=5262c4ac-db58-4c3d-9546-7252ee76c730,network=Network(33518dc6-7963-4995-b4c7-86d60b44a22f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5262c4ac-db') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5262c4ac-db, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5262c4ac-db, col_values=(('external_ids', {'iface-id': '5262c4ac-db58-4c3d-9546-7252ee76c730', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:7f:9e', 'vm-uuid': 'a99aa211-c2a1-4240-90cc-2df068d4f669'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:32 user nova-compute[73078]: INFO os_vif [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:7f:9e,bridge_name='br-int',has_traffic_filtering=True,id=5262c4ac-db58-4c3d-9546-7252ee76c730,network=Network(33518dc6-7963-4995-b4c7-86d60b44a22f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5262c4ac-db')
Aug 14 18:19:32 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] No VIF found with MAC fa:16:3e:e4:7f:9e, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:19:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:33 user nova-compute[73078]: DEBUG nova.network.neutron [req-2104f01b-aa91-4942-90c9-3706733fbbac req-84f071c0-54d1-4f37-a9ff-6dc910330def service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Updated VIF entry in instance network info cache for port 5262c4ac-db58-4c3d-9546-7252ee76c730. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:19:33 user nova-compute[73078]: DEBUG nova.network.neutron [req-2104f01b-aa91-4942-90c9-3706733fbbac req-84f071c0-54d1-4f37-a9ff-6dc910330def service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Updating instance_info_cache with network_info: [{"id": "5262c4ac-db58-4c3d-9546-7252ee76c730", "address": "fa:16:3e:e4:7f:9e", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5262c4ac-db", "ovs_interfaceid": "5262c4ac-db58-4c3d-9546-7252ee76c730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:19:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-2104f01b-aa91-4942-90c9-3706733fbbac req-84f071c0-54d1-4f37-a9ff-6dc910330def service nova] Releasing lock "refresh_cache-a99aa211-c2a1-4240-90cc-2df068d4f669" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:19:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:34 user nova-compute[73078]: DEBUG nova.compute.manager [req-25ef12e1-caf4-4290-93dc-b1e190199ae1 req-e49507e4-59fa-42fb-a019-902fe56f573d service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Received event network-vif-plugged-5262c4ac-db58-4c3d-9546-7252ee76c730 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:19:34 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-25ef12e1-caf4-4290-93dc-b1e190199ae1 req-e49507e4-59fa-42fb-a019-902fe56f573d service nova] Acquiring lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:19:34 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-25ef12e1-caf4-4290-93dc-b1e190199ae1 req-e49507e4-59fa-42fb-a019-902fe56f573d service nova] Lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:19:34 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-25ef12e1-caf4-4290-93dc-b1e190199ae1 req-e49507e4-59fa-42fb-a019-902fe56f573d service nova] Lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:19:34 user nova-compute[73078]: DEBUG nova.compute.manager [req-25ef12e1-caf4-4290-93dc-b1e190199ae1 req-e49507e4-59fa-42fb-a019-902fe56f573d service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] No waiting events found dispatching network-vif-plugged-5262c4ac-db58-4c3d-9546-7252ee76c730 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:19:34 user nova-compute[73078]: WARNING nova.compute.manager [req-25ef12e1-caf4-4290-93dc-b1e190199ae1 req-e49507e4-59fa-42fb-a019-902fe56f573d service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Received unexpected event network-vif-plugged-5262c4ac-db58-4c3d-9546-7252ee76c730 for instance with vm_state building and task_state spawning.
Aug 14 18:19:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:36 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037176.2364028, a99aa211-c2a1-4240-90cc-2df068d4f669 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:19:36 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] VM Resumed (Lifecycle Event)
Aug 14 18:19:36 user nova-compute[73078]: DEBUG nova.compute.manager [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:19:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:19:36 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Instance spawned successfully.
Aug 14 18:19:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:19:36 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:19:36 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:19:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:19:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:19:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:19:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:19:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:19:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:19:36 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:19:36 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037176.2417753, a99aa211-c2a1-4240-90cc-2df068d4f669 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:19:36 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] VM Started (Lifecycle Event)
Aug 14 18:19:36 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:19:36 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:19:36 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:19:36 user nova-compute[73078]: INFO nova.compute.manager [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Took 5.56 seconds to spawn the instance on the hypervisor.
Aug 14 18:19:36 user nova-compute[73078]: DEBUG nova.compute.manager [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:19:36 user nova-compute[73078]: DEBUG nova.compute.manager [req-5492c497-0585-4175-8604-b27e037fc4b0 req-412f500f-a81b-432a-a948-5d5860eba527 service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Received event network-vif-plugged-5262c4ac-db58-4c3d-9546-7252ee76c730 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:19:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5492c497-0585-4175-8604-b27e037fc4b0 req-412f500f-a81b-432a-a948-5d5860eba527 service nova] Acquiring lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:19:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5492c497-0585-4175-8604-b27e037fc4b0 req-412f500f-a81b-432a-a948-5d5860eba527 service nova] Lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:19:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5492c497-0585-4175-8604-b27e037fc4b0 req-412f500f-a81b-432a-a948-5d5860eba527 service nova] Lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:19:36 user nova-compute[73078]: DEBUG nova.compute.manager [req-5492c497-0585-4175-8604-b27e037fc4b0 req-412f500f-a81b-432a-a948-5d5860eba527 service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] No waiting events found dispatching network-vif-plugged-5262c4ac-db58-4c3d-9546-7252ee76c730 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:19:36 user nova-compute[73078]: WARNING nova.compute.manager [req-5492c497-0585-4175-8604-b27e037fc4b0 req-412f500f-a81b-432a-a948-5d5860eba527 service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Received unexpected event network-vif-plugged-5262c4ac-db58-4c3d-9546-7252ee76c730 for instance with vm_state building and task_state spawning.
Aug 14 18:19:36 user nova-compute[73078]: INFO nova.compute.manager [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Took 6.43 seconds to build instance.
Aug 14 18:19:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cf09367b-33dd-45fd-b213-46e9f2418930 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "a99aa211-c2a1-4240-90cc-2df068d4f669" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.533s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:19:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-bec7f6d5-a4ee-483e-9b22-672839296396 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Acquiring lock "7783c26e-ec61-4375-b191-0ce5caf766c7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:19:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-bec7f6d5-a4ee-483e-9b22-672839296396 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "7783c26e-ec61-4375-b191-0ce5caf766c7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:19:38 user nova-compute[73078]: INFO nova.compute.manager [None req-bec7f6d5-a4ee-483e-9b22-672839296396 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Detaching volume 2393519f-30c1-49aa-8f58-d922fe5d1275
Aug 14 18:19:38 user nova-compute[73078]: INFO nova.virt.block_device [None req-bec7f6d5-a4ee-483e-9b22-672839296396 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Attempting to driver detach volume 2393519f-30c1-49aa-8f58-d922fe5d1275 from mountpoint /dev/vdb
Aug 14 18:19:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-bec7f6d5-a4ee-483e-9b22-672839296396 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Attempting to detach device vdb from instance 7783c26e-ec61-4375-b191-0ce5caf766c7 from the persistent domain config. {{(pid=73078) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 18:19:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-bec7f6d5-a4ee-483e-9b22-672839296396 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:19:38 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:19:38 user nova-compute[73078]:   <source dev="/dev/sdd"/>
Aug 14 18:19:38 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:19:38 user nova-compute[73078]:   <serial>2393519f-30c1-49aa-8f58-d922fe5d1275</serial>
Aug 14 18:19:38 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:19:38 user nova-compute[73078]: </disk>
Aug 14 18:19:38 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:19:38 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-bec7f6d5-a4ee-483e-9b22-672839296396 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Successfully detached device vdb from instance 7783c26e-ec61-4375-b191-0ce5caf766c7 from the persistent domain config.
Aug 14 18:19:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-bec7f6d5-a4ee-483e-9b22-672839296396 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7783c26e-ec61-4375-b191-0ce5caf766c7 from the live domain config. {{(pid=73078) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 18:19:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-bec7f6d5-a4ee-483e-9b22-672839296396 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:19:38 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:19:38 user nova-compute[73078]:   <source dev="/dev/sdd"/>
Aug 14 18:19:38 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:19:38 user nova-compute[73078]:   <serial>2393519f-30c1-49aa-8f58-d922fe5d1275</serial>
Aug 14 18:19:38 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:19:38 user nova-compute[73078]: </disk>
Aug 14 18:19:38 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Received event <DeviceRemovedEvent: 1692037179.225171, 7783c26e-ec61-4375-b191-0ce5caf766c7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73078) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-bec7f6d5-a4ee-483e-9b22-672839296396 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7783c26e-ec61-4375-b191-0ce5caf766c7 {{(pid=73078) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 18:19:39 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-bec7f6d5-a4ee-483e-9b22-672839296396 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Successfully detached device vdb from instance 7783c26e-ec61-4375-b191-0ce5caf766c7 from the live domain config.
Aug 14 18:19:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bec7f6d5-a4ee-483e-9b22-672839296396 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec7f6d5-a4ee-483e-9b22-672839296396 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VIwjOaFh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:19:39 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-bec7f6d5-a4ee-483e-9b22-672839296396 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:19:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-bec7f6d5-a4ee-483e-9b22-672839296396 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-bec7f6d5-a4ee-483e-9b22-672839296396 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec7f6d5-a4ee-483e-9b22-672839296396 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7fa75e-60fc-4c7c-bd22-3a8cead29b68]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d651dcb-d74e-4b37-be1b-dc8336ec63f1]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec7f6d5-a4ee-483e-9b22-672839296396 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:19:39 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:19:39 user nova-compute[73078]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 (non-flash)
Aug 14 18:19:39 user nova-compute[73078]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:19:39 user nova-compute[73078]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:19:39 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec7f6d5-a4ee-483e-9b22-672839296396 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:19:39 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:19:39 user nova-compute[73078]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 (non-flash)
Aug 14 18:19:39 user nova-compute[73078]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:19:39 user nova-compute[73078]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:19:39 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec7f6d5-a4ee-483e-9b22-672839296396 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe99017c550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275'): ({'sdd'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-bec7f6d5-a4ee-483e-9b22-672839296396 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Removing single pathed devices sdd {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c26833d-d888-450f-aaef-cc552d8a9b18]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcdb380-30ae-4d39-9deb-1e23cbf07f61]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-bec7f6d5-a4ee-483e-9b22-672839296396 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Flushing IO for device /dev/sdd {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[870ffaf5-4b22-4d55-8fbc-4ca84c16b64c]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-bec7f6d5-a4ee-483e-9b22-672839296396 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.071s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a696f3fd-a2af-4d37-afc5-4527fcb3b49c]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-bec7f6d5-a4ee-483e-9b22-672839296396 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-bec7f6d5-a4ee-483e-9b22-672839296396 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] SCSI volumes sdd have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec7f6d5-a4ee-483e-9b22-672839296396 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[599919b0-cd7a-4caa-a421-3805b0455aa0]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec7f6d5-a4ee-483e-9b22-672839296396 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[268dee5b-d89e-4e57-abbb-7faa36828b0f]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec7f6d5-a4ee-483e-9b22-672839296396 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275, portal: 172.16.0.220,3260]
Aug 14 18:19:39 user nova-compute[73078]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275, portal: 172.16.0.220,3260] successful.
Aug 14 18:19:39 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2393519f-30c1-49aa-8f58-d922fe5d1275 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0060de9f-9803-459f-a2e1-1d9b1ff0ab57]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec7f6d5-a4ee-483e-9b22-672839296396 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-bec7f6d5-a4ee-483e-9b22-672839296396 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec7f6d5-a4ee-483e-9b22-672839296396 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] <== disconnect_volume: return (366ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:19:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bec7f6d5-a4ee-483e-9b22-672839296396 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0e0136fb-f307-4c24-9742-20f00fe70ec2 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0e0136fb-f307-4c24-9742-20f00fe70ec2 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:19:40 user nova-compute[73078]: INFO nova.compute.manager [None req-0e0136fb-f307-4c24-9742-20f00fe70ec2 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Detaching volume eb79e58d-10c0-41a7-89f3-80f6f42552ab
Aug 14 18:19:40 user nova-compute[73078]: INFO nova.virt.block_device [None req-0e0136fb-f307-4c24-9742-20f00fe70ec2 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Attempting to driver detach volume eb79e58d-10c0-41a7-89f3-80f6f42552ab from mountpoint /dev/vdb
Aug 14 18:19:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-0e0136fb-f307-4c24-9742-20f00fe70ec2 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Attempting to detach device vdb from instance 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47 from the persistent domain config. {{(pid=73078) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-0e0136fb-f307-4c24-9742-20f00fe70ec2 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:19:40 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:19:40 user nova-compute[73078]:   <source dev="/dev/sdb"/>
Aug 14 18:19:40 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:19:40 user nova-compute[73078]:   <serial>eb79e58d-10c0-41a7-89f3-80f6f42552ab</serial>
Aug 14 18:19:40 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 18:19:40 user nova-compute[73078]: </disk>
Aug 14 18:19:40 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:19:40 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-0e0136fb-f307-4c24-9742-20f00fe70ec2 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Successfully detached device vdb from instance 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47 from the persistent domain config.
Aug 14 18:19:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-0e0136fb-f307-4c24-9742-20f00fe70ec2 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47 from the live domain config. {{(pid=73078) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-0e0136fb-f307-4c24-9742-20f00fe70ec2 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:19:40 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:19:40 user nova-compute[73078]:   <source dev="/dev/sdb"/>
Aug 14 18:19:40 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:19:40 user nova-compute[73078]:   <serial>eb79e58d-10c0-41a7-89f3-80f6f42552ab</serial>
Aug 14 18:19:40 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 18:19:40 user nova-compute[73078]: </disk>
Aug 14 18:19:40 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG nova.objects.instance [None req-bec7f6d5-a4ee-483e-9b22-672839296396 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lazy-loading 'flavor' on Instance uuid 7783c26e-ec61-4375-b191-0ce5caf766c7 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-bec7f6d5-a4ee-483e-9b22-672839296396 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "7783c26e-ec61-4375-b191-0ce5caf766c7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.945s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Received event <DeviceRemovedEvent: 1692037180.6449714, 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73078) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-0e0136fb-f307-4c24-9742-20f00fe70ec2 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47 {{(pid=73078) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 18:19:40 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-0e0136fb-f307-4c24-9742-20f00fe70ec2 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Successfully detached device vdb from instance 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47 from the live domain config.
Aug 14 18:19:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e0136fb-f307-4c24-9742-20f00fe70ec2 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0136fb-f307-4c24-9742-20f00fe70ec2 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kscWnpYV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:19:40 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-0e0136fb-f307-4c24-9742-20f00fe70ec2 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:19:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-0e0136fb-f307-4c24-9742-20f00fe70ec2 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-0e0136fb-f307-4c24-9742-20f00fe70ec2 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0136fb-f307-4c24-9742-20f00fe70ec2 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[981aec24-8b26-43b6-bc4c-4f6e41c2689c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f24460d-4a64-4de5-9d3d-cb4fd5fefd95]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0136fb-f307-4c24-9742-20f00fe70ec2 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:19:40 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:19:40 user nova-compute[73078]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:19:40 user nova-compute[73078]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:19:40 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0136fb-f307-4c24-9742-20f00fe70ec2 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab (non-flash)
Aug 14 18:19:40 user nova-compute[73078]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:19:40 user nova-compute[73078]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:19:40 user nova-compute[73078]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:19:40 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0136fb-f307-4c24-9742-20f00fe70ec2 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe97879caf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab'): ({'sdb'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-0e0136fb-f307-4c24-9742-20f00fe70ec2 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Removing single pathed devices sdb {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dda3def-b7d5-412d-bbeb-7c1ac3a75d8d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0b7dad-1965-4a8f-a3e6-2306d39be35d]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-0e0136fb-f307-4c24-9742-20f00fe70ec2 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Flushing IO for device /dev/sdb {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f1bc81-a010-4377-ad02-1b8bedf9fe31]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-0e0136fb-f307-4c24-9742-20f00fe70ec2 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8971e7cd-ea4d-49b0-b260-453aa2c4b3e4]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-0e0136fb-f307-4c24-9742-20f00fe70ec2 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-0e0136fb-f307-4c24-9742-20f00fe70ec2 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] SCSI volumes sdb have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0136fb-f307-4c24-9742-20f00fe70ec2 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0106c3e8-ac45-42f2-b459-95a2ceb52805]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0136fb-f307-4c24-9742-20f00fe70ec2 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a15b49-3fb0-48a3-8caa-af0c1dba1ba6]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0136fb-f307-4c24-9742-20f00fe70ec2 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab, portal: 172.16.0.220,3260]
Aug 14 18:19:40 user nova-compute[73078]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab, portal: 172.16.0.220,3260] successful.
Aug 14 18:19:40 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb79e58d-10c0-41a7-89f3-80f6f42552ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[979dbfcd-2ee5-44de-a185-2c3db222154e]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0136fb-f307-4c24-9742-20f00fe70ec2 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-0e0136fb-f307-4c24-9742-20f00fe70ec2 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0136fb-f307-4c24-9742-20f00fe70ec2 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] <== disconnect_volume: return (322ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:19:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e0136fb-f307-4c24-9742-20f00fe70ec2 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:19:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Acquiring lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:19:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:19:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Acquiring lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:19:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:19:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:19:41 user nova-compute[73078]: INFO nova.compute.manager [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Terminating instance
Aug 14 18:19:41 user nova-compute[73078]: DEBUG nova.compute.manager [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:19:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:41 user nova-compute[73078]: DEBUG nova.objects.instance [None req-0e0136fb-f307-4c24-9742-20f00fe70ec2 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lazy-loading 'flavor' on Instance uuid 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:19:41 user nova-compute[73078]: DEBUG nova.compute.manager [req-ac87e527-8ebc-456f-b5d1-692a0f1994d9 req-fe32a020-7129-4a99-80b8-bd5c9b4a0340 service nova] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Received event network-vif-unplugged-74bc6a0e-0628-4482-be86-c53122e1363c {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:19:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ac87e527-8ebc-456f-b5d1-692a0f1994d9 req-fe32a020-7129-4a99-80b8-bd5c9b4a0340 service nova] Acquiring lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:19:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ac87e527-8ebc-456f-b5d1-692a0f1994d9 req-fe32a020-7129-4a99-80b8-bd5c9b4a0340 service nova] Lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:19:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ac87e527-8ebc-456f-b5d1-692a0f1994d9 req-fe32a020-7129-4a99-80b8-bd5c9b4a0340 service nova] Lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:19:41 user nova-compute[73078]: DEBUG nova.compute.manager [req-ac87e527-8ebc-456f-b5d1-692a0f1994d9 req-fe32a020-7129-4a99-80b8-bd5c9b4a0340 service nova] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] No waiting events found dispatching network-vif-unplugged-74bc6a0e-0628-4482-be86-c53122e1363c {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:19:41 user nova-compute[73078]: DEBUG nova.compute.manager [req-ac87e527-8ebc-456f-b5d1-692a0f1994d9 req-fe32a020-7129-4a99-80b8-bd5c9b4a0340 service nova] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Received event network-vif-unplugged-74bc6a0e-0628-4482-be86-c53122e1363c for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0e0136fb-f307-4c24-9742-20f00fe70ec2 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.956s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:19:42 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Instance destroyed successfully.
Aug 14 18:19:42 user nova-compute[73078]: DEBUG nova.objects.instance [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lazy-loading 'resources' on Instance uuid 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T18:15:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1987059253',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1497637679',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtJLJQBmgtrDyTBUJe8Q/tiHCzjGEVBxUbvCC7nYOmxztS2QanKQLBPdwFwQyvsPRy+jAfMiHcGMYRvHIAt2urg9izZdbJETz7dtqMJlhiy41t8tSflk18DOHtZARdHFg==',key_name='tempest-keypair-499236215',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:18:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4b726267e2c49c69b843234bb761f06',ramdisk_id='',reservation_id='r-2u1e60fu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1368753977',owner_user_name='tempest-ServerActionsV293TestJSON-1368753977-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:18:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a3800a849fa4c199373454d92aada0a',uuid=90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74bc6a0e-0628-4482-be86-c53122e1363c", "address": "fa:16:3e:f1:45:de", "network": {"id": "f600e59d-4edc-4daa-a017-629c89211580", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-604738940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b726267e2c49c69b843234bb761f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74bc6a0e-06", "ovs_interfaceid": "74bc6a0e-0628-4482-be86-c53122e1363c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Converting VIF {"id": "74bc6a0e-0628-4482-be86-c53122e1363c", "address": "fa:16:3e:f1:45:de", "network": {"id": "f600e59d-4edc-4daa-a017-629c89211580", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-604738940-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b726267e2c49c69b843234bb761f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74bc6a0e-06", "ovs_interfaceid": "74bc6a0e-0628-4482-be86-c53122e1363c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:45:de,bridge_name='br-int',has_traffic_filtering=True,id=74bc6a0e-0628-4482-be86-c53122e1363c,network=Network(f600e59d-4edc-4daa-a017-629c89211580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74bc6a0e-06') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG os_vif [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:45:de,bridge_name='br-int',has_traffic_filtering=True,id=74bc6a0e-0628-4482-be86-c53122e1363c,network=Network(f600e59d-4edc-4daa-a017-629c89211580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74bc6a0e-06') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74bc6a0e-06, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:19:42 user nova-compute[73078]: INFO os_vif [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:45:de,bridge_name='br-int',has_traffic_filtering=True,id=74bc6a0e-0628-4482-be86-c53122e1363c,network=Network(f600e59d-4edc-4daa-a017-629c89211580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74bc6a0e-06')
Aug 14 18:19:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgcyazBh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:19:42 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:19:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cb3e2f-5d3b-4c63-adee-b87d81c6923e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b4147a-4434-46f3-a611-62475de8df08]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:19:42 user nova-compute[73078]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:19:42 user nova-compute[73078]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:19:42 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:19:42 user nova-compute[73078]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a (non-flash)
Aug 14 18:19:42 user nova-compute[73078]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:19:42 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9781c8790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a'): ({'sdh'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Removing single pathed devices sdh {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6042561e-4fdd-499b-92d9-b3525e647a18]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[11abd97c-814e-4f88-aea5-5b2671bda414]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Flushing IO for device /dev/sdh {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0b10a4-b19d-4507-acbf-ae3a88c518ca]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.057s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3007b8f8-a5b5-44a1-8eca-4a100ac4fbc0]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] SCSI volumes sdh have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4a8ae2-b560-481f-a353-09b25696d6de]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4831c351-d2f6-45d3-ab52-44f75591b0fe]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a, portal: 172.16.0.220,3260]
Aug 14 18:19:42 user nova-compute[73078]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a, portal: 172.16.0.220,3260] successful.
Aug 14 18:19:42 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77e8c78-bb17-42b5-a3cd-19258651c57a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[548800df-b66b-4e97-8d1f-d63e6846fd1d]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] <== disconnect_volume: return (348ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:19:42 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Deleting instance files /opt/stack/data/nova/instances/90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c_del
Aug 14 18:19:42 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Deletion of /opt/stack/data/nova/instances/90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c_del complete
Aug 14 18:19:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Acquiring lock "24c00db3-2457-443d-b5ab-7e6ecaa57515" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Acquiring lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:19:42 user nova-compute[73078]: INFO nova.compute.manager [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Terminating instance
Aug 14 18:19:42 user nova-compute[73078]: DEBUG nova.compute.manager [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:42 user nova-compute[73078]: INFO nova.compute.manager [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 14 18:19:42 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:19:42 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG nova.compute.manager [req-fa3ff0e0-5fa5-4a57-a16d-1659ccb642cb req-6681fee0-2619-48a1-b011-a71d5c1da501 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Received event network-vif-unplugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-fa3ff0e0-5fa5-4a57-a16d-1659ccb642cb req-6681fee0-2619-48a1-b011-a71d5c1da501 service nova] Acquiring lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-fa3ff0e0-5fa5-4a57-a16d-1659ccb642cb req-6681fee0-2619-48a1-b011-a71d5c1da501 service nova] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-fa3ff0e0-5fa5-4a57-a16d-1659ccb642cb req-6681fee0-2619-48a1-b011-a71d5c1da501 service nova] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG nova.compute.manager [req-fa3ff0e0-5fa5-4a57-a16d-1659ccb642cb req-6681fee0-2619-48a1-b011-a71d5c1da501 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] No waiting events found dispatching network-vif-unplugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG nova.compute.manager [req-fa3ff0e0-5fa5-4a57-a16d-1659ccb642cb req-6681fee0-2619-48a1-b011-a71d5c1da501 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Received event network-vif-unplugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:19:43 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Instance destroyed successfully.
Aug 14 18:19:43 user nova-compute[73078]: DEBUG nova.objects.instance [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lazy-loading 'resources' on Instance uuid 24c00db3-2457-443d-b5ab-7e6ecaa57515 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-800184995',display_name='tempest-ServerActionsTestOtherB-server-800184995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-800184995',id=5,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbnc7U7feBP7majde5yxGnuBaGos4MxLqvnB0BjKphlc0UqHWP3CzhimKim+Kv31+0a1u5JyxtEQSRk/yFbj17pMkgZ6K1nerehXIw6QXdILWEOhFCV63jMfH8QM13ghA==',key_name='tempest-keypair-2079056104',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:17:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09794ca2aebc4f50a4ab26cecefb4d0c',ramdisk_id='',reservation_id='r-ikq8fsl0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-727924132',owner_user_name='tempest-ServerActionsTestOtherB-727924132-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:17:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ad487c5160a4dd8b9a03d468edf4bef',uuid=24c00db3-2457-443d-b5ab-7e6ecaa57515,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "address": "fa:16:3e:ce:cd:93", "network": {"id": "1ec1577a-2943-44e6-9fd6-9d8308fcf09f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-135315381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09794ca2aebc4f50a4ab26cecefb4d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d8f3d6-2e", "ovs_interfaceid": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Converting VIF {"id": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "address": "fa:16:3e:ce:cd:93", "network": {"id": "1ec1577a-2943-44e6-9fd6-9d8308fcf09f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-135315381-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09794ca2aebc4f50a4ab26cecefb4d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d8f3d6-2e", "ovs_interfaceid": "99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:cd:93,bridge_name='br-int',has_traffic_filtering=True,id=99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563,network=Network(1ec1577a-2943-44e6-9fd6-9d8308fcf09f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d8f3d6-2e') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG os_vif [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:cd:93,bridge_name='br-int',has_traffic_filtering=True,id=99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563,network=Network(1ec1577a-2943-44e6-9fd6-9d8308fcf09f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d8f3d6-2e') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99d8f3d6-2e, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:19:43 user nova-compute[73078]: INFO os_vif [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:cd:93,bridge_name='br-int',has_traffic_filtering=True,id=99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563,network=Network(1ec1577a-2943-44e6-9fd6-9d8308fcf09f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d8f3d6-2e')
Aug 14 18:19:43 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XefjBbVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:19:43 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:19:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4e265d-e376-49b2-95e4-b549fd036aa3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b777e5-57e1-4f76-a13c-6b3542cc2f4f]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:19:43 user nova-compute[73078]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:19:43 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 (non-flash)
Aug 14 18:19:43 user nova-compute[73078]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:19:43 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe978268e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272'): ({'sdc'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Removing single pathed devices sdc {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd1504b-db58-466b-8f24-d89a8d22960c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c509152-729c-4ebe-9027-fc8b67f7cc22]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Flushing IO for device /dev/sdc {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdaddad-7d9d-4ad6-b841-29dbc5e69410]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e2bcd4-67dd-432c-a52d-15e7f852c20c]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] SCSI volumes sdc have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c89f1f-b3b6-45d2-b39c-f0bcd17acd39]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:19:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:44 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[559bfc55-3ba7-49db-9cd5-c2f2cadff1f8]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:44 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272, portal: 172.16.0.220,3260]
Aug 14 18:19:44 user nova-compute[73078]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272, portal: 172.16.0.220,3260] successful.
Aug 14 18:19:44 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:19:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:44 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:19:44 user nova-compute[73078]: DEBUG nova.compute.manager [req-39b3ab3b-e572-4a53-a7ca-3d81d577810d req-f3d49314-bf1f-4702-8f3b-37b428bf779b service nova] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Received event network-vif-plugged-74bc6a0e-0628-4482-be86-c53122e1363c {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:19:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-39b3ab3b-e572-4a53-a7ca-3d81d577810d req-f3d49314-bf1f-4702-8f3b-37b428bf779b service nova] Acquiring lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:19:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-39b3ab3b-e572-4a53-a7ca-3d81d577810d req-f3d49314-bf1f-4702-8f3b-37b428bf779b service nova] Lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:19:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-39b3ab3b-e572-4a53-a7ca-3d81d577810d req-f3d49314-bf1f-4702-8f3b-37b428bf779b service nova] Lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:19:44 user nova-compute[73078]: DEBUG nova.compute.manager [req-39b3ab3b-e572-4a53-a7ca-3d81d577810d req-f3d49314-bf1f-4702-8f3b-37b428bf779b service nova] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] No waiting events found dispatching network-vif-plugged-74bc6a0e-0628-4482-be86-c53122e1363c {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:19:44 user nova-compute[73078]: WARNING nova.compute.manager [req-39b3ab3b-e572-4a53-a7ca-3d81d577810d req-f3d49314-bf1f-4702-8f3b-37b428bf779b service nova] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Received unexpected event network-vif-plugged-74bc6a0e-0628-4482-be86-c53122e1363c for instance with vm_state active and task_state deleting.
Aug 14 18:19:44 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Took 1.14 seconds to deallocate network for instance.
Aug 14 18:19:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd880623-a7e9-4e11-9490-b18345719272 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:44 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f45b77a-5475-438b-8be8-77a27aa58943]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:44 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:19:44 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:19:44 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] <== disconnect_volume: return (332ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:19:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:19:44 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Deleting instance files /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515_del
Aug 14 18:19:44 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Deletion of /opt/stack/data/nova/instances/24c00db3-2457-443d-b5ab-7e6ecaa57515_del complete
Aug 14 18:19:44 user nova-compute[73078]: INFO nova.compute.manager [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Took 1.29 seconds to destroy the instance on the hypervisor.
Aug 14 18:19:44 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:19:44 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:19:44 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:19:45 user nova-compute[73078]: INFO nova.compute.manager [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Took 1.15 seconds to detach 1 volumes for instance.
Aug 14 18:19:45 user nova-compute[73078]: DEBUG nova.compute.manager [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Deleting volume: d77e8c78-bb17-42b5-a3cd-19258651c57a {{(pid=73078) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 18:19:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:19:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:19:45 user nova-compute[73078]: DEBUG nova.compute.manager [req-3ba79ac0-3652-4f13-8439-dd45e764d036 req-2c553635-a4ef-46f2-8447-2d5d1cf142b7 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Received event network-vif-plugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:19:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3ba79ac0-3652-4f13-8439-dd45e764d036 req-2c553635-a4ef-46f2-8447-2d5d1cf142b7 service nova] Acquiring lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:19:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3ba79ac0-3652-4f13-8439-dd45e764d036 req-2c553635-a4ef-46f2-8447-2d5d1cf142b7 service nova] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:19:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3ba79ac0-3652-4f13-8439-dd45e764d036 req-2c553635-a4ef-46f2-8447-2d5d1cf142b7 service nova] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:19:45 user nova-compute[73078]: DEBUG nova.compute.manager [req-3ba79ac0-3652-4f13-8439-dd45e764d036 req-2c553635-a4ef-46f2-8447-2d5d1cf142b7 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] No waiting events found dispatching network-vif-plugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:19:45 user nova-compute[73078]: WARNING nova.compute.manager [req-3ba79ac0-3652-4f13-8439-dd45e764d036 req-2c553635-a4ef-46f2-8447-2d5d1cf142b7 service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Received unexpected event network-vif-plugged-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 for instance with vm_state active and task_state deleting.
Aug 14 18:19:45 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:19:45 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:19:45 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:19:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.552s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:19:45 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Took 1.74 seconds to deallocate network for instance.
Aug 14 18:19:45 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Deleted allocations for instance 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c
Aug 14 18:19:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b34f5c49-ad0a-435d-b848-b41f540b2b7c tempest-ServerActionsV293TestJSON-1368753977 tempest-ServerActionsV293TestJSON-1368753977-project-member] Lock "90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.359s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:19:46 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:19:46 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:19:46 user nova-compute[73078]: DEBUG nova.compute.manager [req-12f65fc3-6f4e-457d-8758-5d7bc2c81855 req-dffcf6ae-af21-4a04-8f30-5d95e38d26cc service nova] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Received event network-vif-deleted-74bc6a0e-0628-4482-be86-c53122e1363c {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:19:46 user nova-compute[73078]: DEBUG nova.compute.manager [req-12f65fc3-6f4e-457d-8758-5d7bc2c81855 req-dffcf6ae-af21-4a04-8f30-5d95e38d26cc service nova] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Received event network-vif-deleted-99d8f3d6-2e1e-4bf7-a7a6-e1c8d2c0f563 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:19:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Acquiring lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:19:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:19:46 user nova-compute[73078]: DEBUG nova.objects.instance [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lazy-loading 'flavor' on Instance uuid ea445c0c-e5a1-4e24-8008-2cd64a679f34 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:19:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:19:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Acquiring lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:19:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:19:46 user nova-compute[73078]: INFO nova.compute.manager [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Attaching volume 2c94d393-5546-43fc-b05e-adcb5a32b032 to /dev/vdb
Aug 14 18:19:46 user nova-compute[73078]: DEBUG os_brick.utils [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:19:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:46 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b477ee9-7bb2-4116-b353-94321ffb429c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:46 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[99901dde-e5ab-45f3-9f62-417b9f5af159]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:46 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b08734f-2535-4190-82a8-d292c6f26a24]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:46 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3294c5b9-7313-4510-a565-3e68f1655ed5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:19:46 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:19:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:19:46 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:19:46 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d94a8b-9dd2-47c1-9eda-9e508a93c6db]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:46 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:19:46 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:19:46 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:19:46 user nova-compute[73078]: DEBUG os_brick.utils [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:19:46 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Updating existing volume attachment record: 316a2fe4-d0a3-4095-a62f-251949c71f59 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:19:46 user nova-compute[73078]: INFO nova.compute.manager [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Took 0.82 seconds to detach 1 volumes for instance.
Aug 14 18:19:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:19:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:19:47 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:19:47 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:19:47 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:19:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.418s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:19:47 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Deleted allocations for instance 24c00db3-2457-443d-b5ab-7e6ecaa57515
Aug 14 18:19:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8fe771d0-790a-478e-9fa4-6050e71aa3ae tempest-ServerActionsTestOtherB-727924132 tempest-ServerActionsTestOtherB-727924132-project-member] Lock "24c00db3-2457-443d-b5ab-7e6ecaa57515" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.581s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:19:48 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:19:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:19:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:19:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:19:48 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:19:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e812037c-a0ef-4e60-9041-b382087dc2c5/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e812037c-a0ef-4e60-9041-b382087dc2c5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e812037c-a0ef-4e60-9041-b382087dc2c5/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e812037c-a0ef-4e60-9041-b382087dc2c5/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7783c26e-ec61-4375-b191-0ce5caf766c7/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7783c26e-ec61-4375-b191-0ce5caf766c7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7783c26e-ec61-4375-b191-0ce5caf766c7/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7783c26e-ec61-4375-b191-0ce5caf766c7/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:19:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:53 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:19:53 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:19:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=6957MB free_disk=25.271766662597656GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:19:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:19:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:19:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance de80e188-9385-4613-8a6c-aa72b624ad55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:19:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 1f88cb97-4f22-439e-99f2-d7cb8d5aff36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:19:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 3c840309-9884-4c8a-a6ee-1acd44f32c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:19:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:19:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance ea445c0c-e5a1-4e24-8008-2cd64a679f34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:19:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 7783c26e-ec61-4375-b191-0ce5caf766c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:19:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance e812037c-a0ef-4e60-9041-b382087dc2c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:19:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 4569b529-5c8f-45ec-94fe-58c60f6bcc8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:19:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance f61b5dc6-4b63-439b-9b3d-62ee0a4056d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:19:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance ef110d5f-afb5-415c-9590-29da006734a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:19:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance a99aa211-c2a1-4240-90cc-2df068d4f669 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:19:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:19:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:19:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:53 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:19:53 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:19:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:19:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.511s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:19:54 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:19:54 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-1f88cb97-4f22-439e-99f2-d7cb8d5aff36" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-1f88cb97-4f22-439e-99f2-d7cb8d5aff36" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Updating instance_info_cache with network_info: [{"id": "8df77a26-faab-47ca-a39b-3df6930cd1d5", "address": "fa:16:3e:2d:25:52", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df77a26-fa", "ovs_interfaceid": "8df77a26-faab-47ca-a39b-3df6930cd1d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-1f88cb97-4f22-439e-99f2-d7cb8d5aff36" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLhSxMQZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:19:55 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:19:55 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:19:55 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:19:55 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:19:55 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb31862d-1a49-48e0-8325-7e7f7bfdf07e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:19:55 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8f50e8-0bb5-462e-a32c-dfb739188c24]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032] added
Aug 14 18:19:55 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f8af1d-09ac-4e25-b0bb-653d7e86d64c]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-99aa54a0-8322-42a9-b75c-e53da0fc48b7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Acquiring lock "e812037c-a0ef-4e60-9041-b382087dc2c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-99aa54a0-8322-42a9-b75c-e53da0fc48b7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Lock "e812037c-a0ef-4e60-9041-b382087dc2c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-99aa54a0-8322-42a9-b75c-e53da0fc48b7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Acquiring lock "e812037c-a0ef-4e60-9041-b382087dc2c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-99aa54a0-8322-42a9-b75c-e53da0fc48b7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Lock "e812037c-a0ef-4e60-9041-b382087dc2c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-99aa54a0-8322-42a9-b75c-e53da0fc48b7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Lock "e812037c-a0ef-4e60-9041-b382087dc2c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:19:55 user nova-compute[73078]: INFO nova.compute.manager [None req-99aa54a0-8322-42a9-b75c-e53da0fc48b7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Terminating instance
Aug 14 18:19:55 user nova-compute[73078]: DEBUG nova.compute.manager [None req-99aa54a0-8322-42a9-b75c-e53da0fc48b7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8085a0-967d-49c6-9a04-e50c92f32ffd]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rLhSxMQZ {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rLhSxMQZ" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f856cb6-c089-4179-9351-a4d9c2156405]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rLhSxMQZ'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[048f51dc-1e5d-4bfd-8228-999eb52468d3]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ae894e-cd46-4bf7-9a1a-15cd8752886e]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:19:55 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:19:55 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d595e532-481c-4d90-85c9-9e099cb2d895]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032, portal: 172.16.0.220,3260]
Aug 14 18:19:55 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032, portal: 172.16.0.220,3260] successful.
Aug 14 18:19:55 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96fd573-8c75-41c7-8094-cf3319ce31ac]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:19:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:56 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86499e3-32aa-45d9-a9eb-f73d0b59432a]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:56 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:19:56 user nova-compute[73078]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 (non-flash)
Aug 14 18:19:56 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:19:56 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:19:56 user nova-compute[73078]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 (non-flash)
Aug 14 18:19:56 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:19:56 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:19:56 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:19:56 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:19:56 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:19:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:19:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:19:56 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[521fe68a-ac0c-4bdc-8c2e-ab421814891f]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:19:56 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:19:56 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLhSxMQZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:19:56 user nova-compute[73078]: DEBUG nova.compute.manager [req-460103d5-bcf1-4e85-a7d1-b2511678a468 req-42778269-fef2-4d21-866a-ace1f698e2b0 service nova] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Received event network-vif-unplugged-c581b8a4-7109-4251-a895-680f7487276f {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:19:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-460103d5-bcf1-4e85-a7d1-b2511678a468 req-42778269-fef2-4d21-866a-ace1f698e2b0 service nova] Acquiring lock "e812037c-a0ef-4e60-9041-b382087dc2c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:19:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-460103d5-bcf1-4e85-a7d1-b2511678a468 req-42778269-fef2-4d21-866a-ace1f698e2b0 service nova] Lock "e812037c-a0ef-4e60-9041-b382087dc2c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:19:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-460103d5-bcf1-4e85-a7d1-b2511678a468 req-42778269-fef2-4d21-866a-ace1f698e2b0 service nova] Lock "e812037c-a0ef-4e60-9041-b382087dc2c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:19:56 user nova-compute[73078]: DEBUG nova.compute.manager [req-460103d5-bcf1-4e85-a7d1-b2511678a468 req-42778269-fef2-4d21-866a-ace1f698e2b0 service nova] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] No waiting events found dispatching network-vif-unplugged-c581b8a4-7109-4251-a895-680f7487276f {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:19:56 user nova-compute[73078]: DEBUG nova.compute.manager [req-460103d5-bcf1-4e85-a7d1-b2511678a468 req-42778269-fef2-4d21-866a-ace1f698e2b0 service nova] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Received event network-vif-unplugged-c581b8a4-7109-4251-a895-680f7487276f for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:19:56 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Instance destroyed successfully.
Aug 14 18:19:56 user nova-compute[73078]: DEBUG nova.objects.instance [None req-99aa54a0-8322-42a9-b75c-e53da0fc48b7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Lazy-loading 'resources' on Instance uuid e812037c-a0ef-4e60-9041-b382087dc2c5 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:19:56 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-99aa54a0-8322-42a9-b75c-e53da0fc48b7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1371061164',display_name='tempest-VolumesActionsTest-instance-1371061164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1371061164',id=21,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:18:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f664e2a18ee487bb2d32fbe1619a7e5',ramdisk_id='',reservation_id='r-100zk8oa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1407236132',owner_user_name='tempest-VolumesActionsTest-1407236132-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:18:04Z,user_data=None,user_id='a04504b65e2645c58456ea8aab0af822',uuid=e812037c-a0ef-4e60-9041-b382087dc2c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c581b8a4-7109-4251-a895-680f7487276f", "address": "fa:16:3e:c2:99:c4", "network": {"id": "3657c542-8f13-46f0-82ca-76abc904eaee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1405653250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f664e2a18ee487bb2d32fbe1619a7e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc581b8a4-71", "ovs_interfaceid": "c581b8a4-7109-4251-a895-680f7487276f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:19:56 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-99aa54a0-8322-42a9-b75c-e53da0fc48b7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Converting VIF {"id": "c581b8a4-7109-4251-a895-680f7487276f", "address": "fa:16:3e:c2:99:c4", "network": {"id": "3657c542-8f13-46f0-82ca-76abc904eaee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1405653250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f664e2a18ee487bb2d32fbe1619a7e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc581b8a4-71", "ovs_interfaceid": "c581b8a4-7109-4251-a895-680f7487276f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:19:56 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-99aa54a0-8322-42a9-b75c-e53da0fc48b7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:99:c4,bridge_name='br-int',has_traffic_filtering=True,id=c581b8a4-7109-4251-a895-680f7487276f,network=Network(3657c542-8f13-46f0-82ca-76abc904eaee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc581b8a4-71') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:19:56 user nova-compute[73078]: DEBUG os_vif [None req-99aa54a0-8322-42a9-b75c-e53da0fc48b7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:99:c4,bridge_name='br-int',has_traffic_filtering=True,id=c581b8a4-7109-4251-a895-680f7487276f,network=Network(3657c542-8f13-46f0-82ca-76abc904eaee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc581b8a4-71') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:19:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc581b8a4-71, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:19:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:19:56 user nova-compute[73078]: INFO os_vif [None req-99aa54a0-8322-42a9-b75c-e53da0fc48b7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:99:c4,bridge_name='br-int',has_traffic_filtering=True,id=c581b8a4-7109-4251-a895-680f7487276f,network=Network(3657c542-8f13-46f0-82ca-76abc904eaee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc581b8a4-71')
Aug 14 18:19:56 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-99aa54a0-8322-42a9-b75c-e53da0fc48b7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Deleting instance files /opt/stack/data/nova/instances/e812037c-a0ef-4e60-9041-b382087dc2c5_del
Aug 14 18:19:56 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-99aa54a0-8322-42a9-b75c-e53da0fc48b7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Deletion of /opt/stack/data/nova/instances/e812037c-a0ef-4e60-9041-b382087dc2c5_del complete
Aug 14 18:19:56 user nova-compute[73078]: INFO nova.compute.manager [None req-99aa54a0-8322-42a9-b75c-e53da0fc48b7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 14 18:19:56 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-99aa54a0-8322-42a9-b75c-e53da0fc48b7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:19:56 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:19:56 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:19:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:19:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26464306163353634', 'path': '/dev/sdb'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:19:57 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464306163353634', 'path': '/dev/sdb'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:19:57 user nova-compute[73078]: DEBUG nova.objects.instance [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lazy-loading 'flavor' on Instance uuid ea445c0c-e5a1-4e24-8008-2cd64a679f34 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:19:57 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 18:19:57 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:19:57 user nova-compute[73078]:   <source dev="/dev/sdb"/>
Aug 14 18:19:57 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:19:57 user nova-compute[73078]:   <serial>2c94d393-5546-43fc-b05e-adcb5a32b032</serial>
Aug 14 18:19:57 user nova-compute[73078]: </disk>
Aug 14 18:19:57 user nova-compute[73078]:  {{(pid=73078) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 18:19:57 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:19:57 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Took 0.59 seconds to deallocate network for instance.
Aug 14 18:19:57 user nova-compute[73078]: DEBUG nova.compute.manager [req-6bf53b70-1b91-458f-b6ba-aed446669386 req-d7fad9e7-3f85-4997-b354-f35437cc9411 service nova] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Received event network-vif-deleted-c581b8a4-7109-4251-a895-680f7487276f {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:19:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-99aa54a0-8322-42a9-b75c-e53da0fc48b7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:19:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-99aa54a0-8322-42a9-b75c-e53da0fc48b7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:19:57 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692037182.4584074, 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:19:57 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] VM Stopped (Lifecycle Event)
Aug 14 18:19:57 user nova-compute[73078]: DEBUG nova.compute.manager [None req-d7a56dc5-aa70-4eeb-977a-496bc92c06ef None None] [instance: 90b4b8c2-561e-49b8-80d1-8bd65cf8ed5c] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:19:57 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:19:57 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:19:57 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] No VIF found with MAC fa:16:3e:a3:fb:e1, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:19:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-66ac2322-489f-4237-b7ea-b8b670249c48 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.092s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:19:57 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-99aa54a0-8322-42a9-b75c-e53da0fc48b7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:19:57 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-99aa54a0-8322-42a9-b75c-e53da0fc48b7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:19:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-99aa54a0-8322-42a9-b75c-e53da0fc48b7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:19:57 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-99aa54a0-8322-42a9-b75c-e53da0fc48b7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Deleted allocations for instance e812037c-a0ef-4e60-9041-b382087dc2c5
Aug 14 18:19:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-99aa54a0-8322-42a9-b75c-e53da0fc48b7 tempest-VolumesActionsTest-1407236132 tempest-VolumesActionsTest-1407236132-project-member] Lock "e812037c-a0ef-4e60-9041-b382087dc2c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.022s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:19:57 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:58 user nova-compute[73078]: DEBUG nova.compute.manager [req-ae215014-f373-4b29-b1b8-e4c6c6c2014a req-c350c439-fea4-476b-ab8a-9cf6f055ab30 service nova] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Received event network-vif-plugged-c581b8a4-7109-4251-a895-680f7487276f {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:19:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ae215014-f373-4b29-b1b8-e4c6c6c2014a req-c350c439-fea4-476b-ab8a-9cf6f055ab30 service nova] Acquiring lock "e812037c-a0ef-4e60-9041-b382087dc2c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:19:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ae215014-f373-4b29-b1b8-e4c6c6c2014a req-c350c439-fea4-476b-ab8a-9cf6f055ab30 service nova] Lock "e812037c-a0ef-4e60-9041-b382087dc2c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:19:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ae215014-f373-4b29-b1b8-e4c6c6c2014a req-c350c439-fea4-476b-ab8a-9cf6f055ab30 service nova] Lock "e812037c-a0ef-4e60-9041-b382087dc2c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:19:58 user nova-compute[73078]: DEBUG nova.compute.manager [req-ae215014-f373-4b29-b1b8-e4c6c6c2014a req-c350c439-fea4-476b-ab8a-9cf6f055ab30 service nova] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] No waiting events found dispatching network-vif-plugged-c581b8a4-7109-4251-a895-680f7487276f {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:19:58 user nova-compute[73078]: WARNING nova.compute.manager [req-ae215014-f373-4b29-b1b8-e4c6c6c2014a req-c350c439-fea4-476b-ab8a-9cf6f055ab30 service nova] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Received unexpected event network-vif-plugged-c581b8a4-7109-4251-a895-680f7487276f for instance with vm_state deleted and task_state None.
Aug 14 18:19:58 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692037183.7022533, 24c00db3-2457-443d-b5ab-7e6ecaa57515 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:19:58 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] VM Stopped (Lifecycle Event)
Aug 14 18:19:58 user nova-compute[73078]: DEBUG nova.compute.manager [None req-0483ba10-4660-431e-8741-2d4fff0568b7 None None] [instance: 24c00db3-2457-443d-b5ab-7e6ecaa57515] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:19:58 user nova-compute[73078]: INFO nova.compute.manager [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Rescuing
Aug 14 18:19:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Acquiring lock "refresh_cache-ea445c0c-e5a1-4e24-8008-2cd64a679f34" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:19:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Acquired lock "refresh_cache-ea445c0c-e5a1-4e24-8008-2cd64a679f34" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:19:58 user nova-compute[73078]: DEBUG nova.network.neutron [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:19:59 user nova-compute[73078]: DEBUG nova.network.neutron [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Updating instance_info_cache with network_info: [{"id": "3a008b18-c1c3-4656-9ada-f437888cdee6", "address": "fa:16:3e:a3:fb:e1", "network": {"id": "45b49a52-f99e-437a-aa8d-440f4f6b1099", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1520302261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9a739612a674c5c82fad631a64c57ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a008b18-c1", "ovs_interfaceid": "3a008b18-c1c3-4656-9ada-f437888cdee6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:19:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Releasing lock "refresh_cache-ea445c0c-e5a1-4e24-8008-2cd64a679f34" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:19:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:19:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:00 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Instance destroyed successfully.
Aug 14 18:20:00 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Attempting a stable device rescue
Aug 14 18:20:00 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=73078) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 18:20:00 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Instance directory exists: not creating {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 18:20:00 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Creating image(s)
Aug 14 18:20:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:20:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "/opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:20:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "/opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:20:00 user nova-compute[73078]: DEBUG nova.objects.instance [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lazy-loading 'trusted_certs' on Instance uuid ea445c0c-e5a1-4e24-8008-2cd64a679f34 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:20:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Acquiring lock "3e47c6043e6ea1ea6e66cb3fba74c3aa1a55be25" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:20:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "3e47c6043e6ea1ea6e66cb3fba74c3aa1a55be25" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:20:00 user nova-compute[73078]: DEBUG nova.compute.manager [req-af251d88-c604-4f94-ab12-768cd99b4431 req-620f3568-e20b-4668-be36-0530bfbce27a service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Received event network-vif-unplugged-3a008b18-c1c3-4656-9ada-f437888cdee6 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:20:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-af251d88-c604-4f94-ab12-768cd99b4431 req-620f3568-e20b-4668-be36-0530bfbce27a service nova] Acquiring lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:20:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-af251d88-c604-4f94-ab12-768cd99b4431 req-620f3568-e20b-4668-be36-0530bfbce27a service nova] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:20:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-af251d88-c604-4f94-ab12-768cd99b4431 req-620f3568-e20b-4668-be36-0530bfbce27a service nova] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:20:00 user nova-compute[73078]: DEBUG nova.compute.manager [req-af251d88-c604-4f94-ab12-768cd99b4431 req-620f3568-e20b-4668-be36-0530bfbce27a service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] No waiting events found dispatching network-vif-unplugged-3a008b18-c1c3-4656-9ada-f437888cdee6 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:20:00 user nova-compute[73078]: WARNING nova.compute.manager [req-af251d88-c604-4f94-ab12-768cd99b4431 req-620f3568-e20b-4668-be36-0530bfbce27a service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Received unexpected event network-vif-unplugged-3a008b18-c1c3-4656-9ada-f437888cdee6 for instance with vm_state active and task_state rescuing.
Aug 14 18:20:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e47c6043e6ea1ea6e66cb3fba74c3aa1a55be25.part --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e47c6043e6ea1ea6e66cb3fba74c3aa1a55be25.part --force-share --output=json" returned: 0 in 0.185s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:01 user nova-compute[73078]: DEBUG nova.virt.images [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] cb950435-ff3a-4eeb-85fe-517aa8120217 was qcow2, converting to raw {{(pid=73078) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 18:20:01 user nova-compute[73078]: DEBUG nova.privsep.utils [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73078) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 18:20:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3e47c6043e6ea1ea6e66cb3fba74c3aa1a55be25.part /opt/stack/data/nova/instances/_base/3e47c6043e6ea1ea6e66cb3fba74c3aa1a55be25.converted {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3e47c6043e6ea1ea6e66cb3fba74c3aa1a55be25.part /opt/stack/data/nova/instances/_base/3e47c6043e6ea1ea6e66cb3fba74c3aa1a55be25.converted" returned: 0 in 0.203s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e47c6043e6ea1ea6e66cb3fba74c3aa1a55be25.converted --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e47c6043e6ea1ea6e66cb3fba74c3aa1a55be25.converted --force-share --output=json" returned: 0 in 0.203s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "3e47c6043e6ea1ea6e66cb3fba74c3aa1a55be25" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.546s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:20:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Acquiring lock "3e47c6043e6ea1ea6e66cb3fba74c3aa1a55be25" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:20:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "3e47c6043e6ea1ea6e66cb3fba74c3aa1a55be25" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:20:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e47c6043e6ea1ea6e66cb3fba74c3aa1a55be25 --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e47c6043e6ea1ea6e66cb3fba74c3aa1a55be25 --force-share --output=json" returned: 0 in 0.171s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e47c6043e6ea1ea6e66cb3fba74c3aa1a55be25,backing_fmt=raw /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk.rescue {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e47c6043e6ea1ea6e66cb3fba74c3aa1a55be25,backing_fmt=raw /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk.rescue" returned: 0 in 0.049s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "3e47c6043e6ea1ea6e66cb3fba74c3aa1a55be25" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG nova.objects.instance [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lazy-loading 'migration_context' on Instance uuid ea445c0c-e5a1-4e24-8008-2cd64a679f34 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Start _get_guest_xml network_info=[{"id": "3a008b18-c1c3-4656-9ada-f437888cdee6", "address": "fa:16:3e:a3:fb:e1", "network": {"id": "45b49a52-f99e-437a-aa8d-440f4f6b1099", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1520302261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1520302261-network", "vif_mac": "fa:16:3e:a3:fb:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9a739612a674c5c82fad631a64c57ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a008b18-c1", "ovs_interfaceid": "3a008b18-c1c3-4656-9ada-f437888cdee6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'cb950435-ff3a-4eeb-85fe-517aa8120217', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '316a2fe4-d0a3-4095-a62f-251949c71f59', 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLhSxMQZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'ea445c0c-e5a1-4e24-8008-2cd64a679f34', 'attached_at': '', 'detached_at': '', 'volume_id': '2c94d393-5546-43fc-b05e-adcb5a32b032', 'serial': '2c94d393-5546-43fc-b05e-adcb5a32b032'}, 'volume_type': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG nova.objects.instance [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lazy-loading 'resources' on Instance uuid ea445c0c-e5a1-4e24-8008-2cd64a679f34 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG nova.objects.instance [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lazy-loading 'numa_topology' on Instance uuid ea445c0c-e5a1-4e24-8008-2cd64a679f34 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:20:02 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:20:02 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:20:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG nova.objects.instance [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lazy-loading 'vcpu_model' on Instance uuid ea445c0c-e5a1-4e24-8008-2cd64a679f34 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLhSxMQZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:20:02 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:20:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:20:02 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:20:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:20:02 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:20:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5596ba0a-5224-4acf-9a63-dd5772b44984]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = rLhSxMQZ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 14 18:20:02 user nova-compute[73078]: node.name = iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032
Aug 14 18:20:02 user nova-compute[73078]: node.tpgt = -1
Aug 14 18:20:02 user nova-compute[73078]: node.startup = automatic
Aug 14 18:20:02 user nova-compute[73078]: node.leading_login = No
Aug 14 18:20:02 user nova-compute[73078]: iface.iscsi_ifacename = default
Aug 14 18:20:02 user nova-compute[73078]: iface.net_ifacename = <empty>
Aug 14 18:20:02 user nova-compute[73078]: iface.ipaddress = <empty>
Aug 14 18:20:02 user nova-compute[73078]: iface.prefix_len = 0
Aug 14 18:20:02 user nova-compute[73078]: iface.hwaddress = <empty>
Aug 14 18:20:02 user nova-compute[73078]: iface.transport_name = tcp
Aug 14 18:20:02 user nova-compute[73078]: iface.initiatorname = <empty>
Aug 14 18:20:02 user nova-compute[73078]: iface.state = <empty>
Aug 14 18:20:02 user nova-compute[73078]: iface.vlan_id = 0
Aug 14 18:20:02 user nova-compute[73078]: iface.vlan_priority = 0
Aug 14 18:20:02 user nova-compute[73078]: iface.vlan_state = <empty>
Aug 14 18:20:02 user nova-compute[73078]: iface.iface_num = 0
Aug 14 18:20:02 user nova-compute[73078]: iface.mtu = 0
Aug 14 18:20:02 user nova-compute[73078]: iface.port = 0
Aug 14 18:20:02 user nova-compute[73078]: iface.bootproto = <empty>
Aug 14 18:20:02 user nova-compute[73078]: iface.subnet_mask = <empty>
Aug 14 18:20:02 user nova-compute[73078]: iface.gateway = <empty>
Aug 14 18:20:02 user nova-compute[73078]: iface.dhcp_alt_client_id_state = <empty>
Aug 14 18:20:02 user nova-compute[73078]: iface.dhcp_alt_client_id = <empty>
Aug 14 18:20:02 user nova-compute[73078]: iface.dhcp_dns = <empty>
Aug 14 18:20:02 user nova-compute[73078]: iface.dhcp_learn_iqn = <empty>
Aug 14 18:20:02 user nova-compute[73078]: iface.dhcp_req_vendor_id_state = <empty>
Aug 14 18:20:02 user nova-compute[73078]: iface.dhcp_vendor_id_state = <empty>
Aug 14 18:20:02 user nova-compute[73078]: iface.dhcp_vendor_id = <empty>
Aug 14 18:20:02 user nova-compute[73078]: iface.dhcp_slp_da = <empty>
Aug 14 18:20:02 user nova-compute[73078]: iface.fragmentation = <empty>
Aug 14 18:20:02 user nova-compute[73078]: iface.gratuitous_arp = <empty>
Aug 14 18:20:02 user nova-compute[73078]: iface.incoming_forwarding = <empty>
Aug 14 18:20:02 user nova-compute[73078]: iface.tos_state = <empty>
Aug 14 18:20:02 user nova-compute[73078]: iface.tos = 0
Aug 14 18:20:02 user nova-compute[73078]: iface.ttl = 0
Aug 14 18:20:02 user nova-compute[73078]: iface.delayed_ack = <empty>
Aug 14 18:20:02 user nova-compute[73078]: iface.tcp_nagle = <empty>
Aug 14 18:20:02 user nova-compute[73078]: iface.tcp_wsf_state = <empty>
Aug 14 18:20:02 user nova-compute[73078]: iface.tcp_wsf = 0
Aug 14 18:20:02 user nova-compute[73078]: iface.tcp_timer_scale = 0
Aug 14 18:20:02 user nova-compute[73078]: iface.tcp_timestamp = <empty>
Aug 14 18:20:02 user nova-compute[73078]: iface.redirect = <empty>
Aug 14 18:20:02 user nova-compute[73078]: iface.def_task_mgmt_timeout = 0
Aug 14 18:20:02 user nova-compute[73078]: iface.header_digest = <empty>
Aug 14 18:20:02 user nova-compute[73078]: iface.data_digest = <empty>
Aug 14 18:20:02 user nova-compute[73078]: iface.immediate_data = <empty>
Aug 14 18:20:02 user nova-compute[73078]: iface.initial_r2t = <empty>
Aug 14 18:20:02 user nova-compute[73078]: iface.data_seq_inorder = <empty>
Aug 14 18:20:02 user nova-compute[73078]: iface.data_pdu_inorder = <empty>
Aug 14 18:20:02 user nova-compute[73078]: iface.erl = 0
Aug 14 18:20:02 user nova-compute[73078]: iface.max_receive_data_len = 0
Aug 14 18:20:02 user nova-compute[73078]: iface.first_burst_len = 0
Aug 14 18:20:02 user nova-compute[73078]: iface.max_outstanding_r2t = 0
Aug 14 18:20:02 user nova-compute[73078]: iface.max_burst_len = 0
Aug 14 18:20:02 user nova-compute[73078]: iface.chap_auth = <empty>
Aug 14 18:20:02 user nova-compute[73078]: iface.bidi_chap = <empty>
Aug 14 18:20:02 user nova-compute[73078]: iface.strict_login_compliance = <empty>
Aug 14 18:20:02 user nova-compute[73078]: iface.discovery_auth = <empty>
Aug 14 18:20:02 user nova-compute[73078]: iface.discovery_logout = <empty>
Aug 14 18:20:02 user nova-compute[73078]: node.discovery_address = <empty>
Aug 14 18:20:02 user nova-compute[73078]: node.discovery_port = 0
Aug 14 18:20:02 user nova-compute[73078]: node.discovery_type = static
Aug 14 18:20:02 user nova-compute[73078]: node.session.initial_cmdsn = 0
Aug 14 18:20:02 user nova-compute[73078]: node.session.initial_login_retry_max = 8
Aug 14 18:20:02 user nova-compute[73078]: node.session.xmit_thread_priority = -20
Aug 14 18:20:02 user nova-compute[73078]: node.session.cmds_max = 128
Aug 14 18:20:02 user nova-compute[73078]: node.session.queue_depth = 32
Aug 14 18:20:02 user nova-compute[73078]: node.session.nr_sessions = 1
Aug 14 18:20:02 user nova-compute[73078]: node.session.auth.authmethod = CHAP
Aug 14 18:20:02 user nova-compute[73078]: node.session.auth.username = rLhSxMQZ
Aug 14 18:20:02 user nova-compute[73078]: node.session.auth.password = ***
Aug 14 18:20:02 user nova-compute[73078]: node.session.auth.username_in = <empty>
Aug 14 18:20:02 user nova-compute[73078]: node.session.auth.password_in = <empty>
Aug 14 18:20:02 user nova-compute[73078]: node.session.auth.chap_algs = MD5
Aug 14 18:20:02 user nova-compute[73078]: node.session.timeo.replacement_timeout = 120
Aug 14 18:20:02 user nova-compute[73078]: node.session.err_timeo.abort_timeout = 15
Aug 14 18:20:02 user nova-compute[73078]: node.session.err_timeo.lu_reset_timeout = 30
Aug 14 18:20:02 user nova-compute[73078]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 14 18:20:02 user nova-compute[73078]: node.session.err_timeo.host_reset_timeout = 60
Aug 14 18:20:02 user nova-compute[73078]: node.session.iscsi.FastAbort = Yes
Aug 14 18:20:02 user nova-compute[73078]: node.session.iscsi.InitialR2T = No
Aug 14 18:20:02 user nova-compute[73078]: node.session.iscsi.ImmediateData = Yes
Aug 14 18:20:02 user nova-compute[73078]: node.session.iscsi.FirstBurstLength = 262144
Aug 14 18:20:02 user nova-compute[73078]: node.session.iscsi.MaxBurstLength = 16776192
Aug 14 18:20:02 user nova-compute[73078]: node.session.iscsi.DefaultTime2Retain = 0
Aug 14 18:20:02 user nova-compute[73078]: node.session.iscsi.DefaultTime2Wait = 2
Aug 14 18:20:02 user nova-compute[73078]: node.session.iscsi.MaxConnections = 1
Aug 14 18:20:02 user nova-compute[73078]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 14 18:20:02 user nova-compute[73078]: node.session.iscsi.ERL = 0
Aug 14 18:20:02 user nova-compute[73078]: node.session.scan = manual
Aug 14 18:20:02 user nova-compute[73078]: node.session.reopen_max = 0
Aug 14 18:20:02 user nova-compute[73078]: node.conn[0].address = 172.16.0.220
Aug 14 18:20:02 user nova-compute[73078]: node.conn[0].port = 3260
Aug 14 18:20:02 user nova-compute[73078]: node.conn[0].startup = manual
Aug 14 18:20:02 user nova-compute[73078]: node.conn[0].tcp.window_size = 524288
Aug 14 18:20:02 user nova-compute[73078]: node.conn[0].tcp.type_of_service = 0
Aug 14 18:20:02 user nova-compute[73078]: node.conn[0].timeo.logout_timeout = 15
Aug 14 18:20:02 user nova-compute[73078]: node.conn[0].timeo.login_timeout = 15
Aug 14 18:20:02 user nova-compute[73078]: node.conn[0].timeo.auth_timeout = 45
Aug 14 18:20:02 user nova-compute[73078]: node.conn[0].timeo.noop_out_interval = 5
Aug 14 18:20:02 user nova-compute[73078]: node.conn[0].timeo.noop_out_timeout = 5
Aug 14 18:20:02 user nova-compute[73078]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 14 18:20:02 user nova-compute[73078]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 14 18:20:02 user nova-compute[73078]: node.conn[0].iscsi.HeaderDigest = None
Aug 14 18:20:02 user nova-compute[73078]: node.conn[0].iscsi.DataDigest = None
Aug 14 18:20:02 user nova-compute[73078]: node.conn[0].iscsi.IFMarker = No
Aug 14 18:20:02 user nova-compute[73078]: node.conn[0].iscsi.OFMarker = No
Aug 14 18:20:02 user nova-compute[73078]: # END RECORD
Aug 14 18:20:02 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[176df146-9ba2-4da7-ba03-ad10f1bf0de6]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5469cc-022c-40f8-a321-9805675a531a]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rLhSxMQZ {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rLhSxMQZ" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2169d8f-0350-4eef-9207-896c0939322e]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rLhSxMQZ'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0318858-c434-4d77-ab27-43dbe0b7289b]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef6d97c-1777-4dfa-93a7-fb799565d6ec]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:20:02 user nova-compute[73078]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 (non-flash)
Aug 14 18:20:02 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:20:02 user nova-compute[73078]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 (non-flash)
Aug 14 18:20:02 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.152s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] HCTL ('33', '0', '0', 0) found on session 29 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e792c8-4062-415a-b40e-138855a8b541]: (4, ('0 0 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Searching for a device in session 29 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLhSxMQZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.179s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] <== connect_volume: return (180ms) {'type': 'block', 'scsi_wwn': '26464306163353634', 'path': '/dev/sdb'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464306163353634', 'path': '/dev/sdb'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:15:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1491685202',display_name='tempest-ServerStableDeviceRescueTest-server-1491685202',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1491685202',id=18,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSTDg2a3FdDwHLS5eghJchIu9zBpTAzj/gcbB/c+1H/CD2nkhiGbofjc2p/swBhyY2DVBNVOfggutnqRrWuq96pedEA+ZYoofu9LuMUjdduc37Lprb2vTrGWcdyssj9AA==',key_name='tempest-keypair-113748248',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:16:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9a739612a674c5c82fad631a64c57ba',ramdisk_id='',reservation_id='r-lbnq00mr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-79994875',owner_user_name='tempest-ServerStableDeviceRescueTest-79994875-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:18:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc572af82fa544ab8d0af9dcc3470136',uuid=ea445c0c-e5a1-4e24-8008-2cd64a679f34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a008b18-c1c3-4656-9ada-f437888cdee6", "address": "fa:16:3e:a3:fb:e1", "network": {"id": "45b49a52-f99e-437a-aa8d-440f4f6b1099", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1520302261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1520302261-network", "vif_mac": "fa:16:3e:a3:fb:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9a739612a674c5c82fad631a64c57ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a008b18-c1", "ovs_interfaceid": "3a008b18-c1c3-4656-9ada-f437888cdee6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Converting VIF {"id": "3a008b18-c1c3-4656-9ada-f437888cdee6", "address": "fa:16:3e:a3:fb:e1", "network": {"id": "45b49a52-f99e-437a-aa8d-440f4f6b1099", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1520302261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1520302261-network", "vif_mac": "fa:16:3e:a3:fb:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9a739612a674c5c82fad631a64c57ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a008b18-c1", "ovs_interfaceid": "3a008b18-c1c3-4656-9ada-f437888cdee6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:fb:e1,bridge_name='br-int',has_traffic_filtering=True,id=3a008b18-c1c3-4656-9ada-f437888cdee6,network=Network(45b49a52-f99e-437a-aa8d-440f4f6b1099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a008b18-c1') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG nova.objects.instance [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lazy-loading 'pci_devices' on Instance uuid ea445c0c-e5a1-4e24-8008-2cd64a679f34 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:20:02 user nova-compute[73078]:   <uuid>ea445c0c-e5a1-4e24-8008-2cd64a679f34</uuid>
Aug 14 18:20:02 user nova-compute[73078]:   <name>instance-00000012</name>
Aug 14 18:20:02 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:20:02 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:20:02 user nova-compute[73078]:   <metadata>
Aug 14 18:20:02 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:20:02 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:20:02 user nova-compute[73078]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1491685202</nova:name>
Aug 14 18:20:02 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:20:02</nova:creationTime>
Aug 14 18:20:02 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:20:02 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:20:02 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:20:02 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:20:02 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:20:02 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:20:02 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:20:02 user nova-compute[73078]:       <nova:owner>
Aug 14 18:20:02 user nova-compute[73078]:         <nova:user uuid="fc572af82fa544ab8d0af9dcc3470136">tempest-ServerStableDeviceRescueTest-79994875-project-member</nova:user>
Aug 14 18:20:02 user nova-compute[73078]:         <nova:project uuid="f9a739612a674c5c82fad631a64c57ba">tempest-ServerStableDeviceRescueTest-79994875</nova:project>
Aug 14 18:20:02 user nova-compute[73078]:       </nova:owner>
Aug 14 18:20:02 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:20:02 user nova-compute[73078]:       <nova:ports>
Aug 14 18:20:02 user nova-compute[73078]:         <nova:port uuid="3a008b18-c1c3-4656-9ada-f437888cdee6">
Aug 14 18:20:02 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 18:20:02 user nova-compute[73078]:         </nova:port>
Aug 14 18:20:02 user nova-compute[73078]:       </nova:ports>
Aug 14 18:20:02 user nova-compute[73078]:     </nova:instance>
Aug 14 18:20:02 user nova-compute[73078]:   </metadata>
Aug 14 18:20:02 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:20:02 user nova-compute[73078]:     <system>
Aug 14 18:20:02 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:20:02 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:20:02 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:20:02 user nova-compute[73078]:       <entry name="serial">ea445c0c-e5a1-4e24-8008-2cd64a679f34</entry>
Aug 14 18:20:02 user nova-compute[73078]:       <entry name="uuid">ea445c0c-e5a1-4e24-8008-2cd64a679f34</entry>
Aug 14 18:20:02 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:20:02 user nova-compute[73078]:     </system>
Aug 14 18:20:02 user nova-compute[73078]:   </sysinfo>
Aug 14 18:20:02 user nova-compute[73078]:   <os>
Aug 14 18:20:02 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:20:02 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:20:02 user nova-compute[73078]:   </os>
Aug 14 18:20:02 user nova-compute[73078]:   <features>
Aug 14 18:20:02 user nova-compute[73078]:     <acpi/>
Aug 14 18:20:02 user nova-compute[73078]:     <apic/>
Aug 14 18:20:02 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:20:02 user nova-compute[73078]:   </features>
Aug 14 18:20:02 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:20:02 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:20:02 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:20:02 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:20:02 user nova-compute[73078]:   </clock>
Aug 14 18:20:02 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:20:02 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:20:02 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:20:02 user nova-compute[73078]:   </cpu>
Aug 14 18:20:02 user nova-compute[73078]:   <devices>
Aug 14 18:20:02 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:20:02 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:20:02 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk"/>
Aug 14 18:20:02 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:20:02 user nova-compute[73078]:     </disk>
Aug 14 18:20:02 user nova-compute[73078]:     <disk type="block" device="disk">
Aug 14 18:20:02 user nova-compute[73078]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:20:02 user nova-compute[73078]:       <source dev="/dev/sdb"/>
Aug 14 18:20:02 user nova-compute[73078]:       <target dev="vdb" bus="virtio"/>
Aug 14 18:20:02 user nova-compute[73078]:       <serial>2c94d393-5546-43fc-b05e-adcb5a32b032</serial>
Aug 14 18:20:02 user nova-compute[73078]:     </disk>
Aug 14 18:20:02 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:20:02 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:20:02 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk.rescue"/>
Aug 14 18:20:02 user nova-compute[73078]:       <target dev="vdc" bus="virtio"/>
Aug 14 18:20:02 user nova-compute[73078]:       <boot order="1"/>
Aug 14 18:20:02 user nova-compute[73078]:     </disk>
Aug 14 18:20:02 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:20:02 user nova-compute[73078]:       <mac address="fa:16:3e:a3:fb:e1"/>
Aug 14 18:20:02 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:20:02 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:20:02 user nova-compute[73078]:       <target dev="tap3a008b18-c1"/>
Aug 14 18:20:02 user nova-compute[73078]:     </interface>
Aug 14 18:20:02 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:20:02 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/console.log" append="off"/>
Aug 14 18:20:02 user nova-compute[73078]:     </serial>
Aug 14 18:20:02 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:20:02 user nova-compute[73078]:     <video>
Aug 14 18:20:02 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:20:02 user nova-compute[73078]:     </video>
Aug 14 18:20:02 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:20:02 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:20:02 user nova-compute[73078]:     </rng>
Aug 14 18:20:02 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:20:02 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:20:02 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:20:02 user nova-compute[73078]:     </memballoon>
Aug 14 18:20:02 user nova-compute[73078]:   </devices>
Aug 14 18:20:02 user nova-compute[73078]: </domain>
Aug 14 18:20:02 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:20:02 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Instance destroyed successfully.
Aug 14 18:20:02 user nova-compute[73078]: DEBUG nova.compute.manager [req-f563a6f7-630e-4416-a717-a8bce192e196 req-93d14c27-1732-42c5-9c24-2f5ec3ab36de service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Received event network-vif-plugged-3a008b18-c1c3-4656-9ada-f437888cdee6 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-f563a6f7-630e-4416-a717-a8bce192e196 req-93d14c27-1732-42c5-9c24-2f5ec3ab36de service nova] Acquiring lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-f563a6f7-630e-4416-a717-a8bce192e196 req-93d14c27-1732-42c5-9c24-2f5ec3ab36de service nova] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-f563a6f7-630e-4416-a717-a8bce192e196 req-93d14c27-1732-42c5-9c24-2f5ec3ab36de service nova] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG nova.compute.manager [req-f563a6f7-630e-4416-a717-a8bce192e196 req-93d14c27-1732-42c5-9c24-2f5ec3ab36de service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] No waiting events found dispatching network-vif-plugged-3a008b18-c1c3-4656-9ada-f437888cdee6 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:20:02 user nova-compute[73078]: WARNING nova.compute.manager [req-f563a6f7-630e-4416-a717-a8bce192e196 req-93d14c27-1732-42c5-9c24-2f5ec3ab36de service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Received unexpected event network-vif-plugged-3a008b18-c1c3-4656-9ada-f437888cdee6 for instance with vm_state active and task_state rescuing.
Aug 14 18:20:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] No VIF found with MAC fa:16:3e:a3:fb:e1, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:20:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:04 user nova-compute[73078]: DEBUG nova.compute.manager [req-364a3da3-6510-4165-8edc-21094b79c213 req-92298b7c-56ae-4374-97dd-61fb6cce1aa4 service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Received event network-vif-plugged-3a008b18-c1c3-4656-9ada-f437888cdee6 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:20:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-364a3da3-6510-4165-8edc-21094b79c213 req-92298b7c-56ae-4374-97dd-61fb6cce1aa4 service nova] Acquiring lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:20:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-364a3da3-6510-4165-8edc-21094b79c213 req-92298b7c-56ae-4374-97dd-61fb6cce1aa4 service nova] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:20:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-364a3da3-6510-4165-8edc-21094b79c213 req-92298b7c-56ae-4374-97dd-61fb6cce1aa4 service nova] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:20:04 user nova-compute[73078]: DEBUG nova.compute.manager [req-364a3da3-6510-4165-8edc-21094b79c213 req-92298b7c-56ae-4374-97dd-61fb6cce1aa4 service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] No waiting events found dispatching network-vif-plugged-3a008b18-c1c3-4656-9ada-f437888cdee6 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:20:04 user nova-compute[73078]: WARNING nova.compute.manager [req-364a3da3-6510-4165-8edc-21094b79c213 req-92298b7c-56ae-4374-97dd-61fb6cce1aa4 service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Received unexpected event network-vif-plugged-3a008b18-c1c3-4656-9ada-f437888cdee6 for instance with vm_state active and task_state rescuing.
Aug 14 18:20:04 user nova-compute[73078]: DEBUG nova.compute.manager [req-364a3da3-6510-4165-8edc-21094b79c213 req-92298b7c-56ae-4374-97dd-61fb6cce1aa4 service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Received event network-vif-plugged-3a008b18-c1c3-4656-9ada-f437888cdee6 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:20:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-364a3da3-6510-4165-8edc-21094b79c213 req-92298b7c-56ae-4374-97dd-61fb6cce1aa4 service nova] Acquiring lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:20:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-364a3da3-6510-4165-8edc-21094b79c213 req-92298b7c-56ae-4374-97dd-61fb6cce1aa4 service nova] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:20:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-364a3da3-6510-4165-8edc-21094b79c213 req-92298b7c-56ae-4374-97dd-61fb6cce1aa4 service nova] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:20:04 user nova-compute[73078]: DEBUG nova.compute.manager [req-364a3da3-6510-4165-8edc-21094b79c213 req-92298b7c-56ae-4374-97dd-61fb6cce1aa4 service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] No waiting events found dispatching network-vif-plugged-3a008b18-c1c3-4656-9ada-f437888cdee6 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:20:04 user nova-compute[73078]: WARNING nova.compute.manager [req-364a3da3-6510-4165-8edc-21094b79c213 req-92298b7c-56ae-4374-97dd-61fb6cce1aa4 service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Received unexpected event network-vif-plugged-3a008b18-c1c3-4656-9ada-f437888cdee6 for instance with vm_state active and task_state rescuing.
Aug 14 18:20:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Removed pending event for ea445c0c-e5a1-4e24-8008-2cd64a679f34 due to event {{(pid=73078) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 18:20:06 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037206.1156273, ea445c0c-e5a1-4e24-8008-2cd64a679f34 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:20:06 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] VM Resumed (Lifecycle Event)
Aug 14 18:20:06 user nova-compute[73078]: DEBUG nova.compute.manager [None req-0dec2308-3c78-4875-a5c5-aed594a1cac6 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:20:06 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:20:06 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:20:06 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 18:20:06 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037206.1171873, ea445c0c-e5a1-4e24-8008-2cd64a679f34 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:20:06 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] VM Started (Lifecycle Event)
Aug 14 18:20:06 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:20:06 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:20:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:11 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692037196.5820537, e812037c-a0ef-4e60-9041-b382087dc2c5 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:20:11 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] VM Stopped (Lifecycle Event)
Aug 14 18:20:11 user nova-compute[73078]: DEBUG nova.compute.manager [None req-0202497a-290b-4c6c-aeb5-29bc3e9b20bf None None] [instance: e812037c-a0ef-4e60-9041-b382087dc2c5] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:20:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:20:17 user nova-compute[73078]: DEBUG nova.compute.manager [req-a039fc03-e77a-4545-920d-0182da3cb1c3 req-bbcb8881-6367-46b1-90fd-f875d5070dbb service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Received event network-changed-08a212c4-6236-4adc-a3ec-6b76341585b3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:20:17 user nova-compute[73078]: DEBUG nova.compute.manager [req-a039fc03-e77a-4545-920d-0182da3cb1c3 req-bbcb8881-6367-46b1-90fd-f875d5070dbb service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Refreshing instance network info cache due to event network-changed-08a212c4-6236-4adc-a3ec-6b76341585b3. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:20:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a039fc03-e77a-4545-920d-0182da3cb1c3 req-bbcb8881-6367-46b1-90fd-f875d5070dbb service nova] Acquiring lock "refresh_cache-4569b529-5c8f-45ec-94fe-58c60f6bcc8a" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:20:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a039fc03-e77a-4545-920d-0182da3cb1c3 req-bbcb8881-6367-46b1-90fd-f875d5070dbb service nova] Acquired lock "refresh_cache-4569b529-5c8f-45ec-94fe-58c60f6bcc8a" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:20:17 user nova-compute[73078]: DEBUG nova.network.neutron [req-a039fc03-e77a-4545-920d-0182da3cb1c3 req-bbcb8881-6367-46b1-90fd-f875d5070dbb service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Refreshing network info cache for port 08a212c4-6236-4adc-a3ec-6b76341585b3 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:20:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:18 user nova-compute[73078]: DEBUG nova.network.neutron [req-a039fc03-e77a-4545-920d-0182da3cb1c3 req-bbcb8881-6367-46b1-90fd-f875d5070dbb service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Updated VIF entry in instance network info cache for port 08a212c4-6236-4adc-a3ec-6b76341585b3. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:20:18 user nova-compute[73078]: DEBUG nova.network.neutron [req-a039fc03-e77a-4545-920d-0182da3cb1c3 req-bbcb8881-6367-46b1-90fd-f875d5070dbb service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Updating instance_info_cache with network_info: [{"id": "08a212c4-6236-4adc-a3ec-6b76341585b3", "address": "fa:16:3e:4f:04:0e", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a212c4-62", "ovs_interfaceid": "08a212c4-6236-4adc-a3ec-6b76341585b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:20:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a039fc03-e77a-4545-920d-0182da3cb1c3 req-bbcb8881-6367-46b1-90fd-f875d5070dbb service nova] Releasing lock "refresh_cache-4569b529-5c8f-45ec-94fe-58c60f6bcc8a" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:20:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8e7ae16e-41bb-4899-9530-21cc3e3880eb tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:20:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8e7ae16e-41bb-4899-9530-21cc3e3880eb tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:20:23 user nova-compute[73078]: INFO nova.compute.manager [None req-8e7ae16e-41bb-4899-9530-21cc3e3880eb tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Shelving
Aug 14 18:20:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:24 user nova-compute[73078]: DEBUG nova.compute.manager [req-ce367416-8b9a-4193-9a0b-9b32c4c58e6c req-ed086326-f37b-4eae-8603-83dbcc9bbb89 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Received event network-vif-unplugged-08a212c4-6236-4adc-a3ec-6b76341585b3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:20:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ce367416-8b9a-4193-9a0b-9b32c4c58e6c req-ed086326-f37b-4eae-8603-83dbcc9bbb89 service nova] Acquiring lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:20:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ce367416-8b9a-4193-9a0b-9b32c4c58e6c req-ed086326-f37b-4eae-8603-83dbcc9bbb89 service nova] Lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:20:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ce367416-8b9a-4193-9a0b-9b32c4c58e6c req-ed086326-f37b-4eae-8603-83dbcc9bbb89 service nova] Lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:20:24 user nova-compute[73078]: DEBUG nova.compute.manager [req-ce367416-8b9a-4193-9a0b-9b32c4c58e6c req-ed086326-f37b-4eae-8603-83dbcc9bbb89 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] No waiting events found dispatching network-vif-unplugged-08a212c4-6236-4adc-a3ec-6b76341585b3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:20:24 user nova-compute[73078]: WARNING nova.compute.manager [req-ce367416-8b9a-4193-9a0b-9b32c4c58e6c req-ed086326-f37b-4eae-8603-83dbcc9bbb89 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Received unexpected event network-vif-unplugged-08a212c4-6236-4adc-a3ec-6b76341585b3 for instance with vm_state active and task_state shelving.
Aug 14 18:20:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:24 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Instance destroyed successfully.
Aug 14 18:20:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:24 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-8e7ae16e-41bb-4899-9530-21cc3e3880eb tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Beginning cold snapshot process
Aug 14 18:20:25 user nova-compute[73078]: DEBUG nova.privsep.utils [None req-8e7ae16e-41bb-4899-9530-21cc3e3880eb tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73078) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 18:20:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-8e7ae16e-41bb-4899-9530-21cc3e3880eb tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/disk /opt/stack/data/nova/instances/snapshots/tmp2kwke0pz/98de41443bbb4e0ebb00ac0dee73745b {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:25 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:25 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:25 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:25 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:25 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:25 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-8e7ae16e-41bb-4899-9530-21cc3e3880eb tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/disk /opt/stack/data/nova/instances/snapshots/tmp2kwke0pz/98de41443bbb4e0ebb00ac0dee73745b" returned: 0 in 0.770s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:25 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-8e7ae16e-41bb-4899-9530-21cc3e3880eb tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Snapshot extracted, beginning image upload
Aug 14 18:20:26 user nova-compute[73078]: DEBUG nova.compute.manager [req-72c1aab3-6c1c-4ed2-b521-250cba5437a9 req-8412cad7-ac02-45e9-b88b-25a4522df105 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Received event network-vif-plugged-08a212c4-6236-4adc-a3ec-6b76341585b3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:20:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-72c1aab3-6c1c-4ed2-b521-250cba5437a9 req-8412cad7-ac02-45e9-b88b-25a4522df105 service nova] Acquiring lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:20:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-72c1aab3-6c1c-4ed2-b521-250cba5437a9 req-8412cad7-ac02-45e9-b88b-25a4522df105 service nova] Lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:20:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-72c1aab3-6c1c-4ed2-b521-250cba5437a9 req-8412cad7-ac02-45e9-b88b-25a4522df105 service nova] Lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:20:26 user nova-compute[73078]: DEBUG nova.compute.manager [req-72c1aab3-6c1c-4ed2-b521-250cba5437a9 req-8412cad7-ac02-45e9-b88b-25a4522df105 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] No waiting events found dispatching network-vif-plugged-08a212c4-6236-4adc-a3ec-6b76341585b3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:20:26 user nova-compute[73078]: WARNING nova.compute.manager [req-72c1aab3-6c1c-4ed2-b521-250cba5437a9 req-8412cad7-ac02-45e9-b88b-25a4522df105 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Received unexpected event network-vif-plugged-08a212c4-6236-4adc-a3ec-6b76341585b3 for instance with vm_state active and task_state shelving_image_uploading.
Aug 14 18:20:26 user nova-compute[73078]: DEBUG nova.compute.manager [req-72c1aab3-6c1c-4ed2-b521-250cba5437a9 req-8412cad7-ac02-45e9-b88b-25a4522df105 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Received event network-vif-plugged-08a212c4-6236-4adc-a3ec-6b76341585b3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:20:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-72c1aab3-6c1c-4ed2-b521-250cba5437a9 req-8412cad7-ac02-45e9-b88b-25a4522df105 service nova] Acquiring lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:20:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-72c1aab3-6c1c-4ed2-b521-250cba5437a9 req-8412cad7-ac02-45e9-b88b-25a4522df105 service nova] Lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:20:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-72c1aab3-6c1c-4ed2-b521-250cba5437a9 req-8412cad7-ac02-45e9-b88b-25a4522df105 service nova] Lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:20:26 user nova-compute[73078]: DEBUG nova.compute.manager [req-72c1aab3-6c1c-4ed2-b521-250cba5437a9 req-8412cad7-ac02-45e9-b88b-25a4522df105 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] No waiting events found dispatching network-vif-plugged-08a212c4-6236-4adc-a3ec-6b76341585b3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:20:26 user nova-compute[73078]: WARNING nova.compute.manager [req-72c1aab3-6c1c-4ed2-b521-250cba5437a9 req-8412cad7-ac02-45e9-b88b-25a4522df105 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Received unexpected event network-vif-plugged-08a212c4-6236-4adc-a3ec-6b76341585b3 for instance with vm_state active and task_state shelving_image_uploading.
Aug 14 18:20:26 user nova-compute[73078]: DEBUG nova.compute.manager [req-72c1aab3-6c1c-4ed2-b521-250cba5437a9 req-8412cad7-ac02-45e9-b88b-25a4522df105 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Received event network-vif-plugged-08a212c4-6236-4adc-a3ec-6b76341585b3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:20:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-72c1aab3-6c1c-4ed2-b521-250cba5437a9 req-8412cad7-ac02-45e9-b88b-25a4522df105 service nova] Acquiring lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:20:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-72c1aab3-6c1c-4ed2-b521-250cba5437a9 req-8412cad7-ac02-45e9-b88b-25a4522df105 service nova] Lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:20:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-72c1aab3-6c1c-4ed2-b521-250cba5437a9 req-8412cad7-ac02-45e9-b88b-25a4522df105 service nova] Lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:20:26 user nova-compute[73078]: DEBUG nova.compute.manager [req-72c1aab3-6c1c-4ed2-b521-250cba5437a9 req-8412cad7-ac02-45e9-b88b-25a4522df105 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] No waiting events found dispatching network-vif-plugged-08a212c4-6236-4adc-a3ec-6b76341585b3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:20:26 user nova-compute[73078]: WARNING nova.compute.manager [req-72c1aab3-6c1c-4ed2-b521-250cba5437a9 req-8412cad7-ac02-45e9-b88b-25a4522df105 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Received unexpected event network-vif-plugged-08a212c4-6236-4adc-a3ec-6b76341585b3 for instance with vm_state active and task_state shelving_image_uploading.
Aug 14 18:20:26 user nova-compute[73078]: DEBUG nova.compute.manager [req-72c1aab3-6c1c-4ed2-b521-250cba5437a9 req-8412cad7-ac02-45e9-b88b-25a4522df105 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Received event network-vif-unplugged-08a212c4-6236-4adc-a3ec-6b76341585b3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:20:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-72c1aab3-6c1c-4ed2-b521-250cba5437a9 req-8412cad7-ac02-45e9-b88b-25a4522df105 service nova] Acquiring lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:20:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-72c1aab3-6c1c-4ed2-b521-250cba5437a9 req-8412cad7-ac02-45e9-b88b-25a4522df105 service nova] Lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:20:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-72c1aab3-6c1c-4ed2-b521-250cba5437a9 req-8412cad7-ac02-45e9-b88b-25a4522df105 service nova] Lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:20:26 user nova-compute[73078]: DEBUG nova.compute.manager [req-72c1aab3-6c1c-4ed2-b521-250cba5437a9 req-8412cad7-ac02-45e9-b88b-25a4522df105 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] No waiting events found dispatching network-vif-unplugged-08a212c4-6236-4adc-a3ec-6b76341585b3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:20:26 user nova-compute[73078]: WARNING nova.compute.manager [req-72c1aab3-6c1c-4ed2-b521-250cba5437a9 req-8412cad7-ac02-45e9-b88b-25a4522df105 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Received unexpected event network-vif-unplugged-08a212c4-6236-4adc-a3ec-6b76341585b3 for instance with vm_state active and task_state shelving_image_uploading.
Aug 14 18:20:26 user nova-compute[73078]: DEBUG nova.compute.manager [req-72c1aab3-6c1c-4ed2-b521-250cba5437a9 req-8412cad7-ac02-45e9-b88b-25a4522df105 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Received event network-vif-plugged-08a212c4-6236-4adc-a3ec-6b76341585b3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:20:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-72c1aab3-6c1c-4ed2-b521-250cba5437a9 req-8412cad7-ac02-45e9-b88b-25a4522df105 service nova] Acquiring lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:20:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-72c1aab3-6c1c-4ed2-b521-250cba5437a9 req-8412cad7-ac02-45e9-b88b-25a4522df105 service nova] Lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:20:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-72c1aab3-6c1c-4ed2-b521-250cba5437a9 req-8412cad7-ac02-45e9-b88b-25a4522df105 service nova] Lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:20:26 user nova-compute[73078]: DEBUG nova.compute.manager [req-72c1aab3-6c1c-4ed2-b521-250cba5437a9 req-8412cad7-ac02-45e9-b88b-25a4522df105 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] No waiting events found dispatching network-vif-plugged-08a212c4-6236-4adc-a3ec-6b76341585b3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:20:26 user nova-compute[73078]: WARNING nova.compute.manager [req-72c1aab3-6c1c-4ed2-b521-250cba5437a9 req-8412cad7-ac02-45e9-b88b-25a4522df105 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Received unexpected event network-vif-plugged-08a212c4-6236-4adc-a3ec-6b76341585b3 for instance with vm_state active and task_state shelving_image_uploading.
Aug 14 18:20:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:20:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:20:28 user nova-compute[73078]: DEBUG nova.objects.instance [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lazy-loading 'flavor' on Instance uuid f61b5dc6-4b63-439b-9b3d-62ee0a4056d3 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:20:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:20:28 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-8e7ae16e-41bb-4899-9530-21cc3e3880eb tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Snapshot image upload complete
Aug 14 18:20:28 user nova-compute[73078]: DEBUG nova.compute.manager [None req-8e7ae16e-41bb-4899-9530-21cc3e3880eb tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:20:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:20:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:20:28 user nova-compute[73078]: INFO nova.compute.manager [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Attaching volume b45567c2-1040-47dc-bf5e-57d8f2867b61 to /dev/vdb
Aug 14 18:20:28 user nova-compute[73078]: DEBUG os_brick.utils [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:20:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:28 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[34014f3b-e6fb-4066-82ac-200c822fff1f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:20:28 user nova-compute[73078]: INFO nova.compute.manager [None req-8e7ae16e-41bb-4899-9530-21cc3e3880eb tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Shelve offloading
Aug 14 18:20:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:28 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Instance destroyed successfully.
Aug 14 18:20:28 user nova-compute[73078]: DEBUG nova.compute.manager [None req-8e7ae16e-41bb-4899-9530-21cc3e3880eb tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:20:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:28 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3df2fb-e582-41e3-8f76-3b53631fd674]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:20:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8e7ae16e-41bb-4899-9530-21cc3e3880eb tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "refresh_cache-4569b529-5c8f-45ec-94fe-58c60f6bcc8a" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:20:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8e7ae16e-41bb-4899-9530-21cc3e3880eb tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquired lock "refresh_cache-4569b529-5c8f-45ec-94fe-58c60f6bcc8a" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:20:28 user nova-compute[73078]: DEBUG nova.network.neutron [None req-8e7ae16e-41bb-4899-9530-21cc3e3880eb tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:20:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:28 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[066f3e4c-9521-4802-b769-c7c768f35e4b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:20:28 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba00b71-a090-49c9-9063-5735a8943187]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:20:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:20:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:20:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:20:28 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:20:28 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cc8af0-a87f-4567-88c4-803647e51dcf]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:20:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:20:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:20:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:20:28 user nova-compute[73078]: DEBUG os_brick.utils [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:20:28 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Updating existing volume attachment record: 48cd2579-c217-40fd-9a06-5863bf3b6e30 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:20:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0e79c8d3-4e19-4850-b20d-d467cbbedb23 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Acquiring lock "7783c26e-ec61-4375-b191-0ce5caf766c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:20:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0e79c8d3-4e19-4850-b20d-d467cbbedb23 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "7783c26e-ec61-4375-b191-0ce5caf766c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:20:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0e79c8d3-4e19-4850-b20d-d467cbbedb23 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Acquiring lock "7783c26e-ec61-4375-b191-0ce5caf766c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:20:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0e79c8d3-4e19-4850-b20d-d467cbbedb23 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "7783c26e-ec61-4375-b191-0ce5caf766c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:20:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0e79c8d3-4e19-4850-b20d-d467cbbedb23 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "7783c26e-ec61-4375-b191-0ce5caf766c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:20:29 user nova-compute[73078]: INFO nova.compute.manager [None req-0e79c8d3-4e19-4850-b20d-d467cbbedb23 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Terminating instance
Aug 14 18:20:29 user nova-compute[73078]: DEBUG nova.compute.manager [None req-0e79c8d3-4e19-4850-b20d-d467cbbedb23 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:20:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:29 user nova-compute[73078]: DEBUG nova.compute.manager [req-ff928aa3-623a-4ee8-94e3-61c6f0084a2b req-e4280ca8-ad8f-4108-a883-aab213a50fb9 service nova] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Received event network-vif-unplugged-ed5a7452-e05e-4923-b8f3-23a67b426ecd {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:20:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ff928aa3-623a-4ee8-94e3-61c6f0084a2b req-e4280ca8-ad8f-4108-a883-aab213a50fb9 service nova] Acquiring lock "7783c26e-ec61-4375-b191-0ce5caf766c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:20:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ff928aa3-623a-4ee8-94e3-61c6f0084a2b req-e4280ca8-ad8f-4108-a883-aab213a50fb9 service nova] Lock "7783c26e-ec61-4375-b191-0ce5caf766c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:20:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ff928aa3-623a-4ee8-94e3-61c6f0084a2b req-e4280ca8-ad8f-4108-a883-aab213a50fb9 service nova] Lock "7783c26e-ec61-4375-b191-0ce5caf766c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:20:29 user nova-compute[73078]: DEBUG nova.compute.manager [req-ff928aa3-623a-4ee8-94e3-61c6f0084a2b req-e4280ca8-ad8f-4108-a883-aab213a50fb9 service nova] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] No waiting events found dispatching network-vif-unplugged-ed5a7452-e05e-4923-b8f3-23a67b426ecd {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:20:29 user nova-compute[73078]: DEBUG nova.compute.manager [req-ff928aa3-623a-4ee8-94e3-61c6f0084a2b req-e4280ca8-ad8f-4108-a883-aab213a50fb9 service nova] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Received event network-vif-unplugged-ed5a7452-e05e-4923-b8f3-23a67b426ecd for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:20:29 user nova-compute[73078]: DEBUG nova.network.neutron [None req-8e7ae16e-41bb-4899-9530-21cc3e3880eb tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Updating instance_info_cache with network_info: [{"id": "08a212c4-6236-4adc-a3ec-6b76341585b3", "address": "fa:16:3e:4f:04:0e", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a212c4-62", "ovs_interfaceid": "08a212c4-6236-4adc-a3ec-6b76341585b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:20:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8e7ae16e-41bb-4899-9530-21cc3e3880eb tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Releasing lock "refresh_cache-4569b529-5c8f-45ec-94fe-58c60f6bcc8a" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:20:29 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Instance destroyed successfully.
Aug 14 18:20:29 user nova-compute[73078]: DEBUG nova.objects.instance [None req-0e79c8d3-4e19-4850-b20d-d467cbbedb23 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lazy-loading 'resources' on Instance uuid 7783c26e-ec61-4375-b191-0ce5caf766c7 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:20:29 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-0e79c8d3-4e19-4850-b20d-d467cbbedb23 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:16:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1479359937',display_name='tempest-TestServerVolumeAttachmentScenario-server-1479359937',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1479359937',id=19,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/F7dEOnEf1GkakSVGeM26tAXSzJLvU4A0ZiMhnYuMASBVngAyTDliFRhpp0b/ouyGqTtzqSDWIhAuvSCM25Ewct/z7Y/O+L+3IH+p59r+ZLDyz1f4M5T9t0CF7VSrfcQ==',key_name='tempest-keypair-404370145',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:16:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='723522b7563c4ab79e178b31052e2b71',ramdisk_id='',reservation_id='r-zj86ct5d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-884491858',owner_user_name='tempest-TestServerVolumeAttachmentScenario-884491858-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:16:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='baa21850755541ab953640640d175ba8',uuid=7783c26e-ec61-4375-b191-0ce5caf766c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed5a7452-e05e-4923-b8f3-23a67b426ecd", "address": "fa:16:3e:f7:07:98", "network": {"id": "d8856523-a980-4d8a-a541-72e9b88add3e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2086630095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "723522b7563c4ab79e178b31052e2b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped5a7452-e0", "ovs_interfaceid": "ed5a7452-e05e-4923-b8f3-23a67b426ecd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:20:29 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-0e79c8d3-4e19-4850-b20d-d467cbbedb23 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Converting VIF {"id": "ed5a7452-e05e-4923-b8f3-23a67b426ecd", "address": "fa:16:3e:f7:07:98", "network": {"id": "d8856523-a980-4d8a-a541-72e9b88add3e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2086630095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "723522b7563c4ab79e178b31052e2b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped5a7452-e0", "ovs_interfaceid": "ed5a7452-e05e-4923-b8f3-23a67b426ecd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:20:29 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-0e79c8d3-4e19-4850-b20d-d467cbbedb23 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:07:98,bridge_name='br-int',has_traffic_filtering=True,id=ed5a7452-e05e-4923-b8f3-23a67b426ecd,network=Network(d8856523-a980-4d8a-a541-72e9b88add3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped5a7452-e0') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:20:29 user nova-compute[73078]: DEBUG os_vif [None req-0e79c8d3-4e19-4850-b20d-d467cbbedb23 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:07:98,bridge_name='br-int',has_traffic_filtering=True,id=ed5a7452-e05e-4923-b8f3-23a67b426ecd,network=Network(d8856523-a980-4d8a-a541-72e9b88add3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped5a7452-e0') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:20:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped5a7452-e0, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:20:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:20:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:30 user nova-compute[73078]: INFO os_vif [None req-0e79c8d3-4e19-4850-b20d-d467cbbedb23 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:07:98,bridge_name='br-int',has_traffic_filtering=True,id=ed5a7452-e05e-4923-b8f3-23a67b426ecd,network=Network(d8856523-a980-4d8a-a541-72e9b88add3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped5a7452-e0')
Aug 14 18:20:30 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-0e79c8d3-4e19-4850-b20d-d467cbbedb23 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Deleting instance files /opt/stack/data/nova/instances/7783c26e-ec61-4375-b191-0ce5caf766c7_del
Aug 14 18:20:30 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-0e79c8d3-4e19-4850-b20d-d467cbbedb23 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Deletion of /opt/stack/data/nova/instances/7783c26e-ec61-4375-b191-0ce5caf766c7_del complete
Aug 14 18:20:30 user nova-compute[73078]: INFO nova.compute.manager [None req-0e79c8d3-4e19-4850-b20d-d467cbbedb23 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 14 18:20:30 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-0e79c8d3-4e19-4850-b20d-d467cbbedb23 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:20:30 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:20:30 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:20:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c9acc5f4-c36e-4e48-bee0-b7c017e08f34 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:20:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c9acc5f4-c36e-4e48-bee0-b7c017e08f34 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:20:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c9acc5f4-c36e-4e48-bee0-b7c017e08f34 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:20:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c9acc5f4-c36e-4e48-bee0-b7c017e08f34 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:20:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c9acc5f4-c36e-4e48-bee0-b7c017e08f34 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:20:30 user nova-compute[73078]: INFO nova.compute.manager [None req-c9acc5f4-c36e-4e48-bee0-b7c017e08f34 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Terminating instance
Aug 14 18:20:30 user nova-compute[73078]: DEBUG nova.compute.manager [None req-c9acc5f4-c36e-4e48-bee0-b7c017e08f34 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:20:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:31 user nova-compute[73078]: DEBUG nova.compute.manager [req-665da78f-2bf9-49e1-afd4-b78c714688c2 req-b4171b52-821b-409b-8d02-f6ef116e61cf service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Received event network-vif-unplugged-c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:20:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-665da78f-2bf9-49e1-afd4-b78c714688c2 req-b4171b52-821b-409b-8d02-f6ef116e61cf service nova] Acquiring lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:20:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-665da78f-2bf9-49e1-afd4-b78c714688c2 req-b4171b52-821b-409b-8d02-f6ef116e61cf service nova] Lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:20:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-665da78f-2bf9-49e1-afd4-b78c714688c2 req-b4171b52-821b-409b-8d02-f6ef116e61cf service nova] Lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:20:31 user nova-compute[73078]: DEBUG nova.compute.manager [req-665da78f-2bf9-49e1-afd4-b78c714688c2 req-b4171b52-821b-409b-8d02-f6ef116e61cf service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] No waiting events found dispatching network-vif-unplugged-c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:20:31 user nova-compute[73078]: DEBUG nova.compute.manager [req-665da78f-2bf9-49e1-afd4-b78c714688c2 req-b4171b52-821b-409b-8d02-f6ef116e61cf service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Received event network-vif-unplugged-c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:20:31 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Instance destroyed successfully.
Aug 14 18:20:31 user nova-compute[73078]: DEBUG nova.objects.instance [None req-c9acc5f4-c36e-4e48-bee0-b7c017e08f34 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lazy-loading 'resources' on Instance uuid 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:20:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-c9acc5f4-c36e-4e48-bee0-b7c017e08f34 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T18:14:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1747051739',display_name='tempest-ServerActionsTestOtherA-server-294631183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1747051739',id=15,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7MoxQfLpU8YABS9Pw20/hLN1B8HMClZxOewhbMQPCKdvwfAau43e4Qw7i1r0zeStVmZeOs2kcJHkp+76O4z0OTCmnK5xY5GG1VsFRZAQIs0+ge0mW06cadbyyO+FeOxg==',key_name='tempest-keypair-1384674648',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:17:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='993dd55f40454640824687ffb6a3c581',ramdisk_id='',reservation_id='r-yhnd265c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1876890021',owner_user_name='tempest-ServerActionsTestOtherA-1876890021-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:17:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cca1112ab354f9fb31658e18c0d03b1',uuid=72c1fcb2-7828-41b6-b9c7-bd12e7b35c47,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a", "address": "fa:16:3e:59:9d:f2", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93a3c8e-9e", "ovs_interfaceid": "c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:20:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-c9acc5f4-c36e-4e48-bee0-b7c017e08f34 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Converting VIF {"id": "c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a", "address": "fa:16:3e:59:9d:f2", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93a3c8e-9e", "ovs_interfaceid": "c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:20:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-c9acc5f4-c36e-4e48-bee0-b7c017e08f34 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:9d:f2,bridge_name='br-int',has_traffic_filtering=True,id=c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a,network=Network(bfef9745-5a40-44b6-a6d5-2ef1e77fc5db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93a3c8e-9e') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:20:31 user nova-compute[73078]: DEBUG os_vif [None req-c9acc5f4-c36e-4e48-bee0-b7c017e08f34 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:9d:f2,bridge_name='br-int',has_traffic_filtering=True,id=c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a,network=Network(bfef9745-5a40-44b6-a6d5-2ef1e77fc5db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93a3c8e-9e') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:20:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc93a3c8e-9e, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:20:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:20:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:31 user nova-compute[73078]: INFO os_vif [None req-c9acc5f4-c36e-4e48-bee0-b7c017e08f34 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:9d:f2,bridge_name='br-int',has_traffic_filtering=True,id=c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a,network=Network(bfef9745-5a40-44b6-a6d5-2ef1e77fc5db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93a3c8e-9e')
Aug 14 18:20:31 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-c9acc5f4-c36e-4e48-bee0-b7c017e08f34 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Deleting instance files /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47_del
Aug 14 18:20:31 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-c9acc5f4-c36e-4e48-bee0-b7c017e08f34 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Deletion of /opt/stack/data/nova/instances/72c1fcb2-7828-41b6-b9c7-bd12e7b35c47_del complete
Aug 14 18:20:31 user nova-compute[73078]: INFO nova.compute.manager [None req-c9acc5f4-c36e-4e48-bee0-b7c017e08f34 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 14 18:20:31 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-c9acc5f4-c36e-4e48-bee0-b7c017e08f34 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:20:31 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:20:31 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:20:31 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Instance destroyed successfully.
Aug 14 18:20:31 user nova-compute[73078]: DEBUG nova.objects.instance [None req-8e7ae16e-41bb-4899-9530-21cc3e3880eb tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lazy-loading 'resources' on Instance uuid 4569b529-5c8f-45ec-94fe-58c60f6bcc8a {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:20:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-8e7ae16e-41bb-4899-9530-21cc3e3880eb tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:18:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-747135967',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-747135967',id=22,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBen6FWZ25Rn4AUFT59E6dGpvbFjj5V25k1Dtd5tlTQ8uteSHDv2JBkULY0OdKYhFtwts5/QeT/t58JgQY7L7c1Vp8+VsK8w/J53StMt+e8AdH3CtgsWBpB1AniYT9Ch0w==',key_name='tempest-keypair-452969408',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:18:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5f00de2496804d6eb570f93307f3f088',ramdisk_id='',reservation_id='r-9qv8yi0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1593185714',owner_user_name='tempest-AttachVolumeShelveTestJSON-1593185714-project-member',shelved_at='2023-08-14T18:20:28.584128',shelved_host='user',shelved_image_id='190ad26a-f669-44fa-8435-2cc3fd5b2a95'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:20:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b07aecccb704835b6b765325b1d18bf',uuid=4569b529-5c8f-45ec-94fe-58c60f6bcc8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "08a212c4-6236-4adc-a3ec-6b76341585b3", "address": "fa:16:3e:4f:04:0e", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a212c4-62", "ovs_interfaceid": "08a212c4-6236-4adc-a3ec-6b76341585b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:20:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-8e7ae16e-41bb-4899-9530-21cc3e3880eb tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Converting VIF {"id": "08a212c4-6236-4adc-a3ec-6b76341585b3", "address": "fa:16:3e:4f:04:0e", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a212c4-62", "ovs_interfaceid": "08a212c4-6236-4adc-a3ec-6b76341585b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:20:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-8e7ae16e-41bb-4899-9530-21cc3e3880eb tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:04:0e,bridge_name='br-int',has_traffic_filtering=True,id=08a212c4-6236-4adc-a3ec-6b76341585b3,network=Network(a3adc062-ecf8-4c88-84ab-69425b236920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08a212c4-62') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:20:31 user nova-compute[73078]: DEBUG os_vif [None req-8e7ae16e-41bb-4899-9530-21cc3e3880eb tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:04:0e,bridge_name='br-int',has_traffic_filtering=True,id=08a212c4-6236-4adc-a3ec-6b76341585b3,network=Network(a3adc062-ecf8-4c88-84ab-69425b236920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08a212c4-62') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:20:31 user nova-compute[73078]: DEBUG nova.compute.manager [req-7e268376-c979-4b46-b453-3576b2e89000 req-20f8aa38-ff1f-4343-b614-ca4bec30c563 service nova] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Received event network-vif-plugged-ed5a7452-e05e-4923-b8f3-23a67b426ecd {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:20:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-7e268376-c979-4b46-b453-3576b2e89000 req-20f8aa38-ff1f-4343-b614-ca4bec30c563 service nova] Acquiring lock "7783c26e-ec61-4375-b191-0ce5caf766c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:20:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-7e268376-c979-4b46-b453-3576b2e89000 req-20f8aa38-ff1f-4343-b614-ca4bec30c563 service nova] Lock "7783c26e-ec61-4375-b191-0ce5caf766c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:20:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-7e268376-c979-4b46-b453-3576b2e89000 req-20f8aa38-ff1f-4343-b614-ca4bec30c563 service nova] Lock "7783c26e-ec61-4375-b191-0ce5caf766c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:20:31 user nova-compute[73078]: DEBUG nova.compute.manager [req-7e268376-c979-4b46-b453-3576b2e89000 req-20f8aa38-ff1f-4343-b614-ca4bec30c563 service nova] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] No waiting events found dispatching network-vif-plugged-ed5a7452-e05e-4923-b8f3-23a67b426ecd {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:20:31 user nova-compute[73078]: WARNING nova.compute.manager [req-7e268376-c979-4b46-b453-3576b2e89000 req-20f8aa38-ff1f-4343-b614-ca4bec30c563 service nova] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Received unexpected event network-vif-plugged-ed5a7452-e05e-4923-b8f3-23a67b426ecd for instance with vm_state active and task_state deleting.
Aug 14 18:20:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08a212c4-62, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:20:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:20:31 user nova-compute[73078]: INFO os_vif [None req-8e7ae16e-41bb-4899-9530-21cc3e3880eb tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:04:0e,bridge_name='br-int',has_traffic_filtering=True,id=08a212c4-6236-4adc-a3ec-6b76341585b3,network=Network(a3adc062-ecf8-4c88-84ab-69425b236920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08a212c4-62')
Aug 14 18:20:31 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-8e7ae16e-41bb-4899-9530-21cc3e3880eb tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Deleting instance files /opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a_del
Aug 14 18:20:31 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-8e7ae16e-41bb-4899-9530-21cc3e3880eb tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Deletion of /opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a_del complete
Aug 14 18:20:31 user nova-compute[73078]: DEBUG nova.compute.manager [req-9db82083-744d-4b8d-a6f5-bb93e08fc07d req-d223d985-bc93-4dd4-ba0f-0c6f3aade9f9 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Received event network-changed-08a212c4-6236-4adc-a3ec-6b76341585b3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:20:31 user nova-compute[73078]: DEBUG nova.compute.manager [req-9db82083-744d-4b8d-a6f5-bb93e08fc07d req-d223d985-bc93-4dd4-ba0f-0c6f3aade9f9 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Refreshing instance network info cache due to event network-changed-08a212c4-6236-4adc-a3ec-6b76341585b3. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:20:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9db82083-744d-4b8d-a6f5-bb93e08fc07d req-d223d985-bc93-4dd4-ba0f-0c6f3aade9f9 service nova] Acquiring lock "refresh_cache-4569b529-5c8f-45ec-94fe-58c60f6bcc8a" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:20:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9db82083-744d-4b8d-a6f5-bb93e08fc07d req-d223d985-bc93-4dd4-ba0f-0c6f3aade9f9 service nova] Acquired lock "refresh_cache-4569b529-5c8f-45ec-94fe-58c60f6bcc8a" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:20:31 user nova-compute[73078]: DEBUG nova.network.neutron [req-9db82083-744d-4b8d-a6f5-bb93e08fc07d req-d223d985-bc93-4dd4-ba0f-0c6f3aade9f9 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Refreshing network info cache for port 08a212c4-6236-4adc-a3ec-6b76341585b3 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:20:31 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:20:31 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-8e7ae16e-41bb-4899-9530-21cc3e3880eb tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Deleted allocations for instance 4569b529-5c8f-45ec-94fe-58c60f6bcc8a
Aug 14 18:20:31 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Took 1.59 seconds to deallocate network for instance.
Aug 14 18:20:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8e7ae16e-41bb-4899-9530-21cc3e3880eb tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:20:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8e7ae16e-41bb-4899-9530-21cc3e3880eb tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:20:31 user nova-compute[73078]: DEBUG nova.objects.instance [None req-8e7ae16e-41bb-4899-9530-21cc3e3880eb tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lazy-loading 'numa_topology' on Instance uuid 4569b529-5c8f-45ec-94fe-58c60f6bcc8a {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:20:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0e79c8d3-4e19-4850-b20d-d467cbbedb23 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:20:32 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-8e7ae16e-41bb-4899-9530-21cc3e3880eb tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:20:32 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-8e7ae16e-41bb-4899-9530-21cc3e3880eb tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:20:32 user nova-compute[73078]: DEBUG nova.network.neutron [req-9db82083-744d-4b8d-a6f5-bb93e08fc07d req-d223d985-bc93-4dd4-ba0f-0c6f3aade9f9 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Updated VIF entry in instance network info cache for port 08a212c4-6236-4adc-a3ec-6b76341585b3. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:20:32 user nova-compute[73078]: DEBUG nova.network.neutron [req-9db82083-744d-4b8d-a6f5-bb93e08fc07d req-d223d985-bc93-4dd4-ba0f-0c6f3aade9f9 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Updating instance_info_cache with network_info: [{"id": "08a212c4-6236-4adc-a3ec-6b76341585b3", "address": "fa:16:3e:4f:04:0e", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap08a212c4-62", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:20:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8e7ae16e-41bb-4899-9530-21cc3e3880eb tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:20:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0e79c8d3-4e19-4850-b20d-d467cbbedb23 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.336s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:20:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9db82083-744d-4b8d-a6f5-bb93e08fc07d req-d223d985-bc93-4dd4-ba0f-0c6f3aade9f9 service nova] Releasing lock "refresh_cache-4569b529-5c8f-45ec-94fe-58c60f6bcc8a" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:20:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8e7ae16e-41bb-4899-9530-21cc3e3880eb tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.219s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:20:32 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-0e79c8d3-4e19-4850-b20d-d467cbbedb23 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:20:32 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-0e79c8d3-4e19-4850-b20d-d467cbbedb23 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:20:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0e79c8d3-4e19-4850-b20d-d467cbbedb23 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:20:32 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-0e79c8d3-4e19-4850-b20d-d467cbbedb23 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Deleted allocations for instance 7783c26e-ec61-4375-b191-0ce5caf766c7
Aug 14 18:20:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0e79c8d3-4e19-4850-b20d-d467cbbedb23 tempest-TestServerVolumeAttachmentScenario-884491858 tempest-TestServerVolumeAttachmentScenario-884491858-project-member] Lock "7783c26e-ec61-4375-b191-0ce5caf766c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.521s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:20:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:33 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:20:33 user nova-compute[73078]: DEBUG nova.compute.manager [req-e48f040a-8f3e-446a-b932-ade75f623eac req-61bd8fa4-c1ac-4e8b-a5b4-c41aefd5c291 service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Received event network-vif-plugged-c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:20:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e48f040a-8f3e-446a-b932-ade75f623eac req-61bd8fa4-c1ac-4e8b-a5b4-c41aefd5c291 service nova] Acquiring lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:20:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e48f040a-8f3e-446a-b932-ade75f623eac req-61bd8fa4-c1ac-4e8b-a5b4-c41aefd5c291 service nova] Lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:20:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e48f040a-8f3e-446a-b932-ade75f623eac req-61bd8fa4-c1ac-4e8b-a5b4-c41aefd5c291 service nova] Lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:20:33 user nova-compute[73078]: DEBUG nova.compute.manager [req-e48f040a-8f3e-446a-b932-ade75f623eac req-61bd8fa4-c1ac-4e8b-a5b4-c41aefd5c291 service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] No waiting events found dispatching network-vif-plugged-c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:20:33 user nova-compute[73078]: WARNING nova.compute.manager [req-e48f040a-8f3e-446a-b932-ade75f623eac req-61bd8fa4-c1ac-4e8b-a5b4-c41aefd5c291 service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Received unexpected event network-vif-plugged-c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a for instance with vm_state active and task_state deleting.
Aug 14 18:20:33 user nova-compute[73078]: DEBUG nova.compute.manager [req-e48f040a-8f3e-446a-b932-ade75f623eac req-61bd8fa4-c1ac-4e8b-a5b4-c41aefd5c291 service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Received event network-vif-deleted-c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:20:33 user nova-compute[73078]: INFO nova.compute.manager [req-e48f040a-8f3e-446a-b932-ade75f623eac req-61bd8fa4-c1ac-4e8b-a5b4-c41aefd5c291 service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Neutron deleted interface c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a; detaching it from the instance and deleting it from the info cache
Aug 14 18:20:33 user nova-compute[73078]: DEBUG nova.network.neutron [req-e48f040a-8f3e-446a-b932-ade75f623eac req-61bd8fa4-c1ac-4e8b-a5b4-c41aefd5c291 service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:20:33 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Took 1.62 seconds to deallocate network for instance.
Aug 14 18:20:33 user nova-compute[73078]: DEBUG nova.compute.manager [req-e48f040a-8f3e-446a-b932-ade75f623eac req-61bd8fa4-c1ac-4e8b-a5b4-c41aefd5c291 service nova] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Detach interface failed, port_id=c93a3c8e-9ead-4d6c-84d3-9158c95a8b2a, reason: Instance 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47 could not be found. {{(pid=73078) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 18:20:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c9acc5f4-c36e-4e48-bee0-b7c017e08f34 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:20:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c9acc5f4-c36e-4e48-bee0-b7c017e08f34 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:20:33 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-c9acc5f4-c36e-4e48-bee0-b7c017e08f34 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:20:33 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-c9acc5f4-c36e-4e48-bee0-b7c017e08f34 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:20:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c9acc5f4-c36e-4e48-bee0-b7c017e08f34 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.438s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:20:33 user nova-compute[73078]: DEBUG nova.compute.manager [req-7a3dd747-2ea1-4d3f-8bf6-791f44100fc4 req-8529d160-31ca-44b2-a850-62bcd5d40544 service nova] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Received event network-vif-deleted-ed5a7452-e05e-4923-b8f3-23a67b426ecd {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:20:33 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-c9acc5f4-c36e-4e48-bee0-b7c017e08f34 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Deleted allocations for instance 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47
Aug 14 18:20:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c9acc5f4-c36e-4e48-bee0-b7c017e08f34 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "72c1fcb2-7828-41b6-b9c7-bd12e7b35c47" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.234s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:20:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IzERaeku', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:20:38 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:20:38 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:20:38 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:20:38 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:20:38 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:20:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb09970-13b3-426f-acea-6326fd72ec4f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:20:38 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[775f7379-21c2-42a1-a38f-92e525426d81]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61] added
Aug 14 18:20:38 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[822cc14f-bc38-449e-bd8e-0c07ee97f866]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5d817a-675d-429c-94e4-06d3a5399118]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IzERaeku {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IzERaeku" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[853850d0-75e5-4e36-96b7-5f98d3ddabf8]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IzERaeku'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6113fb57-5866-4c4f-bedf-fdc5dea5903b]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[328dbb93-b244-42d6-88ca-4c9285183d04]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:20:38 user nova-compute[73078]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 (non-flash)
Aug 14 18:20:38 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:20:38 user nova-compute[73078]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 (non-flash)
Aug 14 18:20:38 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3e08e1-805c-4159-ac1b-862716fb7a47]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61, portal: 172.16.0.220,3260]
Aug 14 18:20:38 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61, portal: 172.16.0.220,3260] successful.
Aug 14 18:20:38 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f9dab2-05e9-4e02-9f62-ccdf05406124]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1dd131e-ae23-4124-b311-d2e265d38eb9]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:20:38 user nova-compute[73078]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 (non-flash)
Aug 14 18:20:38 user nova-compute[73078]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 (non-flash)
Aug 14 18:20:38 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:20:38 user nova-compute[73078]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 (non-flash)
Aug 14 18:20:38 user nova-compute[73078]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 (non-flash)
Aug 14 18:20:38 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2d6e8b-0ff3-414f-b554-32458457be83]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:20:38 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: None {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:20:39 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:20:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IzERaeku', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:20:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:20:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23463376561393635', 'path': '/dev/sdc'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:20:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463376561393635', 'path': '/dev/sdc'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:20:39 user nova-compute[73078]: DEBUG nova.objects.instance [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lazy-loading 'flavor' on Instance uuid f61b5dc6-4b63-439b-9b3d-62ee0a4056d3 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:20:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 18:20:39 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:20:39 user nova-compute[73078]:   <source dev="/dev/sdc"/>
Aug 14 18:20:39 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:20:39 user nova-compute[73078]:   <serial>b45567c2-1040-47dc-bf5e-57d8f2867b61</serial>
Aug 14 18:20:39 user nova-compute[73078]: </disk>
Aug 14 18:20:39 user nova-compute[73078]:  {{(pid=73078) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 18:20:39 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692037224.796223, 4569b529-5c8f-45ec-94fe-58c60f6bcc8a => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:20:39 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] VM Stopped (Lifecycle Event)
Aug 14 18:20:39 user nova-compute[73078]: DEBUG nova.compute.manager [None req-b9fc4d29-423c-45ab-be74-1cb890949dae None None] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:20:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:20:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:20:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] No VIF found with MAC fa:16:3e:4a:28:05, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:20:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f5f1dd5e-c2db-4ad8-97bd-2b6a72d234fe tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.765s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:20:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:44 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692037229.9146953, 7783c26e-ec61-4375-b191-0ce5caf766c7 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:20:44 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] VM Stopped (Lifecycle Event)
Aug 14 18:20:44 user nova-compute[73078]: DEBUG nova.compute.manager [None req-de41de94-3d35-4705-b88c-4ee870b861ef None None] [instance: 7783c26e-ec61-4375-b191-0ce5caf766c7] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:20:45 user nova-compute[73078]: DEBUG nova.compute.manager [req-efea3064-c41b-4fa9-a1fb-c1386c910626 req-783d466b-6c8b-489a-8205-a90f2828a303 service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Received event network-changed-6adf2de6-8801-4cc9-ab39-9a521201ca8a {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:20:45 user nova-compute[73078]: DEBUG nova.compute.manager [req-efea3064-c41b-4fa9-a1fb-c1386c910626 req-783d466b-6c8b-489a-8205-a90f2828a303 service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Refreshing instance network info cache due to event network-changed-6adf2de6-8801-4cc9-ab39-9a521201ca8a. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:20:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-efea3064-c41b-4fa9-a1fb-c1386c910626 req-783d466b-6c8b-489a-8205-a90f2828a303 service nova] Acquiring lock "refresh_cache-ef110d5f-afb5-415c-9590-29da006734a9" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:20:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-efea3064-c41b-4fa9-a1fb-c1386c910626 req-783d466b-6c8b-489a-8205-a90f2828a303 service nova] Acquired lock "refresh_cache-ef110d5f-afb5-415c-9590-29da006734a9" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:20:45 user nova-compute[73078]: DEBUG nova.network.neutron [req-efea3064-c41b-4fa9-a1fb-c1386c910626 req-783d466b-6c8b-489a-8205-a90f2828a303 service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Refreshing network info cache for port 6adf2de6-8801-4cc9-ab39-9a521201ca8a {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:20:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Acquiring lock "ef110d5f-afb5-415c-9590-29da006734a9" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:20:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lock "ef110d5f-afb5-415c-9590-29da006734a9" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:20:46 user nova-compute[73078]: INFO nova.compute.manager [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Shelve offloading
Aug 14 18:20:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:46 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692037231.2972698, 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:20:46 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] VM Stopped (Lifecycle Event)
Aug 14 18:20:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:46 user nova-compute[73078]: DEBUG nova.compute.manager [None req-f9744959-1635-4118-b5b9-663abb20e798 None None] [instance: 72c1fcb2-7828-41b6-b9c7-bd12e7b35c47] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:20:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:46 user nova-compute[73078]: DEBUG nova.network.neutron [req-efea3064-c41b-4fa9-a1fb-c1386c910626 req-783d466b-6c8b-489a-8205-a90f2828a303 service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Updated VIF entry in instance network info cache for port 6adf2de6-8801-4cc9-ab39-9a521201ca8a. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:20:46 user nova-compute[73078]: DEBUG nova.network.neutron [req-efea3064-c41b-4fa9-a1fb-c1386c910626 req-783d466b-6c8b-489a-8205-a90f2828a303 service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Updating instance_info_cache with network_info: [{"id": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "address": "fa:16:3e:b7:d1:09", "network": {"id": "7ba1366f-4346-4830-ae29-621591ee55ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-525338528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a97c5c314a94a52b01778d69561d862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6adf2de6-88", "ovs_interfaceid": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:20:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-efea3064-c41b-4fa9-a1fb-c1386c910626 req-783d466b-6c8b-489a-8205-a90f2828a303 service nova] Releasing lock "refresh_cache-ef110d5f-afb5-415c-9590-29da006734a9" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:20:46 user nova-compute[73078]: DEBUG nova.compute.manager [req-da9bc027-87c1-4446-999f-17dff7f1974b req-3d0bb715-a8f2-4122-a4a7-94938f0d0769 service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Received event network-vif-unplugged-6adf2de6-8801-4cc9-ab39-9a521201ca8a {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:20:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-da9bc027-87c1-4446-999f-17dff7f1974b req-3d0bb715-a8f2-4122-a4a7-94938f0d0769 service nova] Acquiring lock "ef110d5f-afb5-415c-9590-29da006734a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:20:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-da9bc027-87c1-4446-999f-17dff7f1974b req-3d0bb715-a8f2-4122-a4a7-94938f0d0769 service nova] Lock "ef110d5f-afb5-415c-9590-29da006734a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:20:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-da9bc027-87c1-4446-999f-17dff7f1974b req-3d0bb715-a8f2-4122-a4a7-94938f0d0769 service nova] Lock "ef110d5f-afb5-415c-9590-29da006734a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:20:46 user nova-compute[73078]: DEBUG nova.compute.manager [req-da9bc027-87c1-4446-999f-17dff7f1974b req-3d0bb715-a8f2-4122-a4a7-94938f0d0769 service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] No waiting events found dispatching network-vif-unplugged-6adf2de6-8801-4cc9-ab39-9a521201ca8a {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:20:46 user nova-compute[73078]: WARNING nova.compute.manager [req-da9bc027-87c1-4446-999f-17dff7f1974b req-3d0bb715-a8f2-4122-a4a7-94938f0d0769 service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Received unexpected event network-vif-unplugged-6adf2de6-8801-4cc9-ab39-9a521201ca8a for instance with vm_state active and task_state shelving.
Aug 14 18:20:46 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Instance destroyed successfully.
Aug 14 18:20:46 user nova-compute[73078]: DEBUG nova.compute.manager [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:20:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Acquiring lock "refresh_cache-ef110d5f-afb5-415c-9590-29da006734a9" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:20:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Acquired lock "refresh_cache-ef110d5f-afb5-415c-9590-29da006734a9" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:20:46 user nova-compute[73078]: DEBUG nova.network.neutron [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:20:47 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:20:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:48 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:20:48 user nova-compute[73078]: DEBUG nova.network.neutron [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Updating instance_info_cache with network_info: [{"id": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "address": "fa:16:3e:b7:d1:09", "network": {"id": "7ba1366f-4346-4830-ae29-621591ee55ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-525338528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a97c5c314a94a52b01778d69561d862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6adf2de6-88", "ovs_interfaceid": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:20:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Releasing lock "refresh_cache-ef110d5f-afb5-415c-9590-29da006734a9" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:20:48 user nova-compute[73078]: DEBUG nova.compute.manager [req-a2e171d2-d458-4957-bf20-18a47e34a720 req-6f2918b7-382e-4170-b752-aa4ab74e31b9 service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Received event network-vif-plugged-6adf2de6-8801-4cc9-ab39-9a521201ca8a {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:20:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a2e171d2-d458-4957-bf20-18a47e34a720 req-6f2918b7-382e-4170-b752-aa4ab74e31b9 service nova] Acquiring lock "ef110d5f-afb5-415c-9590-29da006734a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:20:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a2e171d2-d458-4957-bf20-18a47e34a720 req-6f2918b7-382e-4170-b752-aa4ab74e31b9 service nova] Lock "ef110d5f-afb5-415c-9590-29da006734a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:20:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a2e171d2-d458-4957-bf20-18a47e34a720 req-6f2918b7-382e-4170-b752-aa4ab74e31b9 service nova] Lock "ef110d5f-afb5-415c-9590-29da006734a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:20:48 user nova-compute[73078]: DEBUG nova.compute.manager [req-a2e171d2-d458-4957-bf20-18a47e34a720 req-6f2918b7-382e-4170-b752-aa4ab74e31b9 service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] No waiting events found dispatching network-vif-plugged-6adf2de6-8801-4cc9-ab39-9a521201ca8a {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:20:48 user nova-compute[73078]: WARNING nova.compute.manager [req-a2e171d2-d458-4957-bf20-18a47e34a720 req-6f2918b7-382e-4170-b752-aa4ab74e31b9 service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Received unexpected event network-vif-plugged-6adf2de6-8801-4cc9-ab39-9a521201ca8a for instance with vm_state active and task_state shelving.
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:20:49 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Instance destroyed successfully.
Aug 14 18:20:49 user nova-compute[73078]: DEBUG nova.objects.instance [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lazy-loading 'resources' on Instance uuid ef110d5f-afb5-415c-9590-29da006734a9 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:18:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1130985749',display_name='tempest-TestShelveInstance-server-1130985749',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1130985749',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1reYlKMKDhreiCvN3W7qUj0UlbkG5KSoN3QC/382Ndyb3kjNdbjplmq8LyPXLlg05YViPAovHDAOEaQZ24+ExLMyfMwYR4qnV7J8GNCTl9uyhPqp6oJkqxxApcu8exrw==',key_name='tempest-TestShelveInstance-979618800',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:19:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a97c5c314a94a52b01778d69561d862',ramdisk_id='',reservation_id='r-lm0zi19n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1474594410',owner_user_name='tempest-TestShelveInstance-1474594410-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:19:10Z,user_data=None,user_id='006108eda23a45df96d06af8cc7c3b42',uuid=ef110d5f-afb5-415c-9590-29da006734a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "address": "fa:16:3e:b7:d1:09", "network": {"id": "7ba1366f-4346-4830-ae29-621591ee55ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-525338528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a97c5c314a94a52b01778d69561d862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6adf2de6-88", "ovs_interfaceid": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Converting VIF {"id": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "address": "fa:16:3e:b7:d1:09", "network": {"id": "7ba1366f-4346-4830-ae29-621591ee55ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-525338528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a97c5c314a94a52b01778d69561d862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6adf2de6-88", "ovs_interfaceid": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:d1:09,bridge_name='br-int',has_traffic_filtering=True,id=6adf2de6-8801-4cc9-ab39-9a521201ca8a,network=Network(7ba1366f-4346-4830-ae29-621591ee55ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6adf2de6-88') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG os_vif [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:d1:09,bridge_name='br-int',has_traffic_filtering=True,id=6adf2de6-8801-4cc9-ab39-9a521201ca8a,network=Network(7ba1366f-4346-4830-ae29-621591ee55ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6adf2de6-88') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6adf2de6-88, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:20:49 user nova-compute[73078]: INFO os_vif [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:d1:09,bridge_name='br-int',has_traffic_filtering=True,id=6adf2de6-8801-4cc9-ab39-9a521201ca8a,network=Network(7ba1366f-4346-4830-ae29-621591ee55ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6adf2de6-88')
Aug 14 18:20:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bCVKUxwE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:20:49 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:20:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6a9c00-150e-4fd5-ad92-70255cd39160]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[528171fd-38b6-4fc2-a109-83922ec012ce]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:20:49 user nova-compute[73078]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 (non-flash)
Aug 14 18:20:49 user nova-compute[73078]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 (non-flash)
Aug 14 18:20:49 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:20:49 user nova-compute[73078]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 (non-flash)
Aug 14 18:20:49 user nova-compute[73078]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 (non-flash)
Aug 14 18:20:49 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe97818f640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac'): ({'sde'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Removing single pathed devices sde {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[00691075-75b4-4f7d-850f-0f78e94ac627]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.031s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49960fa-33e2-492e-a49b-a8b0c5e5274e]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Flushing IO for device /dev/sde {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc63144-88ea-489d-9ba7-e45ee11ab5e1]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[99256c4c-0b21-4e54-832d-bac73cea5aee]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] SCSI volumes sde have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a50df6-d26f-458c-9eb2-4cd725dc3fff]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d8bc64-4773-482d-bef8-6ad8d23f15a2]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac, portal: 172.16.0.220,3260]
Aug 14 18:20:49 user nova-compute[73078]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac, portal: 172.16.0.220,3260] successful.
Aug 14 18:20:49 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[656c4358-0f46-4356-bd4f-ba36632b29b0]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] <== disconnect_volume: return (397ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:20:49 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Deleting instance files /opt/stack/data/nova/instances/ef110d5f-afb5-415c-9590-29da006734a9_del
Aug 14 18:20:49 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Deletion of /opt/stack/data/nova/instances/ef110d5f-afb5-415c-9590-29da006734a9_del complete
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:50 user nova-compute[73078]: DEBUG nova.compute.manager [req-fe4cf579-dcc8-49cf-8691-549e9456082d req-6df3f6ee-15b4-4040-a3c3-a4a99e8baeec service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Received event network-changed-6adf2de6-8801-4cc9-ab39-9a521201ca8a {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:20:50 user nova-compute[73078]: DEBUG nova.compute.manager [req-fe4cf579-dcc8-49cf-8691-549e9456082d req-6df3f6ee-15b4-4040-a3c3-a4a99e8baeec service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Refreshing instance network info cache due to event network-changed-6adf2de6-8801-4cc9-ab39-9a521201ca8a. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:20:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-fe4cf579-dcc8-49cf-8691-549e9456082d req-6df3f6ee-15b4-4040-a3c3-a4a99e8baeec service nova] Acquiring lock "refresh_cache-ef110d5f-afb5-415c-9590-29da006734a9" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:20:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-fe4cf579-dcc8-49cf-8691-549e9456082d req-6df3f6ee-15b4-4040-a3c3-a4a99e8baeec service nova] Acquired lock "refresh_cache-ef110d5f-afb5-415c-9590-29da006734a9" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:20:50 user nova-compute[73078]: DEBUG nova.network.neutron [req-fe4cf579-dcc8-49cf-8691-549e9456082d req-6df3f6ee-15b4-4040-a3c3-a4a99e8baeec service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Refreshing network info cache for port 6adf2de6-8801-4cc9-ab39-9a521201ca8a {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:20:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:20:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk.rescue --force-share --output=json" returned: 0 in 0.240s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:51 user nova-compute[73078]: DEBUG nova.network.neutron [req-fe4cf579-dcc8-49cf-8691-549e9456082d req-6df3f6ee-15b4-4040-a3c3-a4a99e8baeec service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Updated VIF entry in instance network info cache for port 6adf2de6-8801-4cc9-ab39-9a521201ca8a. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:20:51 user nova-compute[73078]: DEBUG nova.network.neutron [req-fe4cf579-dcc8-49cf-8691-549e9456082d req-6df3f6ee-15b4-4040-a3c3-a4a99e8baeec service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Updating instance_info_cache with network_info: [{"id": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "address": "fa:16:3e:b7:d1:09", "network": {"id": "7ba1366f-4346-4830-ae29-621591ee55ed", "bridge": null, "label": "tempest-TestShelveInstance-525338528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a97c5c314a94a52b01778d69561d862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap6adf2de6-88", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:20:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-fe4cf579-dcc8-49cf-8691-549e9456082d req-6df3f6ee-15b4-4040-a3c3-a4a99e8baeec service nova] Releasing lock "refresh_cache-ef110d5f-afb5-415c-9590-29da006734a9" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:20:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-a8418f5b-b45a-4264-9fb7-8b52a945477e req-dc9624f4-9a60-43ec-84db-380dd276aea0 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Received event network-changed-183ecc4d-2001-4254-9f1b-af3a43c362dc {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:20:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-a8418f5b-b45a-4264-9fb7-8b52a945477e req-dc9624f4-9a60-43ec-84db-380dd276aea0 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Refreshing instance network info cache due to event network-changed-183ecc4d-2001-4254-9f1b-af3a43c362dc. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:20:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a8418f5b-b45a-4264-9fb7-8b52a945477e req-dc9624f4-9a60-43ec-84db-380dd276aea0 service nova] Acquiring lock "refresh_cache-f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:20:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a8418f5b-b45a-4264-9fb7-8b52a945477e req-dc9624f4-9a60-43ec-84db-380dd276aea0 service nova] Acquired lock "refresh_cache-f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:20:51 user nova-compute[73078]: DEBUG nova.network.neutron [req-a8418f5b-b45a-4264-9fb7-8b52a945477e req-dc9624f4-9a60-43ec-84db-380dd276aea0 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Refreshing network info cache for port 183ecc4d-2001-4254-9f1b-af3a43c362dc {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:20:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:52 user nova-compute[73078]: DEBUG nova.network.neutron [req-a8418f5b-b45a-4264-9fb7-8b52a945477e req-dc9624f4-9a60-43ec-84db-380dd276aea0 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Updated VIF entry in instance network info cache for port 183ecc4d-2001-4254-9f1b-af3a43c362dc. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:20:52 user nova-compute[73078]: DEBUG nova.network.neutron [req-a8418f5b-b45a-4264-9fb7-8b52a945477e req-dc9624f4-9a60-43ec-84db-380dd276aea0 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Updating instance_info_cache with network_info: [{"id": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "address": "fa:16:3e:4a:28:05", "network": {"id": "4c337404-9329-43e7-bed1-7b5dc32f6cd9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-902748542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6461284f1d491c9cd726d8550a445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183ecc4d-20", "ovs_interfaceid": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:20:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a8418f5b-b45a-4264-9fb7-8b52a945477e req-dc9624f4-9a60-43ec-84db-380dd276aea0 service nova] Releasing lock "refresh_cache-f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:20:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:20:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:20:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:20:52 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Error from libvirt while getting description of instance-00000018: [Error Code 42] Domain not found: no domain with matching uuid 'ef110d5f-afb5-415c-9590-29da006734a9' (instance-00000018): libvirt.libvirtError: Domain not found: no domain with matching uuid 'ef110d5f-afb5-415c-9590-29da006734a9' (instance-00000018)
Aug 14 18:20:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:53 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:20:53 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:20:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=7618MB free_disk=25.189109802246094GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:20:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:20:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:20:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance de80e188-9385-4613-8a6c-aa72b624ad55 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:20:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 1f88cb97-4f22-439e-99f2-d7cb8d5aff36 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:20:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 3c840309-9884-4c8a-a6ee-1acd44f32c4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:20:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance ea445c0c-e5a1-4e24-8008-2cd64a679f34 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:20:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance f61b5dc6-4b63-439b-9b3d-62ee0a4056d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:20:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance ef110d5f-afb5-415c-9590-29da006734a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:20:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance a99aa211-c2a1-4240-90cc-2df068d4f669 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:20:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:20:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:20:53 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:20:53 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:20:53 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:20:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.400s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:20:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:54 user nova-compute[73078]: DEBUG nova.compute.manager [req-dc3893a4-656d-4514-92ac-21160aa3af7f req-730c585d-23d3-4d1d-8290-2af55bc3f4e5 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Received event network-changed-183ecc4d-2001-4254-9f1b-af3a43c362dc {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:20:54 user nova-compute[73078]: DEBUG nova.compute.manager [req-dc3893a4-656d-4514-92ac-21160aa3af7f req-730c585d-23d3-4d1d-8290-2af55bc3f4e5 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Refreshing instance network info cache due to event network-changed-183ecc4d-2001-4254-9f1b-af3a43c362dc. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:20:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-dc3893a4-656d-4514-92ac-21160aa3af7f req-730c585d-23d3-4d1d-8290-2af55bc3f4e5 service nova] Acquiring lock "refresh_cache-f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:20:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-dc3893a4-656d-4514-92ac-21160aa3af7f req-730c585d-23d3-4d1d-8290-2af55bc3f4e5 service nova] Acquired lock "refresh_cache-f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:20:54 user nova-compute[73078]: DEBUG nova.network.neutron [req-dc3893a4-656d-4514-92ac-21160aa3af7f req-730c585d-23d3-4d1d-8290-2af55bc3f4e5 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Refreshing network info cache for port 183ecc4d-2001-4254-9f1b-af3a43c362dc {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:20:54 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:20:54 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:20:54 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:20:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-3c840309-9884-4c8a-a6ee-1acd44f32c4c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:20:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-3c840309-9884-4c8a-a6ee-1acd44f32c4c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:20:54 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:20:55 user nova-compute[73078]: DEBUG nova.network.neutron [req-dc3893a4-656d-4514-92ac-21160aa3af7f req-730c585d-23d3-4d1d-8290-2af55bc3f4e5 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Updated VIF entry in instance network info cache for port 183ecc4d-2001-4254-9f1b-af3a43c362dc. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:20:55 user nova-compute[73078]: DEBUG nova.network.neutron [req-dc3893a4-656d-4514-92ac-21160aa3af7f req-730c585d-23d3-4d1d-8290-2af55bc3f4e5 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Updating instance_info_cache with network_info: [{"id": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "address": "fa:16:3e:4a:28:05", "network": {"id": "4c337404-9329-43e7-bed1-7b5dc32f6cd9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-902748542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6461284f1d491c9cd726d8550a445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183ecc4d-20", "ovs_interfaceid": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:20:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-dc3893a4-656d-4514-92ac-21160aa3af7f req-730c585d-23d3-4d1d-8290-2af55bc3f4e5 service nova] Releasing lock "refresh_cache-f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:20:55 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Updating instance_info_cache with network_info: [{"id": "03e9ece7-7612-4a4f-86ab-d85b0c97d723", "address": "fa:16:3e:70:6a:64", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e9ece7-76", "ovs_interfaceid": "03e9ece7-7612-4a4f-86ab-d85b0c97d723", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:20:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-3c840309-9884-4c8a-a6ee-1acd44f32c4c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:20:55 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:20:55 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:20:55 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:20:55 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:20:55 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:20:57 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:20:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:21:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:21:00 user nova-compute[73078]: INFO nova.compute.manager [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Rebooting instance
Aug 14 18:21:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "refresh_cache-f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:21:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquired lock "refresh_cache-f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:21:00 user nova-compute[73078]: DEBUG nova.network.neutron [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:21:01 user nova-compute[73078]: DEBUG nova.network.neutron [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Updating instance_info_cache with network_info: [{"id": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "address": "fa:16:3e:4a:28:05", "network": {"id": "4c337404-9329-43e7-bed1-7b5dc32f6cd9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-902748542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6461284f1d491c9cd726d8550a445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183ecc4d-20", "ovs_interfaceid": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:21:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Releasing lock "refresh_cache-f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:21:01 user nova-compute[73078]: DEBUG nova.compute.manager [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:21:01 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692037246.9106703, ef110d5f-afb5-415c-9590-29da006734a9 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:21:01 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: ef110d5f-afb5-415c-9590-29da006734a9] VM Stopped (Lifecycle Event)
Aug 14 18:21:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:01 user nova-compute[73078]: DEBUG nova.compute.manager [None req-e86cc046-25f9-46fa-891e-d1f53dc9e1e5 None None] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:21:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG nova.compute.manager [req-1106c59d-82b2-462b-ba74-7b1f97808bae req-63be29a3-170a-4be7-98f5-b95b4b7d88c0 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Received event network-vif-unplugged-183ecc4d-2001-4254-9f1b-af3a43c362dc {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1106c59d-82b2-462b-ba74-7b1f97808bae req-63be29a3-170a-4be7-98f5-b95b4b7d88c0 service nova] Acquiring lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1106c59d-82b2-462b-ba74-7b1f97808bae req-63be29a3-170a-4be7-98f5-b95b4b7d88c0 service nova] Lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1106c59d-82b2-462b-ba74-7b1f97808bae req-63be29a3-170a-4be7-98f5-b95b4b7d88c0 service nova] Lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG nova.compute.manager [req-1106c59d-82b2-462b-ba74-7b1f97808bae req-63be29a3-170a-4be7-98f5-b95b4b7d88c0 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] No waiting events found dispatching network-vif-unplugged-183ecc4d-2001-4254-9f1b-af3a43c362dc {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:21:02 user nova-compute[73078]: WARNING nova.compute.manager [req-1106c59d-82b2-462b-ba74-7b1f97808bae req-63be29a3-170a-4be7-98f5-b95b4b7d88c0 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Received unexpected event network-vif-unplugged-183ecc4d-2001-4254-9f1b-af3a43c362dc for instance with vm_state active and task_state reboot_started_hard.
Aug 14 18:21:02 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Instance destroyed successfully.
Aug 14 18:21:02 user nova-compute[73078]: DEBUG nova.objects.instance [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lazy-loading 'resources' on Instance uuid f61b5dc6-4b63-439b-9b3d-62ee0a4056d3 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:18:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1957182722',display_name='tempest-TestMinimumBasicScenario-server-1957182722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1957182722',id=23,image_ref='5e7413b1-16bd-4339-a215-31981164558b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjJC77llA3l7SUHq/hdkyC+9XFeVKxXNkUb+w5/DdLo+f1BeNe0yWHGVzXJxkhWwKbQcpDIu12NoXM5bJGoIURQlOaFuP0tnE3q8Bzd1rGOHAZD4ANRxT9WAGQT7bMi9A==',key_name='tempest-TestMinimumBasicScenario-1154723146',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:18:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d6461284f1d491c9cd726d8550a445b',ramdisk_id='',reservation_id='r-dghlbzh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e7413b1-16bd-4339-a215-31981164558b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-703150932',owner_user_name='tempest-TestMinimumBasicScenario-703150932-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:21:02Z,user_data=None,user_id='6ffd9b3d18374103918d71165106f131',uuid=f61b5dc6-4b63-439b-9b3d-62ee0a4056d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "address": "fa:16:3e:4a:28:05", "network": {"id": "4c337404-9329-43e7-bed1-7b5dc32f6cd9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-902748542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6461284f1d491c9cd726d8550a445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183ecc4d-20", "ovs_interfaceid": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Converting VIF {"id": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "address": "fa:16:3e:4a:28:05", "network": {"id": "4c337404-9329-43e7-bed1-7b5dc32f6cd9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-902748542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6461284f1d491c9cd726d8550a445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183ecc4d-20", "ovs_interfaceid": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:28:05,bridge_name='br-int',has_traffic_filtering=True,id=183ecc4d-2001-4254-9f1b-af3a43c362dc,network=Network(4c337404-9329-43e7-bed1-7b5dc32f6cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183ecc4d-20') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG os_vif [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:28:05,bridge_name='br-int',has_traffic_filtering=True,id=183ecc4d-2001-4254-9f1b-af3a43c362dc,network=Network(4c337404-9329-43e7-bed1-7b5dc32f6cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183ecc4d-20') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap183ecc4d-20, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:21:02 user nova-compute[73078]: INFO os_vif [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:28:05,bridge_name='br-int',has_traffic_filtering=True,id=183ecc4d-2001-4254-9f1b-af3a43c362dc,network=Network(4c337404-9329-43e7-bed1-7b5dc32f6cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183ecc4d-20')
Aug 14 18:21:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IzERaeku', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:21:02 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:21:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2490dfbb-749b-4293-b2ed-f3c0749d0366]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1ce391-4b8a-4e27-9d2d-1e86d755ab87]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 (non-flash)
Aug 14 18:21:02 user nova-compute[73078]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 (non-flash)
Aug 14 18:21:02 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 (non-flash)
Aug 14 18:21:02 user nova-compute[73078]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 (non-flash)
Aug 14 18:21:02 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe978269cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61'): ({'sdc'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Removing single pathed devices sdc {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c14442d-2865-4cb8-9a94-5c56b6b8d900]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8f1a6d-26b1-41a1-9466-7524ea285b30]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Flushing IO for device /dev/sdc {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[560220dd-ed89-491c-bf39-0902697ccb9d]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe694381-b172-44a8-b5f4-33c24eb1224b]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] SCSI volumes sdc have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6190f760-2a55-415a-abcf-34d4621db43f]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[900030ad-f19c-4e61-8f6c-17c6401f50b6]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61, portal: 172.16.0.220,3260]
Aug 14 18:21:02 user nova-compute[73078]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61, portal: 172.16.0.220,3260] successful.
Aug 14 18:21:02 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[37abcb93-93bc-4040-8d8b-a069d9ea17eb]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] <== disconnect_volume: return (280ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:21:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Start _get_guest_xml network_info=[{"id": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "address": "fa:16:3e:4a:28:05", "network": {"id": "4c337404-9329-43e7-bed1-7b5dc32f6cd9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-902748542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6461284f1d491c9cd726d8550a445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183ecc4d-20", "ovs_interfaceid": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5e7413b1-16bd-4339-a215-31981164558b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '5e7413b1-16bd-4339-a215-31981164558b'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '48cd2579-c217-40fd-9a06-5863bf3b6e30', 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IzERaeku', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'f61b5dc6-4b63-439b-9b3d-62ee0a4056d3', 'attached_at': '', 'detached_at': '', 'volume_id': 'b45567c2-1040-47dc-bf5e-57d8f2867b61', 'serial': 'b45567c2-1040-47dc-bf5e-57d8f2867b61'}, 'volume_type': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:21:03 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:21:03 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:21:03 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5e7413b1-16bd-4339-a215-31981164558b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG nova.objects.instance [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lazy-loading 'vcpu_model' on Instance uuid f61b5dc6-4b63-439b-9b3d-62ee0a4056d3 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IzERaeku', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:21:03 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:21:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:21:03 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:21:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:21:03 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:21:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af1b0b9-c30e-4347-9155-91304397a1ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:21:03 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1caab96-5747-4fb7-85d7-1d5ed74ea221]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61] added
Aug 14 18:21:03 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4675244c-ba0a-482f-aea2-126d960a9f50]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[580a0d9e-f0e6-4d1e-96e4-6b21d4540505]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IzERaeku {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IzERaeku" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffa0b33-422e-48f3-acd8-683c05d64560]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IzERaeku'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a7b9f4-b3cf-4b2b-9c92-3825043b91c8]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60217b4-6a18-4ed1-8c3c-08ebe032b0ef]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 (non-flash)
Aug 14 18:21:03 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 (non-flash)
Aug 14 18:21:03 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a5cd14-88c9-4ccc-8a37-3d6b523d74b9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61, portal: 172.16.0.220,3260]
Aug 14 18:21:03 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61, portal: 172.16.0.220,3260] successful.
Aug 14 18:21:03 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c7895a-6830-4a07-91ce-3e8bc213952c]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e0a9ef-b90d-442f-9977-a3fbecc1df09]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 (non-flash)
Aug 14 18:21:03 user nova-compute[73078]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 (non-flash)
Aug 14 18:21:03 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 (non-flash)
Aug 14 18:21:03 user nova-compute[73078]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 (non-flash)
Aug 14 18:21:03 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7385e42f-3fba-4166-a9a4-70086d18d5cc]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:21:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IzERaeku', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:21:04 user nova-compute[73078]: DEBUG nova.compute.manager [req-bb95c8b3-8fff-45cf-b444-f8e8f2268159 req-f1af978e-9020-4eba-bb86-cdbffc9fe6a1 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Received event network-vif-plugged-183ecc4d-2001-4254-9f1b-af3a43c362dc {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:21:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-bb95c8b3-8fff-45cf-b444-f8e8f2268159 req-f1af978e-9020-4eba-bb86-cdbffc9fe6a1 service nova] Acquiring lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:21:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-bb95c8b3-8fff-45cf-b444-f8e8f2268159 req-f1af978e-9020-4eba-bb86-cdbffc9fe6a1 service nova] Lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:21:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-bb95c8b3-8fff-45cf-b444-f8e8f2268159 req-f1af978e-9020-4eba-bb86-cdbffc9fe6a1 service nova] Lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:21:04 user nova-compute[73078]: DEBUG nova.compute.manager [req-bb95c8b3-8fff-45cf-b444-f8e8f2268159 req-f1af978e-9020-4eba-bb86-cdbffc9fe6a1 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] No waiting events found dispatching network-vif-plugged-183ecc4d-2001-4254-9f1b-af3a43c362dc {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:21:04 user nova-compute[73078]: WARNING nova.compute.manager [req-bb95c8b3-8fff-45cf-b444-f8e8f2268159 req-f1af978e-9020-4eba-bb86-cdbffc9fe6a1 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Received unexpected event network-vif-plugged-183ecc4d-2001-4254-9f1b-af3a43c362dc for instance with vm_state active and task_state reboot_started_hard.
Aug 14 18:21:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:21:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23463376561393635', 'path': '/dev/sdc'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:21:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463376561393635', 'path': '/dev/sdc'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:21:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:18:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1957182722',display_name='tempest-TestMinimumBasicScenario-server-1957182722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1957182722',id=23,image_ref='5e7413b1-16bd-4339-a215-31981164558b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjJC77llA3l7SUHq/hdkyC+9XFeVKxXNkUb+w5/DdLo+f1BeNe0yWHGVzXJxkhWwKbQcpDIu12NoXM5bJGoIURQlOaFuP0tnE3q8Bzd1rGOHAZD4ANRxT9WAGQT7bMi9A==',key_name='tempest-TestMinimumBasicScenario-1154723146',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:18:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d6461284f1d491c9cd726d8550a445b',ramdisk_id='',reservation_id='r-dghlbzh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e7413b1-16bd-4339-a215-31981164558b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-703150932',owner_user_name='tempest-TestMinimumBasicScenario-703150932-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:21:02Z,user_data=None,user_id='6ffd9b3d18374103918d71165106f131',uuid=f61b5dc6-4b63-439b-9b3d-62ee0a4056d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "address": "fa:16:3e:4a:28:05", "network": {"id": "4c337404-9329-43e7-bed1-7b5dc32f6cd9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-902748542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6461284f1d491c9cd726d8550a445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183ecc4d-20", "ovs_interfaceid": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:21:04 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Converting VIF {"id": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "address": "fa:16:3e:4a:28:05", "network": {"id": "4c337404-9329-43e7-bed1-7b5dc32f6cd9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-902748542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6461284f1d491c9cd726d8550a445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183ecc4d-20", "ovs_interfaceid": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:21:04 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:28:05,bridge_name='br-int',has_traffic_filtering=True,id=183ecc4d-2001-4254-9f1b-af3a43c362dc,network=Network(4c337404-9329-43e7-bed1-7b5dc32f6cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183ecc4d-20') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:21:04 user nova-compute[73078]: DEBUG nova.objects.instance [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lazy-loading 'pci_devices' on Instance uuid f61b5dc6-4b63-439b-9b3d-62ee0a4056d3 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:21:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:21:04 user nova-compute[73078]:   <uuid>f61b5dc6-4b63-439b-9b3d-62ee0a4056d3</uuid>
Aug 14 18:21:04 user nova-compute[73078]:   <name>instance-00000017</name>
Aug 14 18:21:04 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:21:04 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:21:04 user nova-compute[73078]:   <metadata>
Aug 14 18:21:04 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:21:04 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:21:04 user nova-compute[73078]:       <nova:name>tempest-TestMinimumBasicScenario-server-1957182722</nova:name>
Aug 14 18:21:04 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:21:03</nova:creationTime>
Aug 14 18:21:04 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:21:04 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:21:04 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:21:04 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:21:04 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:21:04 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:21:04 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:21:04 user nova-compute[73078]:       <nova:owner>
Aug 14 18:21:04 user nova-compute[73078]:         <nova:user uuid="6ffd9b3d18374103918d71165106f131">tempest-TestMinimumBasicScenario-703150932-project-member</nova:user>
Aug 14 18:21:04 user nova-compute[73078]:         <nova:project uuid="7d6461284f1d491c9cd726d8550a445b">tempest-TestMinimumBasicScenario-703150932</nova:project>
Aug 14 18:21:04 user nova-compute[73078]:       </nova:owner>
Aug 14 18:21:04 user nova-compute[73078]:       <nova:root type="image" uuid="5e7413b1-16bd-4339-a215-31981164558b"/>
Aug 14 18:21:04 user nova-compute[73078]:       <nova:ports>
Aug 14 18:21:04 user nova-compute[73078]:         <nova:port uuid="183ecc4d-2001-4254-9f1b-af3a43c362dc">
Aug 14 18:21:04 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 14 18:21:04 user nova-compute[73078]:         </nova:port>
Aug 14 18:21:04 user nova-compute[73078]:       </nova:ports>
Aug 14 18:21:04 user nova-compute[73078]:     </nova:instance>
Aug 14 18:21:04 user nova-compute[73078]:   </metadata>
Aug 14 18:21:04 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:21:04 user nova-compute[73078]:     <system>
Aug 14 18:21:04 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:21:04 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:21:04 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:21:04 user nova-compute[73078]:       <entry name="serial">f61b5dc6-4b63-439b-9b3d-62ee0a4056d3</entry>
Aug 14 18:21:04 user nova-compute[73078]:       <entry name="uuid">f61b5dc6-4b63-439b-9b3d-62ee0a4056d3</entry>
Aug 14 18:21:04 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:21:04 user nova-compute[73078]:     </system>
Aug 14 18:21:04 user nova-compute[73078]:   </sysinfo>
Aug 14 18:21:04 user nova-compute[73078]:   <os>
Aug 14 18:21:04 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:21:04 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:21:04 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:21:04 user nova-compute[73078]:   </os>
Aug 14 18:21:04 user nova-compute[73078]:   <features>
Aug 14 18:21:04 user nova-compute[73078]:     <acpi/>
Aug 14 18:21:04 user nova-compute[73078]:     <apic/>
Aug 14 18:21:04 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:21:04 user nova-compute[73078]:   </features>
Aug 14 18:21:04 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:21:04 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:21:04 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:21:04 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:21:04 user nova-compute[73078]:   </clock>
Aug 14 18:21:04 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:21:04 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:21:04 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:21:04 user nova-compute[73078]:   </cpu>
Aug 14 18:21:04 user nova-compute[73078]:   <devices>
Aug 14 18:21:04 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:21:04 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:21:04 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk"/>
Aug 14 18:21:04 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:21:04 user nova-compute[73078]:     </disk>
Aug 14 18:21:04 user nova-compute[73078]:     <disk type="block" device="disk">
Aug 14 18:21:04 user nova-compute[73078]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:21:04 user nova-compute[73078]:       <source dev="/dev/sdc"/>
Aug 14 18:21:04 user nova-compute[73078]:       <target dev="vdb" bus="virtio"/>
Aug 14 18:21:04 user nova-compute[73078]:       <serial>b45567c2-1040-47dc-bf5e-57d8f2867b61</serial>
Aug 14 18:21:04 user nova-compute[73078]:     </disk>
Aug 14 18:21:04 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:21:04 user nova-compute[73078]:       <mac address="fa:16:3e:4a:28:05"/>
Aug 14 18:21:04 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:21:04 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:21:04 user nova-compute[73078]:       <target dev="tap183ecc4d-20"/>
Aug 14 18:21:04 user nova-compute[73078]:     </interface>
Aug 14 18:21:04 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:21:04 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/console.log" append="off"/>
Aug 14 18:21:04 user nova-compute[73078]:     </serial>
Aug 14 18:21:04 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:21:04 user nova-compute[73078]:     <video>
Aug 14 18:21:04 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:21:04 user nova-compute[73078]:     </video>
Aug 14 18:21:04 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:21:04 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:21:04 user nova-compute[73078]:     </rng>
Aug 14 18:21:04 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:21:04 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:21:04 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:21:04 user nova-compute[73078]:     </memballoon>
Aug 14 18:21:04 user nova-compute[73078]:   </devices>
Aug 14 18:21:04 user nova-compute[73078]: </domain>
Aug 14 18:21:04 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:21:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:21:04 user nova-compute[73078]: DEBUG nova.objects.instance [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lazy-loading 'trusted_certs' on Instance uuid f61b5dc6-4b63-439b-9b3d-62ee0a4056d3 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:21:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a25ee279ecedc5aaaa5279e162d8199454606a0e --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:05 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a25ee279ecedc5aaaa5279e162d8199454606a0e --force-share --output=json" returned: 0 in 0.195s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:05 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:21:05 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:05 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:05 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Cannot resize image /opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:21:05 user nova-compute[73078]: DEBUG nova.objects.instance [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lazy-loading 'migration_context' on Instance uuid f61b5dc6-4b63-439b-9b3d-62ee0a4056d3 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:21:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:18:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1957182722',display_name='tempest-TestMinimumBasicScenario-server-1957182722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1957182722',id=23,image_ref='5e7413b1-16bd-4339-a215-31981164558b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjJC77llA3l7SUHq/hdkyC+9XFeVKxXNkUb+w5/DdLo+f1BeNe0yWHGVzXJxkhWwKbQcpDIu12NoXM5bJGoIURQlOaFuP0tnE3q8Bzd1rGOHAZD4ANRxT9WAGQT7bMi9A==',key_name='tempest-TestMinimumBasicScenario-1154723146',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:18:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='7d6461284f1d491c9cd726d8550a445b',ramdisk_id='',reservation_id='r-dghlbzh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e7413b1-16bd-4339-a215-31981164558b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-703150932',owner_user_name='tempest-TestMinimumBasicScenario-703150932-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:21:02Z,user_data=None,user_id='6ffd9b3d18374103918d71165106f131',uuid=f61b5dc6-4b63-439b-9b3d-62ee0a4056d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "address": "fa:16:3e:4a:28:05", "network": {"id": "4c337404-9329-43e7-bed1-7b5dc32f6cd9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-902748542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6461284f1d491c9cd726d8550a445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183ecc4d-20", "ovs_interfaceid": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:21:05 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Converting VIF {"id": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "address": "fa:16:3e:4a:28:05", "network": {"id": "4c337404-9329-43e7-bed1-7b5dc32f6cd9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-902748542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6461284f1d491c9cd726d8550a445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183ecc4d-20", "ovs_interfaceid": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:21:05 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:28:05,bridge_name='br-int',has_traffic_filtering=True,id=183ecc4d-2001-4254-9f1b-af3a43c362dc,network=Network(4c337404-9329-43e7-bed1-7b5dc32f6cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183ecc4d-20') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:21:05 user nova-compute[73078]: DEBUG os_vif [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:28:05,bridge_name='br-int',has_traffic_filtering=True,id=183ecc4d-2001-4254-9f1b-af3a43c362dc,network=Network(4c337404-9329-43e7-bed1-7b5dc32f6cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183ecc4d-20') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:21:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:21:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:21:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap183ecc4d-20, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:21:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap183ecc4d-20, col_values=(('external_ids', {'iface-id': '183ecc4d-2001-4254-9f1b-af3a43c362dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:28:05', 'vm-uuid': 'f61b5dc6-4b63-439b-9b3d-62ee0a4056d3'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:21:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:21:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:05 user nova-compute[73078]: INFO os_vif [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:28:05,bridge_name='br-int',has_traffic_filtering=True,id=183ecc4d-2001-4254-9f1b-af3a43c362dc,network=Network(4c337404-9329-43e7-bed1-7b5dc32f6cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183ecc4d-20')
Aug 14 18:21:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:05 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Deleted allocations for instance ef110d5f-afb5-415c-9590-29da006734a9
Aug 14 18:21:05 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:21:05 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:21:05 user nova-compute[73078]: DEBUG nova.objects.instance [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lazy-loading 'numa_topology' on Instance uuid ef110d5f-afb5-415c-9590-29da006734a9 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:21:06 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:21:06 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:21:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.314s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:21:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-21175391-18b9-4a36-a6b6-862e978a5fd9 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lock "ef110d5f-afb5-415c-9590-29da006734a9" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 20.164s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:21:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:07 user nova-compute[73078]: DEBUG nova.compute.manager [req-7675e59e-20fd-4f09-ab7e-086861a76300 req-3e7075d7-71c6-493e-86f6-4ee27e8fcb95 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Received event network-vif-plugged-183ecc4d-2001-4254-9f1b-af3a43c362dc {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:21:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-7675e59e-20fd-4f09-ab7e-086861a76300 req-3e7075d7-71c6-493e-86f6-4ee27e8fcb95 service nova] Acquiring lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:21:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-7675e59e-20fd-4f09-ab7e-086861a76300 req-3e7075d7-71c6-493e-86f6-4ee27e8fcb95 service nova] Lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:21:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-7675e59e-20fd-4f09-ab7e-086861a76300 req-3e7075d7-71c6-493e-86f6-4ee27e8fcb95 service nova] Lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:21:07 user nova-compute[73078]: DEBUG nova.compute.manager [req-7675e59e-20fd-4f09-ab7e-086861a76300 req-3e7075d7-71c6-493e-86f6-4ee27e8fcb95 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] No waiting events found dispatching network-vif-plugged-183ecc4d-2001-4254-9f1b-af3a43c362dc {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:21:07 user nova-compute[73078]: WARNING nova.compute.manager [req-7675e59e-20fd-4f09-ab7e-086861a76300 req-3e7075d7-71c6-493e-86f6-4ee27e8fcb95 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Received unexpected event network-vif-plugged-183ecc4d-2001-4254-9f1b-af3a43c362dc for instance with vm_state active and task_state reboot_started_hard.
Aug 14 18:21:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:09 user nova-compute[73078]: DEBUG nova.compute.manager [req-4a0b1751-28f6-47e2-986d-b869c682cec2 req-d059bbdd-a816-48e4-b13b-b89a0a8b90c0 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Received event network-vif-plugged-183ecc4d-2001-4254-9f1b-af3a43c362dc {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:21:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4a0b1751-28f6-47e2-986d-b869c682cec2 req-d059bbdd-a816-48e4-b13b-b89a0a8b90c0 service nova] Acquiring lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:21:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4a0b1751-28f6-47e2-986d-b869c682cec2 req-d059bbdd-a816-48e4-b13b-b89a0a8b90c0 service nova] Lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:21:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4a0b1751-28f6-47e2-986d-b869c682cec2 req-d059bbdd-a816-48e4-b13b-b89a0a8b90c0 service nova] Lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:21:09 user nova-compute[73078]: DEBUG nova.compute.manager [req-4a0b1751-28f6-47e2-986d-b869c682cec2 req-d059bbdd-a816-48e4-b13b-b89a0a8b90c0 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] No waiting events found dispatching network-vif-plugged-183ecc4d-2001-4254-9f1b-af3a43c362dc {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:21:09 user nova-compute[73078]: WARNING nova.compute.manager [req-4a0b1751-28f6-47e2-986d-b869c682cec2 req-d059bbdd-a816-48e4-b13b-b89a0a8b90c0 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Received unexpected event network-vif-plugged-183ecc4d-2001-4254-9f1b-af3a43c362dc for instance with vm_state active and task_state reboot_started_hard.
Aug 14 18:21:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Removed pending event for f61b5dc6-4b63-439b-9b3d-62ee0a4056d3 due to event {{(pid=73078) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 18:21:09 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037269.5158715, f61b5dc6-4b63-439b-9b3d-62ee0a4056d3 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:21:09 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] VM Resumed (Lifecycle Event)
Aug 14 18:21:09 user nova-compute[73078]: DEBUG nova.compute.manager [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:21:09 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:21:09 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Instance rebooted successfully.
Aug 14 18:21:09 user nova-compute[73078]: DEBUG nova.compute.manager [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:21:09 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:21:09 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 14 18:21:09 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037269.528954, f61b5dc6-4b63-439b-9b3d-62ee0a4056d3 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:21:09 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] VM Started (Lifecycle Event)
Aug 14 18:21:09 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:21:09 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:21:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-70d18dfb-97f8-4d5b-b970-1c13fa90a531 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.706s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:21:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "61dfe42b-c943-4617-bf8e-745eaf1a1bb8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:21:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "61dfe42b-c943-4617-bf8e-745eaf1a1bb8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:21:17 user nova-compute[73078]: DEBUG nova.compute.manager [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:21:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:21:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:21:17 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:21:17 user nova-compute[73078]: INFO nova.compute.claims [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Claim successful on node user
Aug 14 18:21:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:18 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:21:18 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:21:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.409s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:21:18 user nova-compute[73078]: DEBUG nova.compute.manager [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:21:18 user nova-compute[73078]: DEBUG nova.compute.manager [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:21:18 user nova-compute[73078]: DEBUG nova.network.neutron [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:21:18 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:21:18 user nova-compute[73078]: DEBUG nova.compute.manager [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:21:18 user nova-compute[73078]: DEBUG nova.policy [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0bff079d90d942bb8ab3ba53fb007125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e938ed650845d0a64b49273c9f6287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:21:18 user nova-compute[73078]: DEBUG nova.compute.manager [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:21:18 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:21:18 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Creating image(s)
Aug 14 18:21:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "/opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:21:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "/opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:21:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "/opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:21:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.206s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:21:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:21:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.175s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk 1073741824" returned: 0 in 0.057s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:21:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:19 user nova-compute[73078]: DEBUG nova.network.neutron [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Successfully created port: d801cd85-be91-4f26-9750-c2ce847cb33c {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:21:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.227s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:19 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Checking if we can resize image /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:21:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:19 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Cannot resize image /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:21:19 user nova-compute[73078]: DEBUG nova.objects.instance [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lazy-loading 'migration_context' on Instance uuid 61dfe42b-c943-4617-bf8e-745eaf1a1bb8 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:21:19 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:21:19 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Ensure instance console log exists: /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:21:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:21:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:21:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:21:20 user nova-compute[73078]: DEBUG nova.network.neutron [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Successfully updated port: d801cd85-be91-4f26-9750-c2ce847cb33c {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:21:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "refresh_cache-61dfe42b-c943-4617-bf8e-745eaf1a1bb8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:21:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquired lock "refresh_cache-61dfe42b-c943-4617-bf8e-745eaf1a1bb8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:21:20 user nova-compute[73078]: DEBUG nova.network.neutron [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:21:20 user nova-compute[73078]: DEBUG nova.compute.manager [req-86446ea1-f3f8-49f7-8e47-15fde2a67c2f req-944bf8b0-1354-4342-aa89-7e7ef0c2936a service nova] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Received event network-changed-d801cd85-be91-4f26-9750-c2ce847cb33c {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:21:20 user nova-compute[73078]: DEBUG nova.compute.manager [req-86446ea1-f3f8-49f7-8e47-15fde2a67c2f req-944bf8b0-1354-4342-aa89-7e7ef0c2936a service nova] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Refreshing instance network info cache due to event network-changed-d801cd85-be91-4f26-9750-c2ce847cb33c. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:21:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-86446ea1-f3f8-49f7-8e47-15fde2a67c2f req-944bf8b0-1354-4342-aa89-7e7ef0c2936a service nova] Acquiring lock "refresh_cache-61dfe42b-c943-4617-bf8e-745eaf1a1bb8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:21:20 user nova-compute[73078]: DEBUG nova.network.neutron [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:21:20 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG nova.network.neutron [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Updating instance_info_cache with network_info: [{"id": "d801cd85-be91-4f26-9750-c2ce847cb33c", "address": "fa:16:3e:87:55:89", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd801cd85-be", "ovs_interfaceid": "d801cd85-be91-4f26-9750-c2ce847cb33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Releasing lock "refresh_cache-61dfe42b-c943-4617-bf8e-745eaf1a1bb8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG nova.compute.manager [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Instance network_info: |[{"id": "d801cd85-be91-4f26-9750-c2ce847cb33c", "address": "fa:16:3e:87:55:89", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd801cd85-be", "ovs_interfaceid": "d801cd85-be91-4f26-9750-c2ce847cb33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-86446ea1-f3f8-49f7-8e47-15fde2a67c2f req-944bf8b0-1354-4342-aa89-7e7ef0c2936a service nova] Acquired lock "refresh_cache-61dfe42b-c943-4617-bf8e-745eaf1a1bb8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG nova.network.neutron [req-86446ea1-f3f8-49f7-8e47-15fde2a67c2f req-944bf8b0-1354-4342-aa89-7e7ef0c2936a service nova] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Refreshing network info cache for port d801cd85-be91-4f26-9750-c2ce847cb33c {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Start _get_guest_xml network_info=[{"id": "d801cd85-be91-4f26-9750-c2ce847cb33c", "address": "fa:16:3e:87:55:89", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd801cd85-be", "ovs_interfaceid": "d801cd85-be91-4f26-9750-c2ce847cb33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:21:21 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:21:21 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:21:21 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:21:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-801712425',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-801712425',id=26,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16e938ed650845d0a64b49273c9f6287',ramdisk_id='',reservation_id='r-jxwkk62y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1267883434',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:21:18Z,user_data=None,user_id='0bff079d90d942bb8ab3ba53fb007125',uuid=61dfe42b-c943-4617-bf8e-745eaf1a1bb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d801cd85-be91-4f26-9750-c2ce847cb33c", "address": "fa:16:3e:87:55:89", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd801cd85-be", "ovs_interfaceid": "d801cd85-be91-4f26-9750-c2ce847cb33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Converting VIF {"id": "d801cd85-be91-4f26-9750-c2ce847cb33c", "address": "fa:16:3e:87:55:89", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd801cd85-be", "ovs_interfaceid": "d801cd85-be91-4f26-9750-c2ce847cb33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:55:89,bridge_name='br-int',has_traffic_filtering=True,id=d801cd85-be91-4f26-9750-c2ce847cb33c,network=Network(98a29135-c5de-46a6-a2bf-46c90b4e255b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd801cd85-be') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG nova.objects.instance [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lazy-loading 'pci_devices' on Instance uuid 61dfe42b-c943-4617-bf8e-745eaf1a1bb8 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:21:21 user nova-compute[73078]:   <uuid>61dfe42b-c943-4617-bf8e-745eaf1a1bb8</uuid>
Aug 14 18:21:21 user nova-compute[73078]:   <name>instance-0000001a</name>
Aug 14 18:21:21 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:21:21 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:21:21 user nova-compute[73078]:   <metadata>
Aug 14 18:21:21 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:21:21 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:21:21 user nova-compute[73078]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-801712425</nova:name>
Aug 14 18:21:21 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:21:21</nova:creationTime>
Aug 14 18:21:21 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:21:21 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:21:21 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:21:21 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:21:21 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:21:21 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:21:21 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:21:21 user nova-compute[73078]:       <nova:owner>
Aug 14 18:21:21 user nova-compute[73078]:         <nova:user uuid="0bff079d90d942bb8ab3ba53fb007125">tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member</nova:user>
Aug 14 18:21:21 user nova-compute[73078]:         <nova:project uuid="16e938ed650845d0a64b49273c9f6287">tempest-ServerBootFromVolumeStableRescueTest-1267883434</nova:project>
Aug 14 18:21:21 user nova-compute[73078]:       </nova:owner>
Aug 14 18:21:21 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:21:21 user nova-compute[73078]:       <nova:ports>
Aug 14 18:21:21 user nova-compute[73078]:         <nova:port uuid="d801cd85-be91-4f26-9750-c2ce847cb33c">
Aug 14 18:21:21 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 18:21:21 user nova-compute[73078]:         </nova:port>
Aug 14 18:21:21 user nova-compute[73078]:       </nova:ports>
Aug 14 18:21:21 user nova-compute[73078]:     </nova:instance>
Aug 14 18:21:21 user nova-compute[73078]:   </metadata>
Aug 14 18:21:21 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:21:21 user nova-compute[73078]:     <system>
Aug 14 18:21:21 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:21:21 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:21:21 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:21:21 user nova-compute[73078]:       <entry name="serial">61dfe42b-c943-4617-bf8e-745eaf1a1bb8</entry>
Aug 14 18:21:21 user nova-compute[73078]:       <entry name="uuid">61dfe42b-c943-4617-bf8e-745eaf1a1bb8</entry>
Aug 14 18:21:21 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:21:21 user nova-compute[73078]:     </system>
Aug 14 18:21:21 user nova-compute[73078]:   </sysinfo>
Aug 14 18:21:21 user nova-compute[73078]:   <os>
Aug 14 18:21:21 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:21:21 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:21:21 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:21:21 user nova-compute[73078]:   </os>
Aug 14 18:21:21 user nova-compute[73078]:   <features>
Aug 14 18:21:21 user nova-compute[73078]:     <acpi/>
Aug 14 18:21:21 user nova-compute[73078]:     <apic/>
Aug 14 18:21:21 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:21:21 user nova-compute[73078]:   </features>
Aug 14 18:21:21 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:21:21 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:21:21 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:21:21 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:21:21 user nova-compute[73078]:   </clock>
Aug 14 18:21:21 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:21:21 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:21:21 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:21:21 user nova-compute[73078]:   </cpu>
Aug 14 18:21:21 user nova-compute[73078]:   <devices>
Aug 14 18:21:21 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:21:21 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:21:21 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk"/>
Aug 14 18:21:21 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:21:21 user nova-compute[73078]:     </disk>
Aug 14 18:21:21 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:21:21 user nova-compute[73078]:       <mac address="fa:16:3e:87:55:89"/>
Aug 14 18:21:21 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:21:21 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:21:21 user nova-compute[73078]:       <target dev="tapd801cd85-be"/>
Aug 14 18:21:21 user nova-compute[73078]:     </interface>
Aug 14 18:21:21 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:21:21 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/console.log" append="off"/>
Aug 14 18:21:21 user nova-compute[73078]:     </serial>
Aug 14 18:21:21 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:21:21 user nova-compute[73078]:     <video>
Aug 14 18:21:21 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:21:21 user nova-compute[73078]:     </video>
Aug 14 18:21:21 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:21:21 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:21:21 user nova-compute[73078]:     </rng>
Aug 14 18:21:21 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:21:21 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:21:21 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:21:21 user nova-compute[73078]:     </memballoon>
Aug 14 18:21:21 user nova-compute[73078]:   </devices>
Aug 14 18:21:21 user nova-compute[73078]: </domain>
Aug 14 18:21:21 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:21:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-801712425',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-801712425',id=26,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16e938ed650845d0a64b49273c9f6287',ramdisk_id='',reservation_id='r-jxwkk62y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1267883434',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:21:18Z,user_data=None,user_id='0bff079d90d942bb8ab3ba53fb007125',uuid=61dfe42b-c943-4617-bf8e-745eaf1a1bb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d801cd85-be91-4f26-9750-c2ce847cb33c", "address": "fa:16:3e:87:55:89", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd801cd85-be", "ovs_interfaceid": "d801cd85-be91-4f26-9750-c2ce847cb33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Converting VIF {"id": "d801cd85-be91-4f26-9750-c2ce847cb33c", "address": "fa:16:3e:87:55:89", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd801cd85-be", "ovs_interfaceid": "d801cd85-be91-4f26-9750-c2ce847cb33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:55:89,bridge_name='br-int',has_traffic_filtering=True,id=d801cd85-be91-4f26-9750-c2ce847cb33c,network=Network(98a29135-c5de-46a6-a2bf-46c90b4e255b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd801cd85-be') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG os_vif [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:55:89,bridge_name='br-int',has_traffic_filtering=True,id=d801cd85-be91-4f26-9750-c2ce847cb33c,network=Network(98a29135-c5de-46a6-a2bf-46c90b4e255b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd801cd85-be') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd801cd85-be, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd801cd85-be, col_values=(('external_ids', {'iface-id': 'd801cd85-be91-4f26-9750-c2ce847cb33c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:55:89', 'vm-uuid': '61dfe42b-c943-4617-bf8e-745eaf1a1bb8'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:21 user nova-compute[73078]: INFO os_vif [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:55:89,bridge_name='br-int',has_traffic_filtering=True,id=d801cd85-be91-4f26-9750-c2ce847cb33c,network=Network(98a29135-c5de-46a6-a2bf-46c90b4e255b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd801cd85-be')
Aug 14 18:21:21 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] No VIF found with MAC fa:16:3e:87:55:89, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG nova.network.neutron [req-86446ea1-f3f8-49f7-8e47-15fde2a67c2f req-944bf8b0-1354-4342-aa89-7e7ef0c2936a service nova] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Updated VIF entry in instance network info cache for port d801cd85-be91-4f26-9750-c2ce847cb33c. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG nova.network.neutron [req-86446ea1-f3f8-49f7-8e47-15fde2a67c2f req-944bf8b0-1354-4342-aa89-7e7ef0c2936a service nova] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Updating instance_info_cache with network_info: [{"id": "d801cd85-be91-4f26-9750-c2ce847cb33c", "address": "fa:16:3e:87:55:89", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd801cd85-be", "ovs_interfaceid": "d801cd85-be91-4f26-9750-c2ce847cb33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-86446ea1-f3f8-49f7-8e47-15fde2a67c2f req-944bf8b0-1354-4342-aa89-7e7ef0c2936a service nova] Releasing lock "refresh_cache-61dfe42b-c943-4617-bf8e-745eaf1a1bb8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG nova.compute.manager [req-aa3883de-2a38-4c8d-8142-6633d73cd8fa req-f57d65bd-0ac4-4a94-979c-b9dceb58d658 service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Received event network-changed-5262c4ac-db58-4c3d-9546-7252ee76c730 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG nova.compute.manager [req-aa3883de-2a38-4c8d-8142-6633d73cd8fa req-f57d65bd-0ac4-4a94-979c-b9dceb58d658 service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Refreshing instance network info cache due to event network-changed-5262c4ac-db58-4c3d-9546-7252ee76c730. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-aa3883de-2a38-4c8d-8142-6633d73cd8fa req-f57d65bd-0ac4-4a94-979c-b9dceb58d658 service nova] Acquiring lock "refresh_cache-a99aa211-c2a1-4240-90cc-2df068d4f669" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-aa3883de-2a38-4c8d-8142-6633d73cd8fa req-f57d65bd-0ac4-4a94-979c-b9dceb58d658 service nova] Acquired lock "refresh_cache-a99aa211-c2a1-4240-90cc-2df068d4f669" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:21:21 user nova-compute[73078]: DEBUG nova.network.neutron [req-aa3883de-2a38-4c8d-8142-6633d73cd8fa req-f57d65bd-0ac4-4a94-979c-b9dceb58d658 service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Refreshing network info cache for port 5262c4ac-db58-4c3d-9546-7252ee76c730 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:21:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "a99aa211-c2a1-4240-90cc-2df068d4f669" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:21:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "a99aa211-c2a1-4240-90cc-2df068d4f669" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:21:22 user nova-compute[73078]: DEBUG nova.objects.instance [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lazy-loading 'flavor' on Instance uuid a99aa211-c2a1-4240-90cc-2df068d4f669 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:21:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "a99aa211-c2a1-4240-90cc-2df068d4f669" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:21:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "a99aa211-c2a1-4240-90cc-2df068d4f669" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:21:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "a99aa211-c2a1-4240-90cc-2df068d4f669" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:21:22 user nova-compute[73078]: INFO nova.compute.manager [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Attaching volume c4d0cf0d-3b33-4385-98cb-7948afab952a to /dev/vdb
Aug 14 18:21:22 user nova-compute[73078]: DEBUG nova.network.neutron [req-aa3883de-2a38-4c8d-8142-6633d73cd8fa req-f57d65bd-0ac4-4a94-979c-b9dceb58d658 service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Updated VIF entry in instance network info cache for port 5262c4ac-db58-4c3d-9546-7252ee76c730. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:21:22 user nova-compute[73078]: DEBUG nova.network.neutron [req-aa3883de-2a38-4c8d-8142-6633d73cd8fa req-f57d65bd-0ac4-4a94-979c-b9dceb58d658 service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Updating instance_info_cache with network_info: [{"id": "5262c4ac-db58-4c3d-9546-7252ee76c730", "address": "fa:16:3e:e4:7f:9e", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5262c4ac-db", "ovs_interfaceid": "5262c4ac-db58-4c3d-9546-7252ee76c730", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:21:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-aa3883de-2a38-4c8d-8142-6633d73cd8fa req-f57d65bd-0ac4-4a94-979c-b9dceb58d658 service nova] Releasing lock "refresh_cache-a99aa211-c2a1-4240-90cc-2df068d4f669" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:21:22 user nova-compute[73078]: DEBUG os_brick.utils [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:21:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[398a161f-5dc2-4836-9c09-58a6c321b61e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:21:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[40881d5f-09ab-42e7-a256-2bb8a6c1da75]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:21:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d866e4-1f64-4087-823e-c81e30b4c8f7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:21:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d78ce1b-fdec-4d23-85e0-8e5270c9c829]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:21:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:21:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:21:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:21:22 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:21:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cabc48-f650-47ad-aa49-04be9c8cb765]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:21:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:21:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:21:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:21:22 user nova-compute[73078]: DEBUG os_brick.utils [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:21:22 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Updating existing volume attachment record: 2abcb24d-dc82-40a3-94f6-caf185fb0846 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:21:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:23 user nova-compute[73078]: DEBUG nova.compute.manager [req-d089c0e7-f300-44c0-b94c-8c4c73dd64d2 req-baf2f5bd-392a-499f-bb29-41203ae23dcf service nova] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Received event network-vif-plugged-d801cd85-be91-4f26-9750-c2ce847cb33c {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:21:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d089c0e7-f300-44c0-b94c-8c4c73dd64d2 req-baf2f5bd-392a-499f-bb29-41203ae23dcf service nova] Acquiring lock "61dfe42b-c943-4617-bf8e-745eaf1a1bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:21:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d089c0e7-f300-44c0-b94c-8c4c73dd64d2 req-baf2f5bd-392a-499f-bb29-41203ae23dcf service nova] Lock "61dfe42b-c943-4617-bf8e-745eaf1a1bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:21:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d089c0e7-f300-44c0-b94c-8c4c73dd64d2 req-baf2f5bd-392a-499f-bb29-41203ae23dcf service nova] Lock "61dfe42b-c943-4617-bf8e-745eaf1a1bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:21:23 user nova-compute[73078]: DEBUG nova.compute.manager [req-d089c0e7-f300-44c0-b94c-8c4c73dd64d2 req-baf2f5bd-392a-499f-bb29-41203ae23dcf service nova] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] No waiting events found dispatching network-vif-plugged-d801cd85-be91-4f26-9750-c2ce847cb33c {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:21:23 user nova-compute[73078]: WARNING nova.compute.manager [req-d089c0e7-f300-44c0-b94c-8c4c73dd64d2 req-baf2f5bd-392a-499f-bb29-41203ae23dcf service nova] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Received unexpected event network-vif-plugged-d801cd85-be91-4f26-9750-c2ce847cb33c for instance with vm_state building and task_state spawning.
Aug 14 18:21:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:25 user nova-compute[73078]: DEBUG nova.compute.manager [req-c8e76051-27a6-44ca-a4ba-e85f9c481926 req-9961767b-8e65-47bf-be32-dd4a93f41c95 service nova] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Received event network-vif-plugged-d801cd85-be91-4f26-9750-c2ce847cb33c {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:21:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-c8e76051-27a6-44ca-a4ba-e85f9c481926 req-9961767b-8e65-47bf-be32-dd4a93f41c95 service nova] Acquiring lock "61dfe42b-c943-4617-bf8e-745eaf1a1bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:21:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-c8e76051-27a6-44ca-a4ba-e85f9c481926 req-9961767b-8e65-47bf-be32-dd4a93f41c95 service nova] Lock "61dfe42b-c943-4617-bf8e-745eaf1a1bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:21:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-c8e76051-27a6-44ca-a4ba-e85f9c481926 req-9961767b-8e65-47bf-be32-dd4a93f41c95 service nova] Lock "61dfe42b-c943-4617-bf8e-745eaf1a1bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:21:25 user nova-compute[73078]: DEBUG nova.compute.manager [req-c8e76051-27a6-44ca-a4ba-e85f9c481926 req-9961767b-8e65-47bf-be32-dd4a93f41c95 service nova] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] No waiting events found dispatching network-vif-plugged-d801cd85-be91-4f26-9750-c2ce847cb33c {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:21:25 user nova-compute[73078]: WARNING nova.compute.manager [req-c8e76051-27a6-44ca-a4ba-e85f9c481926 req-9961767b-8e65-47bf-be32-dd4a93f41c95 service nova] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Received unexpected event network-vif-plugged-d801cd85-be91-4f26-9750-c2ce847cb33c for instance with vm_state building and task_state spawning.
Aug 14 18:21:25 user nova-compute[73078]: DEBUG nova.compute.manager [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:21:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:21:25 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037285.6460183, 61dfe42b-c943-4617-bf8e-745eaf1a1bb8 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:21:25 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] VM Resumed (Lifecycle Event)
Aug 14 18:21:25 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Instance spawned successfully.
Aug 14 18:21:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:21:25 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:21:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:21:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:21:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:21:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:21:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:21:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:21:25 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:21:25 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:21:25 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037285.647714, 61dfe42b-c943-4617-bf8e-745eaf1a1bb8 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:21:25 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] VM Started (Lifecycle Event)
Aug 14 18:21:25 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:21:25 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:21:25 user nova-compute[73078]: INFO nova.compute.manager [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Took 7.28 seconds to spawn the instance on the hypervisor.
Aug 14 18:21:25 user nova-compute[73078]: DEBUG nova.compute.manager [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:21:25 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:21:25 user nova-compute[73078]: INFO nova.compute.manager [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Took 8.12 seconds to build instance.
Aug 14 18:21:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f545b110-c91d-47d4-84fe-6fc7577dc802 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "61dfe42b-c943-4617-bf8e-745eaf1a1bb8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.258s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:21:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:32 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:21:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wnZJjTPG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:21:32 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:21:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:21:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:21:32 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:21:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:21:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:21:32 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:21:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:32 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f1d082-d00d-4755-8971-37eb78a1d1b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:21:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:21:32 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:21:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:32 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[be902b18-c4f6-4741-8cee-976317619a43]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:21:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a] added
Aug 14 18:21:32 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:21:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:32 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d602599-0f5f-4b6c-8057-3dbd4f0d50cb]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:21:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:21:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:32 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b38d6ea-cfd8-44b3-a44c-a79349344c1b]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:21:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:21:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wnZJjTPG {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wnZJjTPG" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:32 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f820a8-d730-482c-b140-77180e5f0918]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:21:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wnZJjTPG'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:21:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:32 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be43f5c-ac14-4855-87a2-b1410adb6037]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:21:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:21:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:33 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edd87b3-053e-4ee6-82aa-960d8574d18f]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:21:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 (non-flash)
Aug 14 18:21:33 user nova-compute[73078]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 (non-flash)
Aug 14 18:21:33 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:21:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 (non-flash)
Aug 14 18:21:33 user nova-compute[73078]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 (non-flash)
Aug 14 18:21:33 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:21:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:33 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9d1755-0f7f-4297-8b51-b842500fa708]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:21:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a, portal: 172.16.0.220,3260]
Aug 14 18:21:33 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a, portal: 172.16.0.220,3260] successful.
Aug 14 18:21:33 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:21:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:33 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[256aa0e5-8689-4ae5-af2f-bcdf07211260]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:21:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:21:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:33 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d08b4e2-2a35-4784-8818-daf6f249fd65]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:21:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 (non-flash)
Aug 14 18:21:33 user nova-compute[73078]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 (non-flash)
Aug 14 18:21:33 user nova-compute[73078]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:21:33 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:21:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 (non-flash)
Aug 14 18:21:33 user nova-compute[73078]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 (non-flash)
Aug 14 18:21:33 user nova-compute[73078]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:21:33 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:21:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:21:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:21:33 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:21:33 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:21:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:33 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e18d0ba-992d-498b-9737-91684f40657a]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:21:33 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:21:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wnZJjTPG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:21:34 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:21:34 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23231393633383332', 'path': '/dev/sdd'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:21:34 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231393633383332', 'path': '/dev/sdd'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:21:34 user nova-compute[73078]: DEBUG nova.objects.instance [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lazy-loading 'flavor' on Instance uuid a99aa211-c2a1-4240-90cc-2df068d4f669 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:21:34 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 18:21:34 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:21:34 user nova-compute[73078]:   <source dev="/dev/sdd"/>
Aug 14 18:21:34 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:21:34 user nova-compute[73078]:   <serial>c4d0cf0d-3b33-4385-98cb-7948afab952a</serial>
Aug 14 18:21:34 user nova-compute[73078]: </disk>
Aug 14 18:21:34 user nova-compute[73078]:  {{(pid=73078) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 18:21:34 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:21:34 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:21:34 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] No VIF found with MAC fa:16:3e:e4:7f:9e, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:21:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-72b494dc-b197-43a8-9657-1abb123620c9 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "a99aa211-c2a1-4240-90cc-2df068d4f669" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.773s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:21:35 user nova-compute[73078]: INFO nova.compute.manager [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Rescuing
Aug 14 18:21:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "refresh_cache-a99aa211-c2a1-4240-90cc-2df068d4f669" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:21:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquired lock "refresh_cache-a99aa211-c2a1-4240-90cc-2df068d4f669" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:21:35 user nova-compute[73078]: DEBUG nova.network.neutron [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:21:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:36 user nova-compute[73078]: DEBUG nova.network.neutron [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Updating instance_info_cache with network_info: [{"id": "5262c4ac-db58-4c3d-9546-7252ee76c730", "address": "fa:16:3e:e4:7f:9e", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5262c4ac-db", "ovs_interfaceid": "5262c4ac-db58-4c3d-9546-7252ee76c730", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:21:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Releasing lock "refresh_cache-a99aa211-c2a1-4240-90cc-2df068d4f669" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:21:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:37 user nova-compute[73078]: DEBUG nova.compute.manager [req-5eda29a4-d717-4db5-b88e-42a62d80368b req-18757dd1-8840-4472-94b9-38cea1640954 service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Received event network-vif-unplugged-5262c4ac-db58-4c3d-9546-7252ee76c730 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:21:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5eda29a4-d717-4db5-b88e-42a62d80368b req-18757dd1-8840-4472-94b9-38cea1640954 service nova] Acquiring lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:21:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5eda29a4-d717-4db5-b88e-42a62d80368b req-18757dd1-8840-4472-94b9-38cea1640954 service nova] Lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:21:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5eda29a4-d717-4db5-b88e-42a62d80368b req-18757dd1-8840-4472-94b9-38cea1640954 service nova] Lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:21:37 user nova-compute[73078]: DEBUG nova.compute.manager [req-5eda29a4-d717-4db5-b88e-42a62d80368b req-18757dd1-8840-4472-94b9-38cea1640954 service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] No waiting events found dispatching network-vif-unplugged-5262c4ac-db58-4c3d-9546-7252ee76c730 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:21:37 user nova-compute[73078]: WARNING nova.compute.manager [req-5eda29a4-d717-4db5-b88e-42a62d80368b req-18757dd1-8840-4472-94b9-38cea1640954 service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Received unexpected event network-vif-unplugged-5262c4ac-db58-4c3d-9546-7252ee76c730 for instance with vm_state active and task_state rescuing.
Aug 14 18:21:37 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Instance destroyed successfully.
Aug 14 18:21:37 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Attempting rescue
Aug 14 18:21:37 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73078) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 18:21:37 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Instance directory exists: not creating {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 18:21:37 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Creating image(s)
Aug 14 18:21:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "/opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:21:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "/opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:21:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "/opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:21:37 user nova-compute[73078]: DEBUG nova.objects.instance [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lazy-loading 'trusted_certs' on Instance uuid a99aa211-c2a1-4240-90cc-2df068d4f669 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:21:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:21:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:21:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.198s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk.rescue {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk.rescue" returned: 0 in 0.053s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:21:38 user nova-compute[73078]: DEBUG nova.objects.instance [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lazy-loading 'migration_context' on Instance uuid a99aa211-c2a1-4240-90cc-2df068d4f669 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:21:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:21:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Start _get_guest_xml network_info=[{"id": "5262c4ac-db58-4c3d-9546-7252ee76c730", "address": "fa:16:3e:e4:7f:9e", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "vif_mac": "fa:16:3e:e4:7f:9e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5262c4ac-db", "ovs_interfaceid": "5262c4ac-db58-4c3d-9546-7252ee76c730", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:21:38 user nova-compute[73078]: DEBUG nova.objects.instance [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lazy-loading 'resources' on Instance uuid a99aa211-c2a1-4240-90cc-2df068d4f669 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:21:38 user nova-compute[73078]: DEBUG nova.objects.instance [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lazy-loading 'numa_topology' on Instance uuid a99aa211-c2a1-4240-90cc-2df068d4f669 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:21:38 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:21:38 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:21:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:21:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:21:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:21:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:21:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:21:38 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:21:38 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:21:38 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:21:38 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:21:38 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:21:38 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:21:38 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:21:38 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:21:38 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:21:38 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:21:38 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:21:38 user nova-compute[73078]: DEBUG nova.objects.instance [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lazy-loading 'vcpu_model' on Instance uuid a99aa211-c2a1-4240-90cc-2df068d4f669 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:21:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:19:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-391026567',display_name='tempest-ServerRescueNegativeTestJSON-server-391026567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-391026567',id=25,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWtpI0Guw6dmfBFh+LNsyjK/cmY45/WcllmcWyUt0PCxUIaiQz+xX3JbwPmvtFUfJzH0RmBBZEoBqMCiWdkUa7DqGP74ubN/fbpvYzVQHcC/SGLQJev3eWyf6MGKwsstA==',key_name='tempest-keypair-1566952768',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:19:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ec53c6018ee44b09ee31ba712a789aa',ramdisk_id='',reservation_id='r-2hs1fgeo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-38557121',owner_user_name='tempest-ServerRescueNegativeTestJSON-38557121-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:19:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d25ecea70e9e481e8a1957a94d79edfc',uuid=a99aa211-c2a1-4240-90cc-2df068d4f669,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5262c4ac-db58-4c3d-9546-7252ee76c730", "address": "fa:16:3e:e4:7f:9e", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "vif_mac": "fa:16:3e:e4:7f:9e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5262c4ac-db", "ovs_interfaceid": "5262c4ac-db58-4c3d-9546-7252ee76c730", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:21:38 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Converting VIF {"id": "5262c4ac-db58-4c3d-9546-7252ee76c730", "address": "fa:16:3e:e4:7f:9e", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "vif_mac": "fa:16:3e:e4:7f:9e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5262c4ac-db", "ovs_interfaceid": "5262c4ac-db58-4c3d-9546-7252ee76c730", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:21:38 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:7f:9e,bridge_name='br-int',has_traffic_filtering=True,id=5262c4ac-db58-4c3d-9546-7252ee76c730,network=Network(33518dc6-7963-4995-b4c7-86d60b44a22f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5262c4ac-db') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:21:38 user nova-compute[73078]: DEBUG nova.objects.instance [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lazy-loading 'pci_devices' on Instance uuid a99aa211-c2a1-4240-90cc-2df068d4f669 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:21:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:21:38 user nova-compute[73078]:   <uuid>a99aa211-c2a1-4240-90cc-2df068d4f669</uuid>
Aug 14 18:21:38 user nova-compute[73078]:   <name>instance-00000019</name>
Aug 14 18:21:38 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:21:38 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:21:38 user nova-compute[73078]:   <metadata>
Aug 14 18:21:38 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:21:38 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:21:38 user nova-compute[73078]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-391026567</nova:name>
Aug 14 18:21:38 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:21:38</nova:creationTime>
Aug 14 18:21:38 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:21:38 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:21:38 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:21:38 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:21:38 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:21:38 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:21:38 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:21:38 user nova-compute[73078]:       <nova:owner>
Aug 14 18:21:38 user nova-compute[73078]:         <nova:user uuid="d25ecea70e9e481e8a1957a94d79edfc">tempest-ServerRescueNegativeTestJSON-38557121-project-member</nova:user>
Aug 14 18:21:38 user nova-compute[73078]:         <nova:project uuid="4ec53c6018ee44b09ee31ba712a789aa">tempest-ServerRescueNegativeTestJSON-38557121</nova:project>
Aug 14 18:21:38 user nova-compute[73078]:       </nova:owner>
Aug 14 18:21:38 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:21:38 user nova-compute[73078]:       <nova:ports>
Aug 14 18:21:38 user nova-compute[73078]:         <nova:port uuid="5262c4ac-db58-4c3d-9546-7252ee76c730">
Aug 14 18:21:38 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 18:21:38 user nova-compute[73078]:         </nova:port>
Aug 14 18:21:38 user nova-compute[73078]:       </nova:ports>
Aug 14 18:21:38 user nova-compute[73078]:     </nova:instance>
Aug 14 18:21:38 user nova-compute[73078]:   </metadata>
Aug 14 18:21:38 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:21:38 user nova-compute[73078]:     <system>
Aug 14 18:21:38 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:21:38 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:21:38 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:21:38 user nova-compute[73078]:       <entry name="serial">a99aa211-c2a1-4240-90cc-2df068d4f669</entry>
Aug 14 18:21:38 user nova-compute[73078]:       <entry name="uuid">a99aa211-c2a1-4240-90cc-2df068d4f669</entry>
Aug 14 18:21:38 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:21:38 user nova-compute[73078]:     </system>
Aug 14 18:21:38 user nova-compute[73078]:   </sysinfo>
Aug 14 18:21:38 user nova-compute[73078]:   <os>
Aug 14 18:21:38 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:21:38 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:21:38 user nova-compute[73078]:   </os>
Aug 14 18:21:38 user nova-compute[73078]:   <features>
Aug 14 18:21:38 user nova-compute[73078]:     <acpi/>
Aug 14 18:21:38 user nova-compute[73078]:     <apic/>
Aug 14 18:21:38 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:21:38 user nova-compute[73078]:   </features>
Aug 14 18:21:38 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:21:38 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:21:38 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:21:38 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:21:38 user nova-compute[73078]:   </clock>
Aug 14 18:21:38 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:21:38 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:21:38 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:21:38 user nova-compute[73078]:   </cpu>
Aug 14 18:21:38 user nova-compute[73078]:   <devices>
Aug 14 18:21:38 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:21:38 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:21:38 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk.rescue"/>
Aug 14 18:21:38 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:21:38 user nova-compute[73078]:     </disk>
Aug 14 18:21:38 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:21:38 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:21:38 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk"/>
Aug 14 18:21:38 user nova-compute[73078]:       <target dev="vdb" bus="virtio"/>
Aug 14 18:21:38 user nova-compute[73078]:     </disk>
Aug 14 18:21:38 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:21:38 user nova-compute[73078]:       <mac address="fa:16:3e:e4:7f:9e"/>
Aug 14 18:21:38 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:21:38 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:21:38 user nova-compute[73078]:       <target dev="tap5262c4ac-db"/>
Aug 14 18:21:38 user nova-compute[73078]:     </interface>
Aug 14 18:21:38 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:21:38 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/console.log" append="off"/>
Aug 14 18:21:38 user nova-compute[73078]:     </serial>
Aug 14 18:21:38 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:21:38 user nova-compute[73078]:     <video>
Aug 14 18:21:38 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:21:38 user nova-compute[73078]:     </video>
Aug 14 18:21:38 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:21:38 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:21:38 user nova-compute[73078]:     </rng>
Aug 14 18:21:38 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:21:38 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:21:38 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:21:38 user nova-compute[73078]:     </memballoon>
Aug 14 18:21:38 user nova-compute[73078]:   </devices>
Aug 14 18:21:38 user nova-compute[73078]: </domain>
Aug 14 18:21:38 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:21:38 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Instance destroyed successfully.
Aug 14 18:21:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:21:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:21:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] No VIF found with MAC fa:16:3e:e4:7f:9e, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:21:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:39 user nova-compute[73078]: DEBUG nova.compute.manager [req-0d2889b0-e8f2-4010-84f0-fdb59e9f35b0 req-c95d917b-aefb-453b-9eaa-7ef2f8c2a963 service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Received event network-vif-plugged-5262c4ac-db58-4c3d-9546-7252ee76c730 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:21:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0d2889b0-e8f2-4010-84f0-fdb59e9f35b0 req-c95d917b-aefb-453b-9eaa-7ef2f8c2a963 service nova] Acquiring lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:21:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0d2889b0-e8f2-4010-84f0-fdb59e9f35b0 req-c95d917b-aefb-453b-9eaa-7ef2f8c2a963 service nova] Lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:21:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0d2889b0-e8f2-4010-84f0-fdb59e9f35b0 req-c95d917b-aefb-453b-9eaa-7ef2f8c2a963 service nova] Lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:21:39 user nova-compute[73078]: DEBUG nova.compute.manager [req-0d2889b0-e8f2-4010-84f0-fdb59e9f35b0 req-c95d917b-aefb-453b-9eaa-7ef2f8c2a963 service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] No waiting events found dispatching network-vif-plugged-5262c4ac-db58-4c3d-9546-7252ee76c730 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:21:39 user nova-compute[73078]: WARNING nova.compute.manager [req-0d2889b0-e8f2-4010-84f0-fdb59e9f35b0 req-c95d917b-aefb-453b-9eaa-7ef2f8c2a963 service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Received unexpected event network-vif-plugged-5262c4ac-db58-4c3d-9546-7252ee76c730 for instance with vm_state active and task_state rescuing.
Aug 14 18:21:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:40 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:41 user nova-compute[73078]: DEBUG nova.compute.manager [req-c6d3f08e-1f22-4684-a388-bab243989145 req-56353a45-24df-430e-a7db-213b5684aa2e service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Received event network-vif-plugged-5262c4ac-db58-4c3d-9546-7252ee76c730 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:21:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-c6d3f08e-1f22-4684-a388-bab243989145 req-56353a45-24df-430e-a7db-213b5684aa2e service nova] Acquiring lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:21:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-c6d3f08e-1f22-4684-a388-bab243989145 req-56353a45-24df-430e-a7db-213b5684aa2e service nova] Lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:21:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-c6d3f08e-1f22-4684-a388-bab243989145 req-56353a45-24df-430e-a7db-213b5684aa2e service nova] Lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:21:41 user nova-compute[73078]: DEBUG nova.compute.manager [req-c6d3f08e-1f22-4684-a388-bab243989145 req-56353a45-24df-430e-a7db-213b5684aa2e service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] No waiting events found dispatching network-vif-plugged-5262c4ac-db58-4c3d-9546-7252ee76c730 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:21:41 user nova-compute[73078]: WARNING nova.compute.manager [req-c6d3f08e-1f22-4684-a388-bab243989145 req-56353a45-24df-430e-a7db-213b5684aa2e service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Received unexpected event network-vif-plugged-5262c4ac-db58-4c3d-9546-7252ee76c730 for instance with vm_state active and task_state rescuing.
Aug 14 18:21:41 user nova-compute[73078]: DEBUG nova.compute.manager [req-c6d3f08e-1f22-4684-a388-bab243989145 req-56353a45-24df-430e-a7db-213b5684aa2e service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Received event network-vif-plugged-5262c4ac-db58-4c3d-9546-7252ee76c730 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:21:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-c6d3f08e-1f22-4684-a388-bab243989145 req-56353a45-24df-430e-a7db-213b5684aa2e service nova] Acquiring lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:21:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-c6d3f08e-1f22-4684-a388-bab243989145 req-56353a45-24df-430e-a7db-213b5684aa2e service nova] Lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:21:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-c6d3f08e-1f22-4684-a388-bab243989145 req-56353a45-24df-430e-a7db-213b5684aa2e service nova] Lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:21:41 user nova-compute[73078]: DEBUG nova.compute.manager [req-c6d3f08e-1f22-4684-a388-bab243989145 req-56353a45-24df-430e-a7db-213b5684aa2e service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] No waiting events found dispatching network-vif-plugged-5262c4ac-db58-4c3d-9546-7252ee76c730 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:21:41 user nova-compute[73078]: WARNING nova.compute.manager [req-c6d3f08e-1f22-4684-a388-bab243989145 req-56353a45-24df-430e-a7db-213b5684aa2e service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Received unexpected event network-vif-plugged-5262c4ac-db58-4c3d-9546-7252ee76c730 for instance with vm_state active and task_state rescuing.
Aug 14 18:21:42 user nova-compute[73078]: DEBUG nova.compute.manager [None req-f700fb1d-c706-465b-ac7f-590606f772d2 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:21:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Removed pending event for a99aa211-c2a1-4240-90cc-2df068d4f669 due to event {{(pid=73078) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 18:21:42 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037302.0594497, a99aa211-c2a1-4240-90cc-2df068d4f669 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:21:42 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] VM Resumed (Lifecycle Event)
Aug 14 18:21:42 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:21:42 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:21:42 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037302.0603366, a99aa211-c2a1-4240-90cc-2df068d4f669 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:21:42 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] VM Started (Lifecycle Event)
Aug 14 18:21:42 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:21:42 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:21:43 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:43 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:47 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:21:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:49 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:21:50 user nova-compute[73078]: INFO nova.compute.manager [None req-7baf9741-b46a-4364-8454-5aa6978919e0 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Unrescuing
Aug 14 18:21:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-7baf9741-b46a-4364-8454-5aa6978919e0 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Acquiring lock "refresh_cache-ea445c0c-e5a1-4e24-8008-2cd64a679f34" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:21:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-7baf9741-b46a-4364-8454-5aa6978919e0 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Acquired lock "refresh_cache-ea445c0c-e5a1-4e24-8008-2cd64a679f34" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:21:50 user nova-compute[73078]: DEBUG nova.network.neutron [None req-7baf9741-b46a-4364-8454-5aa6978919e0 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:21:50 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:21:50 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:21:50 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:21:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:21:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:21:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:21:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:21:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:51 user nova-compute[73078]: DEBUG nova.network.neutron [None req-7baf9741-b46a-4364-8454-5aa6978919e0 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Updating instance_info_cache with network_info: [{"id": "3a008b18-c1c3-4656-9ada-f437888cdee6", "address": "fa:16:3e:a3:fb:e1", "network": {"id": "45b49a52-f99e-437a-aa8d-440f4f6b1099", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1520302261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9a739612a674c5c82fad631a64c57ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a008b18-c1", "ovs_interfaceid": "3a008b18-c1c3-4656-9ada-f437888cdee6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:21:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-7baf9741-b46a-4364-8454-5aa6978919e0 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Releasing lock "refresh_cache-ea445c0c-e5a1-4e24-8008-2cd64a679f34" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:21:51 user nova-compute[73078]: DEBUG nova.objects.instance [None req-7baf9741-b46a-4364-8454-5aa6978919e0 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lazy-loading 'flavor' on Instance uuid ea445c0c-e5a1-4e24-8008-2cd64a679f34 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:21:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk.rescue --force-share --output=json" returned: 0 in 0.259s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk.rescue --force-share --output=json" returned: 0 in 0.248s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk (vdb) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:21:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:52 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Instance destroyed successfully.
Aug 14 18:21:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:52 user nova-compute[73078]: DEBUG nova.compute.manager [req-dcc54160-39dc-4285-b626-f4eb52bd83c8 req-d1dc84ce-2cb7-4f98-8312-1b413e9a0475 service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Received event network-vif-unplugged-3a008b18-c1c3-4656-9ada-f437888cdee6 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:21:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-dcc54160-39dc-4285-b626-f4eb52bd83c8 req-d1dc84ce-2cb7-4f98-8312-1b413e9a0475 service nova] Acquiring lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:21:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-dcc54160-39dc-4285-b626-f4eb52bd83c8 req-d1dc84ce-2cb7-4f98-8312-1b413e9a0475 service nova] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:21:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-dcc54160-39dc-4285-b626-f4eb52bd83c8 req-d1dc84ce-2cb7-4f98-8312-1b413e9a0475 service nova] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:21:52 user nova-compute[73078]: DEBUG nova.compute.manager [req-dcc54160-39dc-4285-b626-f4eb52bd83c8 req-d1dc84ce-2cb7-4f98-8312-1b413e9a0475 service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] No waiting events found dispatching network-vif-unplugged-3a008b18-c1c3-4656-9ada-f437888cdee6 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:21:52 user nova-compute[73078]: WARNING nova.compute.manager [req-dcc54160-39dc-4285-b626-f4eb52bd83c8 req-d1dc84ce-2cb7-4f98-8312-1b413e9a0475 service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Received unexpected event network-vif-unplugged-3a008b18-c1c3-4656-9ada-f437888cdee6 for instance with vm_state rescued and task_state unrescuing.
Aug 14 18:21:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:21:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json" returned: 0 in 0.238s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:21:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:21:54 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:21:54 user nova-compute[73078]: DEBUG nova.compute.manager [req-1ef1f0d4-8e1b-4ef4-973d-f13296eb5b01 req-8ca148c0-d429-480b-ae31-f9529357a54b service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Received event network-changed-3a008b18-c1c3-4656-9ada-f437888cdee6 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:21:54 user nova-compute[73078]: DEBUG nova.compute.manager [req-1ef1f0d4-8e1b-4ef4-973d-f13296eb5b01 req-8ca148c0-d429-480b-ae31-f9529357a54b service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Refreshing instance network info cache due to event network-changed-3a008b18-c1c3-4656-9ada-f437888cdee6. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:21:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1ef1f0d4-8e1b-4ef4-973d-f13296eb5b01 req-8ca148c0-d429-480b-ae31-f9529357a54b service nova] Acquiring lock "refresh_cache-ea445c0c-e5a1-4e24-8008-2cd64a679f34" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:21:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1ef1f0d4-8e1b-4ef4-973d-f13296eb5b01 req-8ca148c0-d429-480b-ae31-f9529357a54b service nova] Acquired lock "refresh_cache-ea445c0c-e5a1-4e24-8008-2cd64a679f34" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:21:54 user nova-compute[73078]: DEBUG nova.network.neutron [req-1ef1f0d4-8e1b-4ef4-973d-f13296eb5b01 req-8ca148c0-d429-480b-ae31-f9529357a54b service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Refreshing network info cache for port 3a008b18-c1c3-4656-9ada-f437888cdee6 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:21:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:57 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:57 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Removed pending event for ea445c0c-e5a1-4e24-8008-2cd64a679f34 due to event {{(pid=73078) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 18:21:57 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037316.8457015, ea445c0c-e5a1-4e24-8008-2cd64a679f34 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:21:57 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] VM Resumed (Lifecycle Event)
Aug 14 18:21:57 user nova-compute[73078]: DEBUG nova.compute.manager [None req-7baf9741-b46a-4364-8454-5aa6978919e0 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:21:57 user nova-compute[73078]: DEBUG nova.compute.manager [req-262f260b-e581-437a-9efa-6ccaabd05af1 req-8d71b60f-f608-4616-a454-49d510f09444 service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Received event network-vif-plugged-3a008b18-c1c3-4656-9ada-f437888cdee6 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:21:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-262f260b-e581-437a-9efa-6ccaabd05af1 req-8d71b60f-f608-4616-a454-49d510f09444 service nova] Acquiring lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:21:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-262f260b-e581-437a-9efa-6ccaabd05af1 req-8d71b60f-f608-4616-a454-49d510f09444 service nova] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:21:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-262f260b-e581-437a-9efa-6ccaabd05af1 req-8d71b60f-f608-4616-a454-49d510f09444 service nova] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:21:57 user nova-compute[73078]: DEBUG nova.compute.manager [req-262f260b-e581-437a-9efa-6ccaabd05af1 req-8d71b60f-f608-4616-a454-49d510f09444 service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] No waiting events found dispatching network-vif-plugged-3a008b18-c1c3-4656-9ada-f437888cdee6 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:21:57 user nova-compute[73078]: WARNING nova.compute.manager [req-262f260b-e581-437a-9efa-6ccaabd05af1 req-8d71b60f-f608-4616-a454-49d510f09444 service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Received unexpected event network-vif-plugged-3a008b18-c1c3-4656-9ada-f437888cdee6 for instance with vm_state rescued and task_state unrescuing.
Aug 14 18:21:57 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:21:57 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:21:57 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:21:57 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=7489MB free_disk=25.144031524658203GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:21:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:21:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:21:57 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:21:57 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:21:57 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 18:21:57 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037316.8467855, ea445c0c-e5a1-4e24-8008-2cd64a679f34 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:21:57 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] VM Started (Lifecycle Event)
Aug 14 18:21:57 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:21:57 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:21:57 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance de80e188-9385-4613-8a6c-aa72b624ad55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:21:57 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 1f88cb97-4f22-439e-99f2-d7cb8d5aff36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:21:57 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 3c840309-9884-4c8a-a6ee-1acd44f32c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:21:57 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance ea445c0c-e5a1-4e24-8008-2cd64a679f34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:21:57 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance f61b5dc6-4b63-439b-9b3d-62ee0a4056d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:21:57 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance a99aa211-c2a1-4240-90cc-2df068d4f669 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:21:57 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 61dfe42b-c943-4617-bf8e-745eaf1a1bb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:21:57 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:21:57 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:21:57 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Refreshing inventories for resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 18:21:57 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Updating ProviderTree inventory for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 18:21:57 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Updating inventory in ProviderTree for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 18:21:58 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Refreshing aggregate associations for resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b, aggregates: None {{(pid=73078) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 18:21:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:58 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Refreshing trait associations for resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV {{(pid=73078) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 18:21:58 user nova-compute[73078]: DEBUG nova.network.neutron [req-1ef1f0d4-8e1b-4ef4-973d-f13296eb5b01 req-8ca148c0-d429-480b-ae31-f9529357a54b service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Updated VIF entry in instance network info cache for port 3a008b18-c1c3-4656-9ada-f437888cdee6. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:21:58 user nova-compute[73078]: DEBUG nova.network.neutron [req-1ef1f0d4-8e1b-4ef4-973d-f13296eb5b01 req-8ca148c0-d429-480b-ae31-f9529357a54b service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Updating instance_info_cache with network_info: [{"id": "3a008b18-c1c3-4656-9ada-f437888cdee6", "address": "fa:16:3e:a3:fb:e1", "network": {"id": "45b49a52-f99e-437a-aa8d-440f4f6b1099", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1520302261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9a739612a674c5c82fad631a64c57ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a008b18-c1", "ovs_interfaceid": "3a008b18-c1c3-4656-9ada-f437888cdee6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:21:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1ef1f0d4-8e1b-4ef4-973d-f13296eb5b01 req-8ca148c0-d429-480b-ae31-f9529357a54b service nova] Releasing lock "refresh_cache-ea445c0c-e5a1-4e24-8008-2cd64a679f34" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:21:58 user nova-compute[73078]: DEBUG nova.compute.manager [req-1ef1f0d4-8e1b-4ef4-973d-f13296eb5b01 req-8ca148c0-d429-480b-ae31-f9529357a54b service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Received event network-changed-3a008b18-c1c3-4656-9ada-f437888cdee6 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:21:58 user nova-compute[73078]: DEBUG nova.compute.manager [req-1ef1f0d4-8e1b-4ef4-973d-f13296eb5b01 req-8ca148c0-d429-480b-ae31-f9529357a54b service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Refreshing instance network info cache due to event network-changed-3a008b18-c1c3-4656-9ada-f437888cdee6. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:21:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1ef1f0d4-8e1b-4ef4-973d-f13296eb5b01 req-8ca148c0-d429-480b-ae31-f9529357a54b service nova] Acquiring lock "refresh_cache-ea445c0c-e5a1-4e24-8008-2cd64a679f34" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:21:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1ef1f0d4-8e1b-4ef4-973d-f13296eb5b01 req-8ca148c0-d429-480b-ae31-f9529357a54b service nova] Acquired lock "refresh_cache-ea445c0c-e5a1-4e24-8008-2cd64a679f34" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:21:58 user nova-compute[73078]: DEBUG nova.network.neutron [req-1ef1f0d4-8e1b-4ef4-973d-f13296eb5b01 req-8ca148c0-d429-480b-ae31-f9529357a54b service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Refreshing network info cache for port 3a008b18-c1c3-4656-9ada-f437888cdee6 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:21:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:21:58 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:21:58 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:21:58 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:21:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.988s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:21:58 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:21:58 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Cleaning up deleted instances {{(pid=73078) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 18:21:58 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] There are 0 instances to clean {{(pid=73078) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 18:21:58 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:21:58 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73078) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 18:21:58 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:21:59 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:21:59 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:21:59 user nova-compute[73078]: DEBUG nova.network.neutron [req-1ef1f0d4-8e1b-4ef4-973d-f13296eb5b01 req-8ca148c0-d429-480b-ae31-f9529357a54b service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Updated VIF entry in instance network info cache for port 3a008b18-c1c3-4656-9ada-f437888cdee6. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:21:59 user nova-compute[73078]: DEBUG nova.network.neutron [req-1ef1f0d4-8e1b-4ef4-973d-f13296eb5b01 req-8ca148c0-d429-480b-ae31-f9529357a54b service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Updating instance_info_cache with network_info: [{"id": "3a008b18-c1c3-4656-9ada-f437888cdee6", "address": "fa:16:3e:a3:fb:e1", "network": {"id": "45b49a52-f99e-437a-aa8d-440f4f6b1099", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1520302261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9a739612a674c5c82fad631a64c57ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a008b18-c1", "ovs_interfaceid": "3a008b18-c1c3-4656-9ada-f437888cdee6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:21:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1ef1f0d4-8e1b-4ef4-973d-f13296eb5b01 req-8ca148c0-d429-480b-ae31-f9529357a54b service nova] Releasing lock "refresh_cache-ea445c0c-e5a1-4e24-8008-2cd64a679f34" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:21:59 user nova-compute[73078]: DEBUG nova.compute.manager [req-1ef1f0d4-8e1b-4ef4-973d-f13296eb5b01 req-8ca148c0-d429-480b-ae31-f9529357a54b service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Received event network-vif-plugged-3a008b18-c1c3-4656-9ada-f437888cdee6 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:21:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1ef1f0d4-8e1b-4ef4-973d-f13296eb5b01 req-8ca148c0-d429-480b-ae31-f9529357a54b service nova] Acquiring lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:21:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1ef1f0d4-8e1b-4ef4-973d-f13296eb5b01 req-8ca148c0-d429-480b-ae31-f9529357a54b service nova] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:21:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1ef1f0d4-8e1b-4ef4-973d-f13296eb5b01 req-8ca148c0-d429-480b-ae31-f9529357a54b service nova] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:21:59 user nova-compute[73078]: DEBUG nova.compute.manager [req-1ef1f0d4-8e1b-4ef4-973d-f13296eb5b01 req-8ca148c0-d429-480b-ae31-f9529357a54b service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] No waiting events found dispatching network-vif-plugged-3a008b18-c1c3-4656-9ada-f437888cdee6 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:21:59 user nova-compute[73078]: WARNING nova.compute.manager [req-1ef1f0d4-8e1b-4ef4-973d-f13296eb5b01 req-8ca148c0-d429-480b-ae31-f9529357a54b service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Received unexpected event network-vif-plugged-3a008b18-c1c3-4656-9ada-f437888cdee6 for instance with vm_state rescued and task_state unrescuing.
Aug 14 18:21:59 user nova-compute[73078]: DEBUG nova.compute.manager [req-1ef1f0d4-8e1b-4ef4-973d-f13296eb5b01 req-8ca148c0-d429-480b-ae31-f9529357a54b service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Received event network-vif-plugged-3a008b18-c1c3-4656-9ada-f437888cdee6 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:21:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1ef1f0d4-8e1b-4ef4-973d-f13296eb5b01 req-8ca148c0-d429-480b-ae31-f9529357a54b service nova] Acquiring lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:21:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1ef1f0d4-8e1b-4ef4-973d-f13296eb5b01 req-8ca148c0-d429-480b-ae31-f9529357a54b service nova] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:21:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1ef1f0d4-8e1b-4ef4-973d-f13296eb5b01 req-8ca148c0-d429-480b-ae31-f9529357a54b service nova] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:21:59 user nova-compute[73078]: DEBUG nova.compute.manager [req-1ef1f0d4-8e1b-4ef4-973d-f13296eb5b01 req-8ca148c0-d429-480b-ae31-f9529357a54b service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] No waiting events found dispatching network-vif-plugged-3a008b18-c1c3-4656-9ada-f437888cdee6 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:21:59 user nova-compute[73078]: WARNING nova.compute.manager [req-1ef1f0d4-8e1b-4ef4-973d-f13296eb5b01 req-8ca148c0-d429-480b-ae31-f9529357a54b service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Received unexpected event network-vif-plugged-3a008b18-c1c3-4656-9ada-f437888cdee6 for instance with vm_state rescued and task_state unrescuing.
Aug 14 18:21:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-ea445c0c-e5a1-4e24-8008-2cd64a679f34" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:21:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-ea445c0c-e5a1-4e24-8008-2cd64a679f34" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:21:59 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:22:00 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:00 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Updating instance_info_cache with network_info: [{"id": "3a008b18-c1c3-4656-9ada-f437888cdee6", "address": "fa:16:3e:a3:fb:e1", "network": {"id": "45b49a52-f99e-437a-aa8d-440f4f6b1099", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1520302261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9a739612a674c5c82fad631a64c57ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a008b18-c1", "ovs_interfaceid": "3a008b18-c1c3-4656-9ada-f437888cdee6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:22:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-ea445c0c-e5a1-4e24-8008-2cd64a679f34" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:22:01 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:22:01 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:22:01 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:22:01 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:22:01 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:22:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Acquiring lock "adcf1ea7-e7d7-4499-b340-689d25667899" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:22:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Lock "adcf1ea7-e7d7-4499-b340-689d25667899" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:22:04 user nova-compute[73078]: DEBUG nova.compute.manager [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:22:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:22:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:22:04 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:22:04 user nova-compute[73078]: INFO nova.compute.claims [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Claim successful on node user
Aug 14 18:22:05 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:22:05 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:22:05 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.501s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:22:05 user nova-compute[73078]: DEBUG nova.compute.manager [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:22:05 user nova-compute[73078]: DEBUG nova.compute.manager [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:22:05 user nova-compute[73078]: DEBUG nova.network.neutron [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:22:05 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:22:05 user nova-compute[73078]: DEBUG nova.compute.manager [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:22:05 user nova-compute[73078]: DEBUG nova.policy [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4951addc5b8448328689b6e44c6d0551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f4a8df8cb194ca49e33819fdca6ad1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:22:05 user nova-compute[73078]: DEBUG nova.compute.manager [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:22:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:22:05 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Creating image(s)
Aug 14 18:22:05 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Acquiring lock "/opt/stack/data/nova/instances/adcf1ea7-e7d7-4499-b340-689d25667899/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:22:05 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Lock "/opt/stack/data/nova/instances/adcf1ea7-e7d7-4499-b340-689d25667899/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:22:05 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Lock "/opt/stack/data/nova/instances/adcf1ea7-e7d7-4499-b340-689d25667899/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:22:05 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.192s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:22:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:22:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.282s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/adcf1ea7-e7d7-4499-b340-689d25667899/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/adcf1ea7-e7d7-4499-b340-689d25667899/disk 1073741824" returned: 0 in 0.090s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.383s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:22:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.240s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:06 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Checking if we can resize image /opt/stack/data/nova/instances/adcf1ea7-e7d7-4499-b340-689d25667899/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:22:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf1ea7-e7d7-4499-b340-689d25667899/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:06 user nova-compute[73078]: DEBUG nova.network.neutron [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Successfully created port: 99f07cab-5679-4800-a3ec-cb5e13875eca {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:22:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf1ea7-e7d7-4499-b340-689d25667899/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:06 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Cannot resize image /opt/stack/data/nova/instances/adcf1ea7-e7d7-4499-b340-689d25667899/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:22:06 user nova-compute[73078]: DEBUG nova.objects.instance [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Lazy-loading 'migration_context' on Instance uuid adcf1ea7-e7d7-4499-b340-689d25667899 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:22:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:22:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Ensure instance console log exists: /opt/stack/data/nova/instances/adcf1ea7-e7d7-4499-b340-689d25667899/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:22:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:22:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:22:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:22:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:07 user nova-compute[73078]: DEBUG nova.network.neutron [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Successfully updated port: 99f07cab-5679-4800-a3ec-cb5e13875eca {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:22:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Acquiring lock "refresh_cache-adcf1ea7-e7d7-4499-b340-689d25667899" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:22:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Acquired lock "refresh_cache-adcf1ea7-e7d7-4499-b340-689d25667899" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:22:07 user nova-compute[73078]: DEBUG nova.network.neutron [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG nova.compute.manager [req-52a6ed4f-a292-4725-8026-6207280266ed req-f0268a01-6821-4c50-9dfb-177eea62ac13 service nova] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Received event network-changed-99f07cab-5679-4800-a3ec-cb5e13875eca {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG nova.compute.manager [req-52a6ed4f-a292-4725-8026-6207280266ed req-f0268a01-6821-4c50-9dfb-177eea62ac13 service nova] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Refreshing instance network info cache due to event network-changed-99f07cab-5679-4800-a3ec-cb5e13875eca. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-52a6ed4f-a292-4725-8026-6207280266ed req-f0268a01-6821-4c50-9dfb-177eea62ac13 service nova] Acquiring lock "refresh_cache-adcf1ea7-e7d7-4499-b340-689d25667899" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG nova.network.neutron [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG nova.network.neutron [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Updating instance_info_cache with network_info: [{"id": "99f07cab-5679-4800-a3ec-cb5e13875eca", "address": "fa:16:3e:66:92:5c", "network": {"id": "48dd4d92-4939-4d78-a62e-e1f8251e0ca9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-788877171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f4a8df8cb194ca49e33819fdca6ad1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f07cab-56", "ovs_interfaceid": "99f07cab-5679-4800-a3ec-cb5e13875eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Releasing lock "refresh_cache-adcf1ea7-e7d7-4499-b340-689d25667899" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG nova.compute.manager [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Instance network_info: |[{"id": "99f07cab-5679-4800-a3ec-cb5e13875eca", "address": "fa:16:3e:66:92:5c", "network": {"id": "48dd4d92-4939-4d78-a62e-e1f8251e0ca9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-788877171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f4a8df8cb194ca49e33819fdca6ad1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f07cab-56", "ovs_interfaceid": "99f07cab-5679-4800-a3ec-cb5e13875eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-52a6ed4f-a292-4725-8026-6207280266ed req-f0268a01-6821-4c50-9dfb-177eea62ac13 service nova] Acquired lock "refresh_cache-adcf1ea7-e7d7-4499-b340-689d25667899" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG nova.network.neutron [req-52a6ed4f-a292-4725-8026-6207280266ed req-f0268a01-6821-4c50-9dfb-177eea62ac13 service nova] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Refreshing network info cache for port 99f07cab-5679-4800-a3ec-cb5e13875eca {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Start _get_guest_xml network_info=[{"id": "99f07cab-5679-4800-a3ec-cb5e13875eca", "address": "fa:16:3e:66:92:5c", "network": {"id": "48dd4d92-4939-4d78-a62e-e1f8251e0ca9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-788877171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f4a8df8cb194ca49e33819fdca6ad1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f07cab-56", "ovs_interfaceid": "99f07cab-5679-4800-a3ec-cb5e13875eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Acquiring lock "35bb08ed-fa84-4157-a27a-f0dd0dee0408" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Lock "35bb08ed-fa84-4157-a27a-f0dd0dee0408" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:22:08 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:22:08 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:22:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG nova.compute.manager [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:22:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1986688767',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1986688767',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1986688',id=27,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAsV2gEH1L3ls8iqDNO9zBUAQZ8ER2s3OSa/yvGndYct1yDOSxIcFwmlMt/vtIwwW5tfe4bgixUm9eAkPlWZZEo1/1aWMpFm1sW/Ap1q76Ic2NI/FO+khGLyh07mZEz3vA==',key_name='tempest-keypair-1169564615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f4a8df8cb194ca49e33819fdca6ad1a',ramdisk_id='',reservation_id='r-nqk6wj7b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1306773013',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:22:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4951addc5b8448328689b6e44c6d0551',uuid=adcf1ea7-e7d7-4499-b340-689d25667899,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99f07cab-5679-4800-a3ec-cb5e13875eca", "address": "fa:16:3e:66:92:5c", "network": {"id": "48dd4d92-4939-4d78-a62e-e1f8251e0ca9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-788877171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f4a8df8cb194ca49e33819fdca6ad1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f07cab-56", "ovs_interfaceid": "99f07cab-5679-4800-a3ec-cb5e13875eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Converting VIF {"id": "99f07cab-5679-4800-a3ec-cb5e13875eca", "address": "fa:16:3e:66:92:5c", "network": {"id": "48dd4d92-4939-4d78-a62e-e1f8251e0ca9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-788877171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f4a8df8cb194ca49e33819fdca6ad1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f07cab-56", "ovs_interfaceid": "99f07cab-5679-4800-a3ec-cb5e13875eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:92:5c,bridge_name='br-int',has_traffic_filtering=True,id=99f07cab-5679-4800-a3ec-cb5e13875eca,network=Network(48dd4d92-4939-4d78-a62e-e1f8251e0ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f07cab-56') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG nova.objects.instance [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Lazy-loading 'pci_devices' on Instance uuid adcf1ea7-e7d7-4499-b340-689d25667899 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:22:08 user nova-compute[73078]:   <uuid>adcf1ea7-e7d7-4499-b340-689d25667899</uuid>
Aug 14 18:22:08 user nova-compute[73078]:   <name>instance-0000001b</name>
Aug 14 18:22:08 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:22:08 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:22:08 user nova-compute[73078]:   <metadata>
Aug 14 18:22:08 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:22:08 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:22:08 user nova-compute[73078]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1986688767</nova:name>
Aug 14 18:22:08 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:22:08</nova:creationTime>
Aug 14 18:22:08 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:22:08 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:22:08 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:22:08 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:22:08 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:22:08 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:22:08 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:22:08 user nova-compute[73078]:       <nova:owner>
Aug 14 18:22:08 user nova-compute[73078]:         <nova:user uuid="4951addc5b8448328689b6e44c6d0551">tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member</nova:user>
Aug 14 18:22:08 user nova-compute[73078]:         <nova:project uuid="3f4a8df8cb194ca49e33819fdca6ad1a">tempest-TestServerVolumeAttachScenarioOldVersion-1306773013</nova:project>
Aug 14 18:22:08 user nova-compute[73078]:       </nova:owner>
Aug 14 18:22:08 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:22:08 user nova-compute[73078]:       <nova:ports>
Aug 14 18:22:08 user nova-compute[73078]:         <nova:port uuid="99f07cab-5679-4800-a3ec-cb5e13875eca">
Aug 14 18:22:08 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 14 18:22:08 user nova-compute[73078]:         </nova:port>
Aug 14 18:22:08 user nova-compute[73078]:       </nova:ports>
Aug 14 18:22:08 user nova-compute[73078]:     </nova:instance>
Aug 14 18:22:08 user nova-compute[73078]:   </metadata>
Aug 14 18:22:08 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:22:08 user nova-compute[73078]:     <system>
Aug 14 18:22:08 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:22:08 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:22:08 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:22:08 user nova-compute[73078]:       <entry name="serial">adcf1ea7-e7d7-4499-b340-689d25667899</entry>
Aug 14 18:22:08 user nova-compute[73078]:       <entry name="uuid">adcf1ea7-e7d7-4499-b340-689d25667899</entry>
Aug 14 18:22:08 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:22:08 user nova-compute[73078]:     </system>
Aug 14 18:22:08 user nova-compute[73078]:   </sysinfo>
Aug 14 18:22:08 user nova-compute[73078]:   <os>
Aug 14 18:22:08 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:22:08 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:22:08 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:22:08 user nova-compute[73078]:   </os>
Aug 14 18:22:08 user nova-compute[73078]:   <features>
Aug 14 18:22:08 user nova-compute[73078]:     <acpi/>
Aug 14 18:22:08 user nova-compute[73078]:     <apic/>
Aug 14 18:22:08 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:22:08 user nova-compute[73078]:   </features>
Aug 14 18:22:08 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:22:08 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:22:08 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:22:08 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:22:08 user nova-compute[73078]:   </clock>
Aug 14 18:22:08 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:22:08 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:22:08 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:22:08 user nova-compute[73078]:   </cpu>
Aug 14 18:22:08 user nova-compute[73078]:   <devices>
Aug 14 18:22:08 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:22:08 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:22:08 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/adcf1ea7-e7d7-4499-b340-689d25667899/disk"/>
Aug 14 18:22:08 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:22:08 user nova-compute[73078]:     </disk>
Aug 14 18:22:08 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:22:08 user nova-compute[73078]:       <mac address="fa:16:3e:66:92:5c"/>
Aug 14 18:22:08 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:22:08 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:22:08 user nova-compute[73078]:       <target dev="tap99f07cab-56"/>
Aug 14 18:22:08 user nova-compute[73078]:     </interface>
Aug 14 18:22:08 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:22:08 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/adcf1ea7-e7d7-4499-b340-689d25667899/console.log" append="off"/>
Aug 14 18:22:08 user nova-compute[73078]:     </serial>
Aug 14 18:22:08 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:22:08 user nova-compute[73078]:     <video>
Aug 14 18:22:08 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:22:08 user nova-compute[73078]:     </video>
Aug 14 18:22:08 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:22:08 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:22:08 user nova-compute[73078]:     </rng>
Aug 14 18:22:08 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:22:08 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:22:08 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:22:08 user nova-compute[73078]:     </memballoon>
Aug 14 18:22:08 user nova-compute[73078]:   </devices>
Aug 14 18:22:08 user nova-compute[73078]: </domain>
Aug 14 18:22:08 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:22:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1986688767',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1986688767',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1986688',id=27,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAsV2gEH1L3ls8iqDNO9zBUAQZ8ER2s3OSa/yvGndYct1yDOSxIcFwmlMt/vtIwwW5tfe4bgixUm9eAkPlWZZEo1/1aWMpFm1sW/Ap1q76Ic2NI/FO+khGLyh07mZEz3vA==',key_name='tempest-keypair-1169564615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f4a8df8cb194ca49e33819fdca6ad1a',ramdisk_id='',reservation_id='r-nqk6wj7b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1306773013',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:22:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4951addc5b8448328689b6e44c6d0551',uuid=adcf1ea7-e7d7-4499-b340-689d25667899,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99f07cab-5679-4800-a3ec-cb5e13875eca", "address": "fa:16:3e:66:92:5c", "network": {"id": "48dd4d92-4939-4d78-a62e-e1f8251e0ca9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-788877171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f4a8df8cb194ca49e33819fdca6ad1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f07cab-56", "ovs_interfaceid": "99f07cab-5679-4800-a3ec-cb5e13875eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Converting VIF {"id": "99f07cab-5679-4800-a3ec-cb5e13875eca", "address": "fa:16:3e:66:92:5c", "network": {"id": "48dd4d92-4939-4d78-a62e-e1f8251e0ca9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-788877171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f4a8df8cb194ca49e33819fdca6ad1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f07cab-56", "ovs_interfaceid": "99f07cab-5679-4800-a3ec-cb5e13875eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:92:5c,bridge_name='br-int',has_traffic_filtering=True,id=99f07cab-5679-4800-a3ec-cb5e13875eca,network=Network(48dd4d92-4939-4d78-a62e-e1f8251e0ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f07cab-56') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG os_vif [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:92:5c,bridge_name='br-int',has_traffic_filtering=True,id=99f07cab-5679-4800-a3ec-cb5e13875eca,network=Network(48dd4d92-4939-4d78-a62e-e1f8251e0ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f07cab-56') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99f07cab-56, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap99f07cab-56, col_values=(('external_ids', {'iface-id': '99f07cab-5679-4800-a3ec-cb5e13875eca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:92:5c', 'vm-uuid': 'adcf1ea7-e7d7-4499-b340-689d25667899'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:08 user nova-compute[73078]: INFO os_vif [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:92:5c,bridge_name='br-int',has_traffic_filtering=True,id=99f07cab-5679-4800-a3ec-cb5e13875eca,network=Network(48dd4d92-4939-4d78-a62e-e1f8251e0ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f07cab-56')
Aug 14 18:22:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:22:08 user nova-compute[73078]: INFO nova.compute.claims [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Claim successful on node user
Aug 14 18:22:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:22:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] No VIF found with MAC fa:16:3e:66:92:5c, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:22:09 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:22:09 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:22:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.541s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:22:09 user nova-compute[73078]: DEBUG nova.compute.manager [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:22:09 user nova-compute[73078]: DEBUG nova.compute.manager [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:22:09 user nova-compute[73078]: DEBUG nova.network.neutron [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:22:09 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:22:09 user nova-compute[73078]: DEBUG nova.compute.manager [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:22:09 user nova-compute[73078]: DEBUG nova.network.neutron [req-52a6ed4f-a292-4725-8026-6207280266ed req-f0268a01-6821-4c50-9dfb-177eea62ac13 service nova] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Updated VIF entry in instance network info cache for port 99f07cab-5679-4800-a3ec-cb5e13875eca. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:22:09 user nova-compute[73078]: DEBUG nova.network.neutron [req-52a6ed4f-a292-4725-8026-6207280266ed req-f0268a01-6821-4c50-9dfb-177eea62ac13 service nova] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Updating instance_info_cache with network_info: [{"id": "99f07cab-5679-4800-a3ec-cb5e13875eca", "address": "fa:16:3e:66:92:5c", "network": {"id": "48dd4d92-4939-4d78-a62e-e1f8251e0ca9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-788877171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f4a8df8cb194ca49e33819fdca6ad1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f07cab-56", "ovs_interfaceid": "99f07cab-5679-4800-a3ec-cb5e13875eca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:22:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-52a6ed4f-a292-4725-8026-6207280266ed req-f0268a01-6821-4c50-9dfb-177eea62ac13 service nova] Releasing lock "refresh_cache-adcf1ea7-e7d7-4499-b340-689d25667899" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:22:09 user nova-compute[73078]: DEBUG nova.policy [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '629ed9aedb14440cbab218c4b7d2015b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20af5b7e636141fd9a66b093d31cc402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:22:09 user nova-compute[73078]: DEBUG nova.compute.manager [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:22:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:22:09 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Creating image(s)
Aug 14 18:22:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Acquiring lock "/opt/stack/data/nova/instances/35bb08ed-fa84-4157-a27a-f0dd0dee0408/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:22:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Lock "/opt/stack/data/nova/instances/35bb08ed-fa84-4157-a27a-f0dd0dee0408/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:22:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Lock "/opt/stack/data/nova/instances/35bb08ed-fa84-4157-a27a-f0dd0dee0408/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:22:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.180s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:22:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:22:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.182s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/35bb08ed-fa84-4157-a27a-f0dd0dee0408/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/35bb08ed-fa84-4157-a27a-f0dd0dee0408/disk 1073741824" returned: 0 in 0.079s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:22:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:10 user nova-compute[73078]: DEBUG nova.compute.manager [req-ec60048c-6e4d-43e8-96ba-ad04a5fa133b req-06b1a42d-760a-43ca-8ad9-f68537bb5802 service nova] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Received event network-vif-plugged-99f07cab-5679-4800-a3ec-cb5e13875eca {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:22:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ec60048c-6e4d-43e8-96ba-ad04a5fa133b req-06b1a42d-760a-43ca-8ad9-f68537bb5802 service nova] Acquiring lock "adcf1ea7-e7d7-4499-b340-689d25667899-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:22:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ec60048c-6e4d-43e8-96ba-ad04a5fa133b req-06b1a42d-760a-43ca-8ad9-f68537bb5802 service nova] Lock "adcf1ea7-e7d7-4499-b340-689d25667899-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:22:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ec60048c-6e4d-43e8-96ba-ad04a5fa133b req-06b1a42d-760a-43ca-8ad9-f68537bb5802 service nova] Lock "adcf1ea7-e7d7-4499-b340-689d25667899-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:22:10 user nova-compute[73078]: DEBUG nova.compute.manager [req-ec60048c-6e4d-43e8-96ba-ad04a5fa133b req-06b1a42d-760a-43ca-8ad9-f68537bb5802 service nova] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] No waiting events found dispatching network-vif-plugged-99f07cab-5679-4800-a3ec-cb5e13875eca {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:22:10 user nova-compute[73078]: WARNING nova.compute.manager [req-ec60048c-6e4d-43e8-96ba-ad04a5fa133b req-06b1a42d-760a-43ca-8ad9-f68537bb5802 service nova] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Received unexpected event network-vif-plugged-99f07cab-5679-4800-a3ec-cb5e13875eca for instance with vm_state building and task_state spawning.
Aug 14 18:22:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.254s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:10 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35bb08ed-fa84-4157-a27a-f0dd0dee0408/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:22:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35bb08ed-fa84-4157-a27a-f0dd0dee0408/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35bb08ed-fa84-4157-a27a-f0dd0dee0408/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:10 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Cannot resize image /opt/stack/data/nova/instances/35bb08ed-fa84-4157-a27a-f0dd0dee0408/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:22:10 user nova-compute[73078]: DEBUG nova.objects.instance [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Lazy-loading 'migration_context' on Instance uuid 35bb08ed-fa84-4157-a27a-f0dd0dee0408 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:22:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:22:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Ensure instance console log exists: /opt/stack/data/nova/instances/35bb08ed-fa84-4157-a27a-f0dd0dee0408/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:22:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:22:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:22:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:22:10 user nova-compute[73078]: DEBUG nova.network.neutron [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Successfully created port: 3fca973c-b77d-440c-acef-5c93a377bd97 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:22:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:11 user nova-compute[73078]: DEBUG nova.network.neutron [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Successfully updated port: 3fca973c-b77d-440c-acef-5c93a377bd97 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:22:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Acquiring lock "refresh_cache-35bb08ed-fa84-4157-a27a-f0dd0dee0408" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:22:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Acquired lock "refresh_cache-35bb08ed-fa84-4157-a27a-f0dd0dee0408" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:22:11 user nova-compute[73078]: DEBUG nova.network.neutron [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:22:11 user nova-compute[73078]: DEBUG nova.network.neutron [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.compute.manager [req-e5e941cf-76d1-43ac-9297-38a098053e35 req-be91f221-40c9-4cf4-add5-fec5b453946b service nova] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Received event network-changed-3fca973c-b77d-440c-acef-5c93a377bd97 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.compute.manager [req-e5e941cf-76d1-43ac-9297-38a098053e35 req-be91f221-40c9-4cf4-add5-fec5b453946b service nova] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Refreshing instance network info cache due to event network-changed-3fca973c-b77d-440c-acef-5c93a377bd97. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e5e941cf-76d1-43ac-9297-38a098053e35 req-be91f221-40c9-4cf4-add5-fec5b453946b service nova] Acquiring lock "refresh_cache-35bb08ed-fa84-4157-a27a-f0dd0dee0408" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.network.neutron [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Updating instance_info_cache with network_info: [{"id": "3fca973c-b77d-440c-acef-5c93a377bd97", "address": "fa:16:3e:1e:0f:c2", "network": {"id": "3408f138-e61d-4540-b517-56b583c571b5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9d74e47e937341ec928819ea23835937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fca973c-b7", "ovs_interfaceid": "3fca973c-b77d-440c-acef-5c93a377bd97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Releasing lock "refresh_cache-35bb08ed-fa84-4157-a27a-f0dd0dee0408" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Instance network_info: |[{"id": "3fca973c-b77d-440c-acef-5c93a377bd97", "address": "fa:16:3e:1e:0f:c2", "network": {"id": "3408f138-e61d-4540-b517-56b583c571b5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9d74e47e937341ec928819ea23835937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fca973c-b7", "ovs_interfaceid": "3fca973c-b77d-440c-acef-5c93a377bd97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e5e941cf-76d1-43ac-9297-38a098053e35 req-be91f221-40c9-4cf4-add5-fec5b453946b service nova] Acquired lock "refresh_cache-35bb08ed-fa84-4157-a27a-f0dd0dee0408" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.network.neutron [req-e5e941cf-76d1-43ac-9297-38a098053e35 req-be91f221-40c9-4cf4-add5-fec5b453946b service nova] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Refreshing network info cache for port 3fca973c-b77d-440c-acef-5c93a377bd97 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Start _get_guest_xml network_info=[{"id": "3fca973c-b77d-440c-acef-5c93a377bd97", "address": "fa:16:3e:1e:0f:c2", "network": {"id": "3408f138-e61d-4540-b517-56b583c571b5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9d74e47e937341ec928819ea23835937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fca973c-b7", "ovs_interfaceid": "3fca973c-b77d-440c-acef-5c93a377bd97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:22:12 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:22:12 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:22:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-867205447',display_name='tempest-VolumesNegativeTest-instance-867205447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-867205447',id=28,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20af5b7e636141fd9a66b093d31cc402',ramdisk_id='',reservation_id='r-ctvoxr36',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1898058481',owner_user_name='tempest-VolumesNegativeTest-1898058481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:22:10Z,user_data=None,user_id='629ed9aedb14440cbab218c4b7d2015b',uuid=35bb08ed-fa84-4157-a27a-f0dd0dee0408,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fca973c-b77d-440c-acef-5c93a377bd97", "address": "fa:16:3e:1e:0f:c2", "network": {"id": "3408f138-e61d-4540-b517-56b583c571b5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9d74e47e937341ec928819ea23835937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fca973c-b7", "ovs_interfaceid": "3fca973c-b77d-440c-acef-5c93a377bd97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Converting VIF {"id": "3fca973c-b77d-440c-acef-5c93a377bd97", "address": "fa:16:3e:1e:0f:c2", "network": {"id": "3408f138-e61d-4540-b517-56b583c571b5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9d74e47e937341ec928819ea23835937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fca973c-b7", "ovs_interfaceid": "3fca973c-b77d-440c-acef-5c93a377bd97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:0f:c2,bridge_name='br-int',has_traffic_filtering=True,id=3fca973c-b77d-440c-acef-5c93a377bd97,network=Network(3408f138-e61d-4540-b517-56b583c571b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fca973c-b7') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.objects.instance [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Lazy-loading 'pci_devices' on Instance uuid 35bb08ed-fa84-4157-a27a-f0dd0dee0408 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:22:12 user nova-compute[73078]:   <uuid>35bb08ed-fa84-4157-a27a-f0dd0dee0408</uuid>
Aug 14 18:22:12 user nova-compute[73078]:   <name>instance-0000001c</name>
Aug 14 18:22:12 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:22:12 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:22:12 user nova-compute[73078]:   <metadata>
Aug 14 18:22:12 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:22:12 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:22:12 user nova-compute[73078]:       <nova:name>tempest-VolumesNegativeTest-instance-867205447</nova:name>
Aug 14 18:22:12 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:22:12</nova:creationTime>
Aug 14 18:22:12 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:22:12 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:22:12 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:22:12 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:22:12 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:22:12 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:22:12 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:22:12 user nova-compute[73078]:       <nova:owner>
Aug 14 18:22:12 user nova-compute[73078]:         <nova:user uuid="629ed9aedb14440cbab218c4b7d2015b">tempest-VolumesNegativeTest-1898058481-project-member</nova:user>
Aug 14 18:22:12 user nova-compute[73078]:         <nova:project uuid="20af5b7e636141fd9a66b093d31cc402">tempest-VolumesNegativeTest-1898058481</nova:project>
Aug 14 18:22:12 user nova-compute[73078]:       </nova:owner>
Aug 14 18:22:12 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:22:12 user nova-compute[73078]:       <nova:ports>
Aug 14 18:22:12 user nova-compute[73078]:         <nova:port uuid="3fca973c-b77d-440c-acef-5c93a377bd97">
Aug 14 18:22:12 user nova-compute[73078]:           <nova:ip type="fixed" address="192.168.233.123" ipVersion="4"/>
Aug 14 18:22:12 user nova-compute[73078]:         </nova:port>
Aug 14 18:22:12 user nova-compute[73078]:       </nova:ports>
Aug 14 18:22:12 user nova-compute[73078]:     </nova:instance>
Aug 14 18:22:12 user nova-compute[73078]:   </metadata>
Aug 14 18:22:12 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:22:12 user nova-compute[73078]:     <system>
Aug 14 18:22:12 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:22:12 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:22:12 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:22:12 user nova-compute[73078]:       <entry name="serial">35bb08ed-fa84-4157-a27a-f0dd0dee0408</entry>
Aug 14 18:22:12 user nova-compute[73078]:       <entry name="uuid">35bb08ed-fa84-4157-a27a-f0dd0dee0408</entry>
Aug 14 18:22:12 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:22:12 user nova-compute[73078]:     </system>
Aug 14 18:22:12 user nova-compute[73078]:   </sysinfo>
Aug 14 18:22:12 user nova-compute[73078]:   <os>
Aug 14 18:22:12 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:22:12 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:22:12 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:22:12 user nova-compute[73078]:   </os>
Aug 14 18:22:12 user nova-compute[73078]:   <features>
Aug 14 18:22:12 user nova-compute[73078]:     <acpi/>
Aug 14 18:22:12 user nova-compute[73078]:     <apic/>
Aug 14 18:22:12 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:22:12 user nova-compute[73078]:   </features>
Aug 14 18:22:12 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:22:12 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:22:12 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:22:12 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:22:12 user nova-compute[73078]:   </clock>
Aug 14 18:22:12 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:22:12 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:22:12 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:22:12 user nova-compute[73078]:   </cpu>
Aug 14 18:22:12 user nova-compute[73078]:   <devices>
Aug 14 18:22:12 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:22:12 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:22:12 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/35bb08ed-fa84-4157-a27a-f0dd0dee0408/disk"/>
Aug 14 18:22:12 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:22:12 user nova-compute[73078]:     </disk>
Aug 14 18:22:12 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:22:12 user nova-compute[73078]:       <mac address="fa:16:3e:1e:0f:c2"/>
Aug 14 18:22:12 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:22:12 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:22:12 user nova-compute[73078]:       <target dev="tap3fca973c-b7"/>
Aug 14 18:22:12 user nova-compute[73078]:     </interface>
Aug 14 18:22:12 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:22:12 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/35bb08ed-fa84-4157-a27a-f0dd0dee0408/console.log" append="off"/>
Aug 14 18:22:12 user nova-compute[73078]:     </serial>
Aug 14 18:22:12 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:22:12 user nova-compute[73078]:     <video>
Aug 14 18:22:12 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:22:12 user nova-compute[73078]:     </video>
Aug 14 18:22:12 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:22:12 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:22:12 user nova-compute[73078]:     </rng>
Aug 14 18:22:12 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:22:12 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:22:12 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:22:12 user nova-compute[73078]:     </memballoon>
Aug 14 18:22:12 user nova-compute[73078]:   </devices>
Aug 14 18:22:12 user nova-compute[73078]: </domain>
Aug 14 18:22:12 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:22:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-867205447',display_name='tempest-VolumesNegativeTest-instance-867205447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-867205447',id=28,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20af5b7e636141fd9a66b093d31cc402',ramdisk_id='',reservation_id='r-ctvoxr36',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1898058481',owner_user_name='tempest-VolumesNegativeTest-1898058481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:22:10Z,user_data=None,user_id='629ed9aedb14440cbab218c4b7d2015b',uuid=35bb08ed-fa84-4157-a27a-f0dd0dee0408,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fca973c-b77d-440c-acef-5c93a377bd97", "address": "fa:16:3e:1e:0f:c2", "network": {"id": "3408f138-e61d-4540-b517-56b583c571b5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9d74e47e937341ec928819ea23835937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fca973c-b7", "ovs_interfaceid": "3fca973c-b77d-440c-acef-5c93a377bd97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Converting VIF {"id": "3fca973c-b77d-440c-acef-5c93a377bd97", "address": "fa:16:3e:1e:0f:c2", "network": {"id": "3408f138-e61d-4540-b517-56b583c571b5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9d74e47e937341ec928819ea23835937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fca973c-b7", "ovs_interfaceid": "3fca973c-b77d-440c-acef-5c93a377bd97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:0f:c2,bridge_name='br-int',has_traffic_filtering=True,id=3fca973c-b77d-440c-acef-5c93a377bd97,network=Network(3408f138-e61d-4540-b517-56b583c571b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fca973c-b7') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG os_vif [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:0f:c2,bridge_name='br-int',has_traffic_filtering=True,id=3fca973c-b77d-440c-acef-5c93a377bd97,network=Network(3408f138-e61d-4540-b517-56b583c571b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fca973c-b7') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3fca973c-b7, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3fca973c-b7, col_values=(('external_ids', {'iface-id': '3fca973c-b77d-440c-acef-5c93a377bd97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:0f:c2', 'vm-uuid': '35bb08ed-fa84-4157-a27a-f0dd0dee0408'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:12 user nova-compute[73078]: INFO os_vif [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:0f:c2,bridge_name='br-int',has_traffic_filtering=True,id=3fca973c-b77d-440c-acef-5c93a377bd97,network=Network(3408f138-e61d-4540-b517-56b583c571b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fca973c-b7')
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] No VIF found with MAC fa:16:3e:1e:0f:c2, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.compute.manager [req-e30f1b30-e9c3-4bd4-bc2f-4133da11cd01 req-4b0cb436-ddc5-4e27-9f9d-07708d81476d service nova] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Received event network-vif-plugged-99f07cab-5679-4800-a3ec-cb5e13875eca {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e30f1b30-e9c3-4bd4-bc2f-4133da11cd01 req-4b0cb436-ddc5-4e27-9f9d-07708d81476d service nova] Acquiring lock "adcf1ea7-e7d7-4499-b340-689d25667899-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e30f1b30-e9c3-4bd4-bc2f-4133da11cd01 req-4b0cb436-ddc5-4e27-9f9d-07708d81476d service nova] Lock "adcf1ea7-e7d7-4499-b340-689d25667899-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e30f1b30-e9c3-4bd4-bc2f-4133da11cd01 req-4b0cb436-ddc5-4e27-9f9d-07708d81476d service nova] Lock "adcf1ea7-e7d7-4499-b340-689d25667899-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.compute.manager [req-e30f1b30-e9c3-4bd4-bc2f-4133da11cd01 req-4b0cb436-ddc5-4e27-9f9d-07708d81476d service nova] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] No waiting events found dispatching network-vif-plugged-99f07cab-5679-4800-a3ec-cb5e13875eca {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:22:12 user nova-compute[73078]: WARNING nova.compute.manager [req-e30f1b30-e9c3-4bd4-bc2f-4133da11cd01 req-4b0cb436-ddc5-4e27-9f9d-07708d81476d service nova] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Received unexpected event network-vif-plugged-99f07cab-5679-4800-a3ec-cb5e13875eca for instance with vm_state building and task_state spawning.
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037332.7421086, adcf1ea7-e7d7-4499-b340-689d25667899 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:22:12 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] VM Resumed (Lifecycle Event)
Aug 14 18:22:12 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Instance spawned successfully.
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:22:12 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037332.7422326, adcf1ea7-e7d7-4499-b340-689d25667899 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:22:12 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] VM Started (Lifecycle Event)
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.network.neutron [req-e5e941cf-76d1-43ac-9297-38a098053e35 req-be91f221-40c9-4cf4-add5-fec5b453946b service nova] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Updated VIF entry in instance network info cache for port 3fca973c-b77d-440c-acef-5c93a377bd97. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.network.neutron [req-e5e941cf-76d1-43ac-9297-38a098053e35 req-be91f221-40c9-4cf4-add5-fec5b453946b service nova] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Updating instance_info_cache with network_info: [{"id": "3fca973c-b77d-440c-acef-5c93a377bd97", "address": "fa:16:3e:1e:0f:c2", "network": {"id": "3408f138-e61d-4540-b517-56b583c571b5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9d74e47e937341ec928819ea23835937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fca973c-b7", "ovs_interfaceid": "3fca973c-b77d-440c-acef-5c93a377bd97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e5e941cf-76d1-43ac-9297-38a098053e35 req-be91f221-40c9-4cf4-add5-fec5b453946b service nova] Releasing lock "refresh_cache-35bb08ed-fa84-4157-a27a-f0dd0dee0408" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:22:12 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:22:12 user nova-compute[73078]: INFO nova.compute.manager [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Took 7.12 seconds to spawn the instance on the hypervisor.
Aug 14 18:22:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:22:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:13 user nova-compute[73078]: INFO nova.compute.manager [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Took 8.15 seconds to build instance.
Aug 14 18:22:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f3e86430-141c-4029-8bb6-3fa2e5030958 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Lock "adcf1ea7-e7d7-4499-b340-689d25667899" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.283s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:22:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:14 user nova-compute[73078]: DEBUG nova.compute.manager [req-20dea44d-6874-4671-b4ef-9076fd3e8f4c req-1be7ea97-74d6-43f3-b7ae-1dac98c1fa2e service nova] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Received event network-vif-plugged-3fca973c-b77d-440c-acef-5c93a377bd97 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:22:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-20dea44d-6874-4671-b4ef-9076fd3e8f4c req-1be7ea97-74d6-43f3-b7ae-1dac98c1fa2e service nova] Acquiring lock "35bb08ed-fa84-4157-a27a-f0dd0dee0408-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:22:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-20dea44d-6874-4671-b4ef-9076fd3e8f4c req-1be7ea97-74d6-43f3-b7ae-1dac98c1fa2e service nova] Lock "35bb08ed-fa84-4157-a27a-f0dd0dee0408-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:22:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-20dea44d-6874-4671-b4ef-9076fd3e8f4c req-1be7ea97-74d6-43f3-b7ae-1dac98c1fa2e service nova] Lock "35bb08ed-fa84-4157-a27a-f0dd0dee0408-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:22:14 user nova-compute[73078]: DEBUG nova.compute.manager [req-20dea44d-6874-4671-b4ef-9076fd3e8f4c req-1be7ea97-74d6-43f3-b7ae-1dac98c1fa2e service nova] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] No waiting events found dispatching network-vif-plugged-3fca973c-b77d-440c-acef-5c93a377bd97 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:22:14 user nova-compute[73078]: WARNING nova.compute.manager [req-20dea44d-6874-4671-b4ef-9076fd3e8f4c req-1be7ea97-74d6-43f3-b7ae-1dac98c1fa2e service nova] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Received unexpected event network-vif-plugged-3fca973c-b77d-440c-acef-5c93a377bd97 for instance with vm_state building and task_state spawning.
Aug 14 18:22:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:16 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037336.4199097, 35bb08ed-fa84-4157-a27a-f0dd0dee0408 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:22:16 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] VM Resumed (Lifecycle Event)
Aug 14 18:22:16 user nova-compute[73078]: DEBUG nova.compute.manager [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:22:16 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:22:16 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Instance spawned successfully.
Aug 14 18:22:16 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:22:16 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:22:16 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:22:16 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:22:16 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:22:16 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:22:16 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:22:16 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:22:16 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:22:16 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:22:16 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037336.4255028, 35bb08ed-fa84-4157-a27a-f0dd0dee0408 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:22:16 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] VM Started (Lifecycle Event)
Aug 14 18:22:16 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:22:16 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:22:16 user nova-compute[73078]: INFO nova.compute.manager [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Took 6.81 seconds to spawn the instance on the hypervisor.
Aug 14 18:22:16 user nova-compute[73078]: DEBUG nova.compute.manager [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:22:16 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:22:16 user nova-compute[73078]: INFO nova.compute.manager [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Took 7.99 seconds to build instance.
Aug 14 18:22:16 user nova-compute[73078]: DEBUG nova.compute.manager [req-a6e45498-9baa-4881-b15d-3c6a50b9ac85 req-9a787645-bb4d-43c1-8b1c-c5cfa3ec01ce service nova] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Received event network-vif-plugged-3fca973c-b77d-440c-acef-5c93a377bd97 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:22:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a6e45498-9baa-4881-b15d-3c6a50b9ac85 req-9a787645-bb4d-43c1-8b1c-c5cfa3ec01ce service nova] Acquiring lock "35bb08ed-fa84-4157-a27a-f0dd0dee0408-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:22:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a6e45498-9baa-4881-b15d-3c6a50b9ac85 req-9a787645-bb4d-43c1-8b1c-c5cfa3ec01ce service nova] Lock "35bb08ed-fa84-4157-a27a-f0dd0dee0408-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:22:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a6e45498-9baa-4881-b15d-3c6a50b9ac85 req-9a787645-bb4d-43c1-8b1c-c5cfa3ec01ce service nova] Lock "35bb08ed-fa84-4157-a27a-f0dd0dee0408-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:22:16 user nova-compute[73078]: DEBUG nova.compute.manager [req-a6e45498-9baa-4881-b15d-3c6a50b9ac85 req-9a787645-bb4d-43c1-8b1c-c5cfa3ec01ce service nova] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] No waiting events found dispatching network-vif-plugged-3fca973c-b77d-440c-acef-5c93a377bd97 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:22:16 user nova-compute[73078]: WARNING nova.compute.manager [req-a6e45498-9baa-4881-b15d-3c6a50b9ac85 req-9a787645-bb4d-43c1-8b1c-c5cfa3ec01ce service nova] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Received unexpected event network-vif-plugged-3fca973c-b77d-440c-acef-5c93a377bd97 for instance with vm_state active and task_state None.
Aug 14 18:22:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-846296fb-c6bd-43bd-a9da-aa1fdce6192e tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Lock "35bb08ed-fa84-4157-a27a-f0dd0dee0408" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.138s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:22:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:22:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:22:18 user nova-compute[73078]: INFO nova.compute.manager [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Unshelving
Aug 14 18:22:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:22:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:22:18 user nova-compute[73078]: DEBUG nova.objects.instance [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lazy-loading 'pci_requests' on Instance uuid 4569b529-5c8f-45ec-94fe-58c60f6bcc8a {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:22:18 user nova-compute[73078]: DEBUG nova.objects.instance [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lazy-loading 'numa_topology' on Instance uuid 4569b529-5c8f-45ec-94fe-58c60f6bcc8a {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:22:18 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:22:18 user nova-compute[73078]: INFO nova.compute.claims [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Claim successful on node user
Aug 14 18:22:18 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:22:18 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:22:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.522s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:22:18 user nova-compute[73078]: INFO nova.network.neutron [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Updating port 08a212c4-6236-4adc-a3ec-6b76341585b3 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 14 18:22:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "refresh_cache-4569b529-5c8f-45ec-94fe-58c60f6bcc8a" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:22:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquired lock "refresh_cache-4569b529-5c8f-45ec-94fe-58c60f6bcc8a" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:22:20 user nova-compute[73078]: DEBUG nova.network.neutron [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:22:20 user nova-compute[73078]: DEBUG nova.compute.manager [req-befeba34-48fc-4dfe-9fd9-31d9cf466754 req-d86a73f3-6185-4be7-8700-5ec8a6fe6fd1 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Received event network-changed-08a212c4-6236-4adc-a3ec-6b76341585b3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:22:20 user nova-compute[73078]: DEBUG nova.compute.manager [req-befeba34-48fc-4dfe-9fd9-31d9cf466754 req-d86a73f3-6185-4be7-8700-5ec8a6fe6fd1 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Refreshing instance network info cache due to event network-changed-08a212c4-6236-4adc-a3ec-6b76341585b3. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:22:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-befeba34-48fc-4dfe-9fd9-31d9cf466754 req-d86a73f3-6185-4be7-8700-5ec8a6fe6fd1 service nova] Acquiring lock "refresh_cache-4569b529-5c8f-45ec-94fe-58c60f6bcc8a" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:22:20 user nova-compute[73078]: DEBUG nova.network.neutron [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Updating instance_info_cache with network_info: [{"id": "08a212c4-6236-4adc-a3ec-6b76341585b3", "address": "fa:16:3e:4f:04:0e", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a212c4-62", "ovs_interfaceid": "08a212c4-6236-4adc-a3ec-6b76341585b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:22:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Releasing lock "refresh_cache-4569b529-5c8f-45ec-94fe-58c60f6bcc8a" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:22:20 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:22:20 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Creating image(s)
Aug 14 18:22:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "/opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:22:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "/opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:22:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "/opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:22:20 user nova-compute[73078]: DEBUG nova.objects.instance [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4569b529-5c8f-45ec-94fe-58c60f6bcc8a {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:22:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-befeba34-48fc-4dfe-9fd9-31d9cf466754 req-d86a73f3-6185-4be7-8700-5ec8a6fe6fd1 service nova] Acquired lock "refresh_cache-4569b529-5c8f-45ec-94fe-58c60f6bcc8a" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:22:20 user nova-compute[73078]: DEBUG nova.network.neutron [req-befeba34-48fc-4dfe-9fd9-31d9cf466754 req-d86a73f3-6185-4be7-8700-5ec8a6fe6fd1 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Refreshing network info cache for port 08a212c4-6236-4adc-a3ec-6b76341585b3 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:22:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "106c9f2ab5e54121307d9496129f8719d41141a2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:22:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "106c9f2ab5e54121307d9496129f8719d41141a2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:22:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/106c9f2ab5e54121307d9496129f8719d41141a2.part --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/106c9f2ab5e54121307d9496129f8719d41141a2.part --force-share --output=json" returned: 0 in 0.224s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:22 user nova-compute[73078]: DEBUG nova.virt.images [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] 190ad26a-f669-44fa-8435-2cc3fd5b2a95 was qcow2, converting to raw {{(pid=73078) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 18:22:22 user nova-compute[73078]: DEBUG nova.privsep.utils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73078) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 18:22:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/106c9f2ab5e54121307d9496129f8719d41141a2.part /opt/stack/data/nova/instances/_base/106c9f2ab5e54121307d9496129f8719d41141a2.converted {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:22 user nova-compute[73078]: DEBUG nova.network.neutron [req-befeba34-48fc-4dfe-9fd9-31d9cf466754 req-d86a73f3-6185-4be7-8700-5ec8a6fe6fd1 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Updated VIF entry in instance network info cache for port 08a212c4-6236-4adc-a3ec-6b76341585b3. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:22:22 user nova-compute[73078]: DEBUG nova.network.neutron [req-befeba34-48fc-4dfe-9fd9-31d9cf466754 req-d86a73f3-6185-4be7-8700-5ec8a6fe6fd1 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Updating instance_info_cache with network_info: [{"id": "08a212c4-6236-4adc-a3ec-6b76341585b3", "address": "fa:16:3e:4f:04:0e", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a212c4-62", "ovs_interfaceid": "08a212c4-6236-4adc-a3ec-6b76341585b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:22:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-befeba34-48fc-4dfe-9fd9-31d9cf466754 req-d86a73f3-6185-4be7-8700-5ec8a6fe6fd1 service nova] Releasing lock "refresh_cache-4569b529-5c8f-45ec-94fe-58c60f6bcc8a" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:22:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:23 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/106c9f2ab5e54121307d9496129f8719d41141a2.part /opt/stack/data/nova/instances/_base/106c9f2ab5e54121307d9496129f8719d41141a2.converted" returned: 0 in 0.638s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:23 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/106c9f2ab5e54121307d9496129f8719d41141a2.converted --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:23 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/106c9f2ab5e54121307d9496129f8719d41141a2.converted --force-share --output=json" returned: 0 in 0.200s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "106c9f2ab5e54121307d9496129f8719d41141a2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.485s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:22:23 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/106c9f2ab5e54121307d9496129f8719d41141a2 --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:23 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/106c9f2ab5e54121307d9496129f8719d41141a2 --force-share --output=json" returned: 0 in 0.200s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "106c9f2ab5e54121307d9496129f8719d41141a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:22:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "106c9f2ab5e54121307d9496129f8719d41141a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:22:23 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/106c9f2ab5e54121307d9496129f8719d41141a2 --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:23 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/106c9f2ab5e54121307d9496129f8719d41141a2 --force-share --output=json" returned: 0 in 0.257s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:23 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/106c9f2ab5e54121307d9496129f8719d41141a2,backing_fmt=raw /opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:23 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/106c9f2ab5e54121307d9496129f8719d41141a2,backing_fmt=raw /opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/disk 1073741824" returned: 0 in 0.054s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "106c9f2ab5e54121307d9496129f8719d41141a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.319s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:22:23 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/106c9f2ab5e54121307d9496129f8719d41141a2 --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/106c9f2ab5e54121307d9496129f8719d41141a2 --force-share --output=json" returned: 0 in 0.203s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:24 user nova-compute[73078]: DEBUG nova.objects.instance [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lazy-loading 'migration_context' on Instance uuid 4569b529-5c8f-45ec-94fe-58c60f6bcc8a {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:22:24 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Rebasing disk image.
Aug 14 18:22:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.216s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd -F raw /opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/disk {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-24a720a9-f244-4d55-a294-be023f498a02 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Acquiring lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:22:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-24a720a9-f244-4d55-a294-be023f498a02 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:22:25 user nova-compute[73078]: INFO nova.compute.manager [None req-24a720a9-f244-4d55-a294-be023f498a02 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Detaching volume 2c94d393-5546-43fc-b05e-adcb5a32b032
Aug 14 18:22:25 user nova-compute[73078]: INFO nova.virt.block_device [None req-24a720a9-f244-4d55-a294-be023f498a02 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Attempting to driver detach volume 2c94d393-5546-43fc-b05e-adcb5a32b032 from mountpoint /dev/vdb
Aug 14 18:22:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-24a720a9-f244-4d55-a294-be023f498a02 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Attempting to detach device vdb from instance ea445c0c-e5a1-4e24-8008-2cd64a679f34 from the persistent domain config. {{(pid=73078) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-24a720a9-f244-4d55-a294-be023f498a02 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:22:25 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:22:25 user nova-compute[73078]:   <source dev="/dev/sdb"/>
Aug 14 18:22:25 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:22:25 user nova-compute[73078]:   <serial>2c94d393-5546-43fc-b05e-adcb5a32b032</serial>
Aug 14 18:22:25 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:22:25 user nova-compute[73078]: </disk>
Aug 14 18:22:25 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:22:25 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-24a720a9-f244-4d55-a294-be023f498a02 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Successfully detached device vdb from instance ea445c0c-e5a1-4e24-8008-2cd64a679f34 from the persistent domain config.
Aug 14 18:22:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-24a720a9-f244-4d55-a294-be023f498a02 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ea445c0c-e5a1-4e24-8008-2cd64a679f34 from the live domain config. {{(pid=73078) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-24a720a9-f244-4d55-a294-be023f498a02 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:22:25 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:22:25 user nova-compute[73078]:   <source dev="/dev/sdb"/>
Aug 14 18:22:25 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:22:25 user nova-compute[73078]:   <serial>2c94d393-5546-43fc-b05e-adcb5a32b032</serial>
Aug 14 18:22:25 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:22:25 user nova-compute[73078]: </disk>
Aug 14 18:22:25 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Received event <DeviceRemovedEvent: 1692037345.6259751, ea445c0c-e5a1-4e24-8008-2cd64a679f34 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73078) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-24a720a9-f244-4d55-a294-be023f498a02 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ea445c0c-e5a1-4e24-8008-2cd64a679f34 {{(pid=73078) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 18:22:25 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-24a720a9-f244-4d55-a294-be023f498a02 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Successfully detached device vdb from instance ea445c0c-e5a1-4e24-8008-2cd64a679f34 from the live domain config.
Aug 14 18:22:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24a720a9-f244-4d55-a294-be023f498a02 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a720a9-f244-4d55-a294-be023f498a02 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLhSxMQZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:22:25 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-24a720a9-f244-4d55-a294-be023f498a02 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:22:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-24a720a9-f244-4d55-a294-be023f498a02 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-24a720a9-f244-4d55-a294-be023f498a02 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a720a9-f244-4d55-a294-be023f498a02 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39f1559-bf77-4dc8-b40f-57781f91044d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e7b4e7-9ec6-4ee9-a649-b4dff8f9fef4]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a720a9-f244-4d55-a294-be023f498a02 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 (non-flash)
Aug 14 18:22:25 user nova-compute[73078]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 (non-flash)
Aug 14 18:22:25 user nova-compute[73078]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:22:25 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a720a9-f244-4d55-a294-be023f498a02 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 (non-flash)
Aug 14 18:22:25 user nova-compute[73078]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 (non-flash)
Aug 14 18:22:25 user nova-compute[73078]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:22:25 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a720a9-f244-4d55-a294-be023f498a02 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe99010c790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032'): ({'sdb'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-24a720a9-f244-4d55-a294-be023f498a02 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Removing single pathed devices sdb {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.044s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f890da8-d381-447b-af17-fabb468069fd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[355f480c-0d9a-4101-a34b-5300f58ad760]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-24a720a9-f244-4d55-a294-be023f498a02 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Flushing IO for device /dev/sdb {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c38b16-2cc4-4c1d-bea9-438856df8405]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-24a720a9-f244-4d55-a294-be023f498a02 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4022835b-35c7-4631-ad2c-10688f9b143e]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-24a720a9-f244-4d55-a294-be023f498a02 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-24a720a9-f244-4d55-a294-be023f498a02 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] SCSI volumes sdb have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a720a9-f244-4d55-a294-be023f498a02 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5070bd3-3c23-4be5-8d1d-754f7b93a64c]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a720a9-f244-4d55-a294-be023f498a02 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[55798ab5-f01c-4434-96b0-463794fcfc50]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a720a9-f244-4d55-a294-be023f498a02 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032, portal: 172.16.0.220,3260]
Aug 14 18:22:25 user nova-compute[73078]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032, portal: 172.16.0.220,3260] successful.
Aug 14 18:22:25 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c94d393-5546-43fc-b05e-adcb5a32b032 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74fb268-8253-449e-82ef-2f95ac548aef]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a720a9-f244-4d55-a294-be023f498a02 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-24a720a9-f244-4d55-a294-be023f498a02 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24a720a9-f244-4d55-a294-be023f498a02 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] <== disconnect_volume: return (347ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:22:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24a720a9-f244-4d55-a294-be023f498a02 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd -F raw /opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/disk" returned: 0 in 2.708s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Ensure instance console log exists: /opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Start _get_guest_xml network_info=[{"id": "08a212c4-6236-4adc-a3ec-6b76341585b3", "address": "fa:16:3e:4f:04:0e", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a212c4-62", "ovs_interfaceid": "08a212c4-6236-4adc-a3ec-6b76341585b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c7237162a7f61c5a9900ccc318cce670',container_format='bare',created_at=2023-08-14T18:20:24Z,direct_url=<?>,disk_format='qcow2',id=190ad26a-f669-44fa-8435-2cc3fd5b2a95,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-747135967-shelved',owner='5f00de2496804d6eb570f93307f3f088',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-14T18:20:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:22:27 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:22:27 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:22:27 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c7237162a7f61c5a9900ccc318cce670',container_format='bare',created_at=2023-08-14T18:20:24Z,direct_url=<?>,disk_format='qcow2',id=190ad26a-f669-44fa-8435-2cc3fd5b2a95,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-747135967-shelved',owner='5f00de2496804d6eb570f93307f3f088',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-14T18:20:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG nova.objects.instance [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4569b529-5c8f-45ec-94fe-58c60f6bcc8a {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T18:18:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-747135967',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-747135967',id=22,image_ref='190ad26a-f669-44fa-8435-2cc3fd5b2a95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-452969408',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:18:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5f00de2496804d6eb570f93307f3f088',ramdisk_id='',reservation_id='r-9qv8yi0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1593185714',owner_user_name='tempest-AttachVolumeShelveTestJSON-1593185714-project-member',shelved_at='2023-08-14T18:20:28.584128',shelved_host='user',shelved_image_id='190ad26a-f669-44fa-8435-2cc3fd5b2a95'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:22:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b07aecccb704835b6b765325b1d18bf',uuid=4569b529-5c8f-45ec-94fe-58c60f6bcc8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "08a212c4-6236-4adc-a3ec-6b76341585b3", "address": "fa:16:3e:4f:04:0e", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a212c4-62", "ovs_interfaceid": "08a212c4-6236-4adc-a3ec-6b76341585b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Converting VIF {"id": "08a212c4-6236-4adc-a3ec-6b76341585b3", "address": "fa:16:3e:4f:04:0e", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a212c4-62", "ovs_interfaceid": "08a212c4-6236-4adc-a3ec-6b76341585b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:04:0e,bridge_name='br-int',has_traffic_filtering=True,id=08a212c4-6236-4adc-a3ec-6b76341585b3,network=Network(a3adc062-ecf8-4c88-84ab-69425b236920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08a212c4-62') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG nova.objects.instance [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lazy-loading 'pci_devices' on Instance uuid 4569b529-5c8f-45ec-94fe-58c60f6bcc8a {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG nova.objects.instance [None req-24a720a9-f244-4d55-a294-be023f498a02 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lazy-loading 'flavor' on Instance uuid ea445c0c-e5a1-4e24-8008-2cd64a679f34 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:22:27 user nova-compute[73078]:   <uuid>4569b529-5c8f-45ec-94fe-58c60f6bcc8a</uuid>
Aug 14 18:22:27 user nova-compute[73078]:   <name>instance-00000016</name>
Aug 14 18:22:27 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:22:27 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:22:27 user nova-compute[73078]:   <metadata>
Aug 14 18:22:27 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:22:27 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:22:27 user nova-compute[73078]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-747135967</nova:name>
Aug 14 18:22:27 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:22:27</nova:creationTime>
Aug 14 18:22:27 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:22:27 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:22:27 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:22:27 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:22:27 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:22:27 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:22:27 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:22:27 user nova-compute[73078]:       <nova:owner>
Aug 14 18:22:27 user nova-compute[73078]:         <nova:user uuid="2b07aecccb704835b6b765325b1d18bf">tempest-AttachVolumeShelveTestJSON-1593185714-project-member</nova:user>
Aug 14 18:22:27 user nova-compute[73078]:         <nova:project uuid="5f00de2496804d6eb570f93307f3f088">tempest-AttachVolumeShelveTestJSON-1593185714</nova:project>
Aug 14 18:22:27 user nova-compute[73078]:       </nova:owner>
Aug 14 18:22:27 user nova-compute[73078]:       <nova:root type="image" uuid="190ad26a-f669-44fa-8435-2cc3fd5b2a95"/>
Aug 14 18:22:27 user nova-compute[73078]:       <nova:ports>
Aug 14 18:22:27 user nova-compute[73078]:         <nova:port uuid="08a212c4-6236-4adc-a3ec-6b76341585b3">
Aug 14 18:22:27 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 14 18:22:27 user nova-compute[73078]:         </nova:port>
Aug 14 18:22:27 user nova-compute[73078]:       </nova:ports>
Aug 14 18:22:27 user nova-compute[73078]:     </nova:instance>
Aug 14 18:22:27 user nova-compute[73078]:   </metadata>
Aug 14 18:22:27 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:22:27 user nova-compute[73078]:     <system>
Aug 14 18:22:27 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:22:27 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:22:27 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:22:27 user nova-compute[73078]:       <entry name="serial">4569b529-5c8f-45ec-94fe-58c60f6bcc8a</entry>
Aug 14 18:22:27 user nova-compute[73078]:       <entry name="uuid">4569b529-5c8f-45ec-94fe-58c60f6bcc8a</entry>
Aug 14 18:22:27 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:22:27 user nova-compute[73078]:     </system>
Aug 14 18:22:27 user nova-compute[73078]:   </sysinfo>
Aug 14 18:22:27 user nova-compute[73078]:   <os>
Aug 14 18:22:27 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:22:27 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:22:27 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:22:27 user nova-compute[73078]:   </os>
Aug 14 18:22:27 user nova-compute[73078]:   <features>
Aug 14 18:22:27 user nova-compute[73078]:     <acpi/>
Aug 14 18:22:27 user nova-compute[73078]:     <apic/>
Aug 14 18:22:27 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:22:27 user nova-compute[73078]:   </features>
Aug 14 18:22:27 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:22:27 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:22:27 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:22:27 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:22:27 user nova-compute[73078]:   </clock>
Aug 14 18:22:27 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:22:27 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:22:27 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:22:27 user nova-compute[73078]:   </cpu>
Aug 14 18:22:27 user nova-compute[73078]:   <devices>
Aug 14 18:22:27 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:22:27 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:22:27 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/disk"/>
Aug 14 18:22:27 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:22:27 user nova-compute[73078]:     </disk>
Aug 14 18:22:27 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:22:27 user nova-compute[73078]:       <mac address="fa:16:3e:4f:04:0e"/>
Aug 14 18:22:27 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:22:27 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:22:27 user nova-compute[73078]:       <target dev="tap08a212c4-62"/>
Aug 14 18:22:27 user nova-compute[73078]:     </interface>
Aug 14 18:22:27 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:22:27 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/console.log" append="off"/>
Aug 14 18:22:27 user nova-compute[73078]:     </serial>
Aug 14 18:22:27 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:22:27 user nova-compute[73078]:     <video>
Aug 14 18:22:27 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:22:27 user nova-compute[73078]:     </video>
Aug 14 18:22:27 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:22:27 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:22:27 user nova-compute[73078]:     </rng>
Aug 14 18:22:27 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:22:27 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:22:27 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:22:27 user nova-compute[73078]:     </memballoon>
Aug 14 18:22:27 user nova-compute[73078]:   </devices>
Aug 14 18:22:27 user nova-compute[73078]: </domain>
Aug 14 18:22:27 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T18:18:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-747135967',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-747135967',id=22,image_ref='190ad26a-f669-44fa-8435-2cc3fd5b2a95',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-452969408',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:18:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5f00de2496804d6eb570f93307f3f088',ramdisk_id='',reservation_id='r-9qv8yi0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1593185714',owner_user_name='tempest-AttachVolumeShelveTestJSON-1593185714-project-member',shelved_at='2023-08-14T18:20:28.584128',shelved_host='user',shelved_image_id='190ad26a-f669-44fa-8435-2cc3fd5b2a95'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:22:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b07aecccb704835b6b765325b1d18bf',uuid=4569b529-5c8f-45ec-94fe-58c60f6bcc8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "08a212c4-6236-4adc-a3ec-6b76341585b3", "address": "fa:16:3e:4f:04:0e", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a212c4-62", "ovs_interfaceid": "08a212c4-6236-4adc-a3ec-6b76341585b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Converting VIF {"id": "08a212c4-6236-4adc-a3ec-6b76341585b3", "address": "fa:16:3e:4f:04:0e", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a212c4-62", "ovs_interfaceid": "08a212c4-6236-4adc-a3ec-6b76341585b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:04:0e,bridge_name='br-int',has_traffic_filtering=True,id=08a212c4-6236-4adc-a3ec-6b76341585b3,network=Network(a3adc062-ecf8-4c88-84ab-69425b236920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08a212c4-62') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG os_vif [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:04:0e,bridge_name='br-int',has_traffic_filtering=True,id=08a212c4-6236-4adc-a3ec-6b76341585b3,network=Network(a3adc062-ecf8-4c88-84ab-69425b236920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08a212c4-62') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08a212c4-62, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap08a212c4-62, col_values=(('external_ids', {'iface-id': '08a212c4-6236-4adc-a3ec-6b76341585b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:04:0e', 'vm-uuid': '4569b529-5c8f-45ec-94fe-58c60f6bcc8a'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:27 user nova-compute[73078]: INFO os_vif [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:04:0e,bridge_name='br-int',has_traffic_filtering=True,id=08a212c4-6236-4adc-a3ec-6b76341585b3,network=Network(a3adc062-ecf8-4c88-84ab-69425b236920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08a212c4-62')
Aug 14 18:22:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-24a720a9-f244-4d55-a294-be023f498a02 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.244s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:22:27 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] No VIF found with MAC fa:16:3e:4f:04:0e, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:22:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:28 user nova-compute[73078]: DEBUG nova.compute.manager [req-342bd327-c556-4911-80a5-909df851966b req-310f2d9b-b368-4da8-9d2c-9698c171e971 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Received event network-vif-plugged-08a212c4-6236-4adc-a3ec-6b76341585b3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:22:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-342bd327-c556-4911-80a5-909df851966b req-310f2d9b-b368-4da8-9d2c-9698c171e971 service nova] Acquiring lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:22:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-342bd327-c556-4911-80a5-909df851966b req-310f2d9b-b368-4da8-9d2c-9698c171e971 service nova] Lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:22:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-342bd327-c556-4911-80a5-909df851966b req-310f2d9b-b368-4da8-9d2c-9698c171e971 service nova] Lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:22:28 user nova-compute[73078]: DEBUG nova.compute.manager [req-342bd327-c556-4911-80a5-909df851966b req-310f2d9b-b368-4da8-9d2c-9698c171e971 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] No waiting events found dispatching network-vif-plugged-08a212c4-6236-4adc-a3ec-6b76341585b3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:22:28 user nova-compute[73078]: WARNING nova.compute.manager [req-342bd327-c556-4911-80a5-909df851966b req-310f2d9b-b368-4da8-9d2c-9698c171e971 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Received unexpected event network-vif-plugged-08a212c4-6236-4adc-a3ec-6b76341585b3 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 18:22:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:30 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037350.9112277, 4569b529-5c8f-45ec-94fe-58c60f6bcc8a => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:22:30 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] VM Resumed (Lifecycle Event)
Aug 14 18:22:30 user nova-compute[73078]: DEBUG nova.compute.manager [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:22:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:22:30 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Instance spawned successfully.
Aug 14 18:22:30 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:22:30 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:22:30 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:22:30 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037350.913258, 4569b529-5c8f-45ec-94fe-58c60f6bcc8a => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:22:30 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] VM Started (Lifecycle Event)
Aug 14 18:22:30 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:22:30 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:22:31 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:22:31 user nova-compute[73078]: DEBUG nova.compute.manager [req-dca0e7bb-f4fa-4368-94a1-5ded1241fdf6 req-0c4a8d81-1113-47b8-9d05-611a7a72a585 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Received event network-vif-plugged-08a212c4-6236-4adc-a3ec-6b76341585b3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:22:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-dca0e7bb-f4fa-4368-94a1-5ded1241fdf6 req-0c4a8d81-1113-47b8-9d05-611a7a72a585 service nova] Acquiring lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:22:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-dca0e7bb-f4fa-4368-94a1-5ded1241fdf6 req-0c4a8d81-1113-47b8-9d05-611a7a72a585 service nova] Lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:22:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-dca0e7bb-f4fa-4368-94a1-5ded1241fdf6 req-0c4a8d81-1113-47b8-9d05-611a7a72a585 service nova] Lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:22:31 user nova-compute[73078]: DEBUG nova.compute.manager [req-dca0e7bb-f4fa-4368-94a1-5ded1241fdf6 req-0c4a8d81-1113-47b8-9d05-611a7a72a585 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] No waiting events found dispatching network-vif-plugged-08a212c4-6236-4adc-a3ec-6b76341585b3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:22:31 user nova-compute[73078]: WARNING nova.compute.manager [req-dca0e7bb-f4fa-4368-94a1-5ded1241fdf6 req-0c4a8d81-1113-47b8-9d05-611a7a72a585 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Received unexpected event network-vif-plugged-08a212c4-6236-4adc-a3ec-6b76341585b3 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 18:22:31 user nova-compute[73078]: DEBUG nova.compute.manager [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:22:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-42df1f0d-77b9-49c8-bc3f-7d9620c8dcbe tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.285s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:22:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Acquiring lock "ef110d5f-afb5-415c-9590-29da006734a9" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:22:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lock "ef110d5f-afb5-415c-9590-29da006734a9" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:22:37 user nova-compute[73078]: INFO nova.compute.manager [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Unshelving
Aug 14 18:22:38 user nova-compute[73078]: INFO nova.virt.block_device [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Booting with volume a26fa6ac-06c8-4563-bcc9-ea19c5604eac at /dev/vda
Aug 14 18:22:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:38 user nova-compute[73078]: DEBUG os_brick.utils [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:22:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:38 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b347db30-1555-404e-97bd-630bf59b8014]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:38 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5b1f2a-dd41-41ef-9823-0297d36de176]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:38 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cf7fbf-9a9a-4951-94dd-594ff7cf27c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:38 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d136025c-df53-4b53-b719-6b5f58f8e237]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:22:38 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:22:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:22:38 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:22:38 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[22600e84-4495-4ee2-b3a9-ca0464f374fd]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:38 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:22:38 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:22:38 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:22:38 user nova-compute[73078]: DEBUG os_brick.utils [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:22:38 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Updating existing volume attachment record: f3c643c7-bdcc-4693-8f55-5e134a2ee2dd {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:22:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "8ebc48e0-0a24-4421-b180-f14eacc636ad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:22:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "8ebc48e0-0a24-4421-b180-f14eacc636ad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:22:41 user nova-compute[73078]: DEBUG nova.compute.manager [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:22:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:22:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:22:41 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:22:41 user nova-compute[73078]: INFO nova.compute.claims [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Claim successful on node user
Aug 14 18:22:41 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:22:41 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:22:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.800s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:22:42 user nova-compute[73078]: DEBUG nova.compute.manager [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:22:42 user nova-compute[73078]: DEBUG nova.compute.manager [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:22:42 user nova-compute[73078]: DEBUG nova.network.neutron [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:22:42 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:22:42 user nova-compute[73078]: DEBUG nova.compute.manager [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:22:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:42 user nova-compute[73078]: INFO nova.virt.block_device [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Booting with volume 394c2c9e-1cec-4548-8c12-2699fdd049cb at /dev/vda
Aug 14 18:22:42 user nova-compute[73078]: DEBUG nova.policy [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0cca1112ab354f9fb31658e18c0d03b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993dd55f40454640824687ffb6a3c581', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:22:42 user nova-compute[73078]: DEBUG os_brick.utils [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:22:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59072cc-3647-4c0a-a477-1ff31d4599e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60b302b-7f7a-40d0-8ef8-c8e0f0c0a0bd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3de9adb-bfa3-4d8e-a932-4ecd32f109a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[058b2a60-16ef-4231-805a-6b2ab4e15e80]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:22:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:22:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:22:42 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:22:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6c3815-a1a7-407b-8b0d-b4424bb41858]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:22:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:22:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:22:42 user nova-compute[73078]: DEBUG os_brick.utils [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:22:42 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Updating existing volume attachment record: dbb076ca-70bf-40ff-bab8-736f486e9b9d {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:22:42 user nova-compute[73078]: DEBUG nova.network.neutron [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Successfully created port: de400e10-3372-4eb4-b121-48ed70e471d3 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:22:43 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:43 user nova-compute[73078]: DEBUG nova.network.neutron [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Successfully updated port: de400e10-3372-4eb4-b121-48ed70e471d3 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:22:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "refresh_cache-8ebc48e0-0a24-4421-b180-f14eacc636ad" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:22:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquired lock "refresh_cache-8ebc48e0-0a24-4421-b180-f14eacc636ad" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:22:43 user nova-compute[73078]: DEBUG nova.network.neutron [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:22:43 user nova-compute[73078]: DEBUG nova.compute.manager [req-c731ac80-ba55-4f35-a393-b0f1c66b4a65 req-2204912b-ac12-4c25-ac8e-ae5ec84af3d7 service nova] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Received event network-changed-de400e10-3372-4eb4-b121-48ed70e471d3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:22:43 user nova-compute[73078]: DEBUG nova.compute.manager [req-c731ac80-ba55-4f35-a393-b0f1c66b4a65 req-2204912b-ac12-4c25-ac8e-ae5ec84af3d7 service nova] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Refreshing instance network info cache due to event network-changed-de400e10-3372-4eb4-b121-48ed70e471d3. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:22:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-c731ac80-ba55-4f35-a393-b0f1c66b4a65 req-2204912b-ac12-4c25-ac8e-ae5ec84af3d7 service nova] Acquiring lock "refresh_cache-8ebc48e0-0a24-4421-b180-f14eacc636ad" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:22:43 user nova-compute[73078]: DEBUG nova.network.neutron [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:22:44 user nova-compute[73078]: DEBUG nova.network.neutron [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Updating instance_info_cache with network_info: [{"id": "de400e10-3372-4eb4-b121-48ed70e471d3", "address": "fa:16:3e:9d:54:60", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde400e10-33", "ovs_interfaceid": "de400e10-3372-4eb4-b121-48ed70e471d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:22:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Releasing lock "refresh_cache-8ebc48e0-0a24-4421-b180-f14eacc636ad" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:22:44 user nova-compute[73078]: DEBUG nova.compute.manager [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Instance network_info: |[{"id": "de400e10-3372-4eb4-b121-48ed70e471d3", "address": "fa:16:3e:9d:54:60", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde400e10-33", "ovs_interfaceid": "de400e10-3372-4eb4-b121-48ed70e471d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:22:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-c731ac80-ba55-4f35-a393-b0f1c66b4a65 req-2204912b-ac12-4c25-ac8e-ae5ec84af3d7 service nova] Acquired lock "refresh_cache-8ebc48e0-0a24-4421-b180-f14eacc636ad" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:22:44 user nova-compute[73078]: DEBUG nova.network.neutron [req-c731ac80-ba55-4f35-a393-b0f1c66b4a65 req-2204912b-ac12-4c25-ac8e-ae5ec84af3d7 service nova] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Refreshing network info cache for port de400e10-3372-4eb4-b121-48ed70e471d3 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:22:44 user nova-compute[73078]: DEBUG nova.network.neutron [req-c731ac80-ba55-4f35-a393-b0f1c66b4a65 req-2204912b-ac12-4c25-ac8e-ae5ec84af3d7 service nova] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Updated VIF entry in instance network info cache for port de400e10-3372-4eb4-b121-48ed70e471d3. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:22:44 user nova-compute[73078]: DEBUG nova.network.neutron [req-c731ac80-ba55-4f35-a393-b0f1c66b4a65 req-2204912b-ac12-4c25-ac8e-ae5ec84af3d7 service nova] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Updating instance_info_cache with network_info: [{"id": "de400e10-3372-4eb4-b121-48ed70e471d3", "address": "fa:16:3e:9d:54:60", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde400e10-33", "ovs_interfaceid": "de400e10-3372-4eb4-b121-48ed70e471d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:22:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-c731ac80-ba55-4f35-a393-b0f1c66b4a65 req-2204912b-ac12-4c25-ac8e-ae5ec84af3d7 service nova] Releasing lock "refresh_cache-8ebc48e0-0a24-4421-b180-f14eacc636ad" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:22:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:22:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:22:47 user nova-compute[73078]: DEBUG nova.objects.instance [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lazy-loading 'pci_requests' on Instance uuid ef110d5f-afb5-415c-9590-29da006734a9 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:22:47 user nova-compute[73078]: DEBUG nova.objects.instance [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lazy-loading 'numa_topology' on Instance uuid ef110d5f-afb5-415c-9590-29da006734a9 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:22:47 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:22:47 user nova-compute[73078]: INFO nova.compute.claims [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Claim successful on node user
Aug 14 18:22:48 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:22:48 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:22:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:22:48 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:22:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:48 user nova-compute[73078]: INFO nova.network.neutron [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Updating port 6adf2de6-8801-4cc9-ab39-9a521201ca8a with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 14 18:22:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Acquiring lock "refresh_cache-ef110d5f-afb5-415c-9590-29da006734a9" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:22:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Acquired lock "refresh_cache-ef110d5f-afb5-415c-9590-29da006734a9" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:22:48 user nova-compute[73078]: DEBUG nova.network.neutron [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:22:48 user nova-compute[73078]: DEBUG nova.compute.manager [req-72f9ff77-c60a-4af7-894f-ae323da82709 req-25915151-3347-4ff5-8566-d530ae36b3f0 service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Received event network-changed-6adf2de6-8801-4cc9-ab39-9a521201ca8a {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:22:48 user nova-compute[73078]: DEBUG nova.compute.manager [req-72f9ff77-c60a-4af7-894f-ae323da82709 req-25915151-3347-4ff5-8566-d530ae36b3f0 service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Refreshing instance network info cache due to event network-changed-6adf2de6-8801-4cc9-ab39-9a521201ca8a. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:22:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-72f9ff77-c60a-4af7-894f-ae323da82709 req-25915151-3347-4ff5-8566-d530ae36b3f0 service nova] Acquiring lock "refresh_cache-ef110d5f-afb5-415c-9590-29da006734a9" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG nova.network.neutron [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Updating instance_info_cache with network_info: [{"id": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "address": "fa:16:3e:b7:d1:09", "network": {"id": "7ba1366f-4346-4830-ae29-621591ee55ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-525338528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a97c5c314a94a52b01778d69561d862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6adf2de6-88", "ovs_interfaceid": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Releasing lock "refresh_cache-ef110d5f-afb5-415c-9590-29da006734a9" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:22:49 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Creating image(s)
Aug 14 18:22:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Did not create local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Ensure instance console log exists: /opt/stack/data/nova/instances/ef110d5f-afb5-415c-9590-29da006734a9/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Start _get_guest_xml network_info=[{"id": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "address": "fa:16:3e:b7:d1:09", "network": {"id": "7ba1366f-4346-4830-ae29-621591ee55ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-525338528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a97c5c314a94a52b01778d69561d862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6adf2de6-88", "ovs_interfaceid": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'f3c643c7-bdcc-4693-8f55-5e134a2ee2dd', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bCVKUxwE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ef110d5f-afb5-415c-9590-29da006734a9', 'attached_at': '', 'detached_at': '', 'volume_id': 'a26fa6ac-06c8-4563-bcc9-ea19c5604eac', 'serial': 'a26fa6ac-06c8-4563-bcc9-ea19c5604eac'}, 'volume_type': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-72f9ff77-c60a-4af7-894f-ae323da82709 req-25915151-3347-4ff5-8566-d530ae36b3f0 service nova] Acquired lock "refresh_cache-ef110d5f-afb5-415c-9590-29da006734a9" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG nova.network.neutron [req-72f9ff77-c60a-4af7-894f-ae323da82709 req-25915151-3347-4ff5-8566-d530ae36b3f0 service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Refreshing network info cache for port 6adf2de6-8801-4cc9-ab39-9a521201ca8a {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:22:49 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:22:49 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:22:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG nova.objects.instance [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lazy-loading 'vcpu_model' on Instance uuid ef110d5f-afb5-415c-9590-29da006734a9 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bCVKUxwE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:22:49 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:22:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:22:49 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:22:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:22:49 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0897f810-deb4-4dab-8945-d935cf5da0eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:22:49 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6982b79-f4e5-4fc8-8636-e8e675a866f5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac] added
Aug 14 18:22:49 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[959c7d92-2955-4a7a-900a-7112b87ca051]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc896966-851f-4a2e-9e5f-e082b4f2025a]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bCVKUxwE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bCVKUxwE" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3570a038-6a5d-4bd2-9e0d-21d04f553202]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bCVKUxwE'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0823237f-4699-434b-a398-224ff335a9d7]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3a6c15-7e24-4d40-a3d6-e54ce1a61c90]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 (non-flash)
Aug 14 18:22:49 user nova-compute[73078]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:22:49 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 (non-flash)
Aug 14 18:22:49 user nova-compute[73078]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:22:49 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0f8251-0eb3-4ef8-aea2-aa91dd4e8241]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac, portal: 172.16.0.220,3260]
Aug 14 18:22:49 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac, portal: 172.16.0.220,3260] successful.
Aug 14 18:22:49 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d00d312-4473-48e8-bff4-68bd286de815]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58733f0-bb1a-4a69-8dec-9914c3ca1d2a]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 (non-flash)
Aug 14 18:22:49 user nova-compute[73078]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:22:49 user nova-compute[73078]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:22:49 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 (non-flash)
Aug 14 18:22:49 user nova-compute[73078]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:22:49 user nova-compute[73078]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:22:49 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e441aaf8-ba66-4c68-8844-e60a0968c3b9]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bCVKUxwE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG nova.network.neutron [req-72f9ff77-c60a-4af7-894f-ae323da82709 req-25915151-3347-4ff5-8566-d530ae36b3f0 service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Updated VIF entry in instance network info cache for port 6adf2de6-8801-4cc9-ab39-9a521201ca8a. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG nova.network.neutron [req-72f9ff77-c60a-4af7-894f-ae323da82709 req-25915151-3347-4ff5-8566-d530ae36b3f0 service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Updating instance_info_cache with network_info: [{"id": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "address": "fa:16:3e:b7:d1:09", "network": {"id": "7ba1366f-4346-4830-ae29-621591ee55ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-525338528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a97c5c314a94a52b01778d69561d862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6adf2de6-88", "ovs_interfaceid": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:22:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-72f9ff77-c60a-4af7-894f-ae323da82709 req-25915151-3347-4ff5-8566-d530ae36b3f0 service nova] Releasing lock "refresh_cache-ef110d5f-afb5-415c-9590-29da006734a9" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:22:50 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:22:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:22:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:22:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:22:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:22:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:22:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23563636336326533', 'path': '/dev/sdb'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:22:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563636336326533', 'path': '/dev/sdb'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:22:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T18:18:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1130985749',display_name='tempest-TestShelveInstance-server-1130985749',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1130985749',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-979618800',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:19:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4a97c5c314a94a52b01778d69561d862',ramdisk_id='',reservation_id='r-lm0zi19n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1474594410',owner_user_name='tempest-TestShelveInstance-1474594410-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:22:38Z,user_data=None,user_id='006108eda23a45df96d06af8cc7c3b42',uuid=ef110d5f-afb5-415c-9590-29da006734a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "address": "fa:16:3e:b7:d1:09", "network": {"id": "7ba1366f-4346-4830-ae29-621591ee55ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-525338528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a97c5c314a94a52b01778d69561d862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6adf2de6-88", "ovs_interfaceid": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:22:50 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Converting VIF {"id": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "address": "fa:16:3e:b7:d1:09", "network": {"id": "7ba1366f-4346-4830-ae29-621591ee55ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-525338528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a97c5c314a94a52b01778d69561d862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6adf2de6-88", "ovs_interfaceid": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:22:50 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:d1:09,bridge_name='br-int',has_traffic_filtering=True,id=6adf2de6-8801-4cc9-ab39-9a521201ca8a,network=Network(7ba1366f-4346-4830-ae29-621591ee55ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6adf2de6-88') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:22:50 user nova-compute[73078]: DEBUG nova.objects.instance [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lazy-loading 'pci_devices' on Instance uuid ef110d5f-afb5-415c-9590-29da006734a9 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:22:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:22:50 user nova-compute[73078]:   <uuid>ef110d5f-afb5-415c-9590-29da006734a9</uuid>
Aug 14 18:22:50 user nova-compute[73078]:   <name>instance-00000018</name>
Aug 14 18:22:50 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:22:50 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:22:50 user nova-compute[73078]:   <metadata>
Aug 14 18:22:50 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:22:50 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:22:50 user nova-compute[73078]:       <nova:name>tempest-TestShelveInstance-server-1130985749</nova:name>
Aug 14 18:22:50 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:22:49</nova:creationTime>
Aug 14 18:22:50 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:22:50 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:22:50 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:22:50 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:22:50 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:22:50 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:22:50 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:22:50 user nova-compute[73078]:       <nova:owner>
Aug 14 18:22:50 user nova-compute[73078]:         <nova:user uuid="006108eda23a45df96d06af8cc7c3b42">tempest-TestShelveInstance-1474594410-project-member</nova:user>
Aug 14 18:22:50 user nova-compute[73078]:         <nova:project uuid="4a97c5c314a94a52b01778d69561d862">tempest-TestShelveInstance-1474594410</nova:project>
Aug 14 18:22:50 user nova-compute[73078]:       </nova:owner>
Aug 14 18:22:50 user nova-compute[73078]:       <nova:ports>
Aug 14 18:22:50 user nova-compute[73078]:         <nova:port uuid="6adf2de6-8801-4cc9-ab39-9a521201ca8a">
Aug 14 18:22:50 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 18:22:50 user nova-compute[73078]:         </nova:port>
Aug 14 18:22:50 user nova-compute[73078]:       </nova:ports>
Aug 14 18:22:50 user nova-compute[73078]:     </nova:instance>
Aug 14 18:22:50 user nova-compute[73078]:   </metadata>
Aug 14 18:22:50 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:22:50 user nova-compute[73078]:     <system>
Aug 14 18:22:50 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:22:50 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:22:50 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:22:50 user nova-compute[73078]:       <entry name="serial">ef110d5f-afb5-415c-9590-29da006734a9</entry>
Aug 14 18:22:50 user nova-compute[73078]:       <entry name="uuid">ef110d5f-afb5-415c-9590-29da006734a9</entry>
Aug 14 18:22:50 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:22:50 user nova-compute[73078]:     </system>
Aug 14 18:22:50 user nova-compute[73078]:   </sysinfo>
Aug 14 18:22:50 user nova-compute[73078]:   <os>
Aug 14 18:22:50 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:22:50 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:22:50 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:22:50 user nova-compute[73078]:   </os>
Aug 14 18:22:50 user nova-compute[73078]:   <features>
Aug 14 18:22:50 user nova-compute[73078]:     <acpi/>
Aug 14 18:22:50 user nova-compute[73078]:     <apic/>
Aug 14 18:22:50 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:22:50 user nova-compute[73078]:   </features>
Aug 14 18:22:50 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:22:50 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:22:50 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:22:50 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:22:50 user nova-compute[73078]:   </clock>
Aug 14 18:22:50 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:22:50 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:22:50 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:22:50 user nova-compute[73078]:   </cpu>
Aug 14 18:22:50 user nova-compute[73078]:   <devices>
Aug 14 18:22:50 user nova-compute[73078]:     <disk type="block" device="disk">
Aug 14 18:22:50 user nova-compute[73078]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:22:50 user nova-compute[73078]:       <source dev="/dev/sdb"/>
Aug 14 18:22:50 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:22:50 user nova-compute[73078]:       <serial>a26fa6ac-06c8-4563-bcc9-ea19c5604eac</serial>
Aug 14 18:22:50 user nova-compute[73078]:     </disk>
Aug 14 18:22:50 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:22:50 user nova-compute[73078]:       <mac address="fa:16:3e:b7:d1:09"/>
Aug 14 18:22:50 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:22:50 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:22:50 user nova-compute[73078]:       <target dev="tap6adf2de6-88"/>
Aug 14 18:22:50 user nova-compute[73078]:     </interface>
Aug 14 18:22:50 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:22:50 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/ef110d5f-afb5-415c-9590-29da006734a9/console.log" append="off"/>
Aug 14 18:22:50 user nova-compute[73078]:     </serial>
Aug 14 18:22:50 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:22:50 user nova-compute[73078]:     <video>
Aug 14 18:22:50 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:22:50 user nova-compute[73078]:     </video>
Aug 14 18:22:50 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:22:50 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:22:50 user nova-compute[73078]:     </rng>
Aug 14 18:22:50 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:22:50 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:22:50 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:22:50 user nova-compute[73078]:     </memballoon>
Aug 14 18:22:50 user nova-compute[73078]:   </devices>
Aug 14 18:22:50 user nova-compute[73078]: </domain>
Aug 14 18:22:50 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:22:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T18:18:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1130985749',display_name='tempest-TestShelveInstance-server-1130985749',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1130985749',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-979618800',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:19:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4a97c5c314a94a52b01778d69561d862',ramdisk_id='',reservation_id='r-lm0zi19n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1474594410',owner_user_name='tempest-TestShelveInstance-1474594410-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:22:38Z,user_data=None,user_id='006108eda23a45df96d06af8cc7c3b42',uuid=ef110d5f-afb5-415c-9590-29da006734a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "address": "fa:16:3e:b7:d1:09", "network": {"id": "7ba1366f-4346-4830-ae29-621591ee55ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-525338528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a97c5c314a94a52b01778d69561d862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6adf2de6-88", "ovs_interfaceid": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:22:50 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Converting VIF {"id": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "address": "fa:16:3e:b7:d1:09", "network": {"id": "7ba1366f-4346-4830-ae29-621591ee55ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-525338528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a97c5c314a94a52b01778d69561d862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6adf2de6-88", "ovs_interfaceid": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:22:50 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:d1:09,bridge_name='br-int',has_traffic_filtering=True,id=6adf2de6-8801-4cc9-ab39-9a521201ca8a,network=Network(7ba1366f-4346-4830-ae29-621591ee55ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6adf2de6-88') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:22:50 user nova-compute[73078]: DEBUG os_vif [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:d1:09,bridge_name='br-int',has_traffic_filtering=True,id=6adf2de6-8801-4cc9-ab39-9a521201ca8a,network=Network(7ba1366f-4346-4830-ae29-621591ee55ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6adf2de6-88') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:22:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:22:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:22:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6adf2de6-88, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:22:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6adf2de6-88, col_values=(('external_ids', {'iface-id': '6adf2de6-8801-4cc9-ab39-9a521201ca8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:d1:09', 'vm-uuid': 'ef110d5f-afb5-415c-9590-29da006734a9'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:22:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:22:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:50 user nova-compute[73078]: INFO os_vif [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:d1:09,bridge_name='br-int',has_traffic_filtering=True,id=6adf2de6-8801-4cc9-ab39-9a521201ca8a,network=Network(7ba1366f-4346-4830-ae29-621591ee55ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6adf2de6-88')
Aug 14 18:22:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:22:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] No VIF found with MAC fa:16:3e:b7:d1:09, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:22:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk (vdb) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:22:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf1ea7-e7d7-4499-b340-689d25667899/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf1ea7-e7d7-4499-b340-689d25667899/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf1ea7-e7d7-4499-b340-689d25667899/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf1ea7-e7d7-4499-b340-689d25667899/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG nova.compute.manager [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:22:52 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Creating image(s)
Aug 14 18:22:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Did not create local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Ensure instance console log exists: /opt/stack/data/nova/instances/8ebc48e0-0a24-4421-b180-f14eacc636ad/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Start _get_guest_xml network_info=[{"id": "de400e10-3372-4eb4-b121-48ed70e471d3", "address": "fa:16:3e:9d:54:60", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde400e10-33", "ovs_interfaceid": "de400e10-3372-4eb4-b121-48ed70e471d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'dbb076ca-70bf-40ff-bab8-736f486e9b9d', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxmiXRqA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8ebc48e0-0a24-4421-b180-f14eacc636ad', 'attached_at': '', 'detached_at': '', 'volume_id': '394c2c9e-1cec-4548-8c12-2699fdd049cb', 'serial': '394c2c9e-1cec-4548-8c12-2699fdd049cb'}, 'volume_type': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:22:52 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:22:52 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:22:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxmiXRqA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:22:52 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:22:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:22:52 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:22:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:22:52 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[571c5c36-423c-4c85-91ea-cd3dfa772b31]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG nova.compute.manager [req-4fb40298-846f-4244-bd8e-7ab307adedb5 req-8dc9189e-7d9c-47a6-862c-a9a4a3dfb555 service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Received event network-vif-plugged-6adf2de6-8801-4cc9-ab39-9a521201ca8a {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4fb40298-846f-4244-bd8e-7ab307adedb5 req-8dc9189e-7d9c-47a6-862c-a9a4a3dfb555 service nova] Acquiring lock "ef110d5f-afb5-415c-9590-29da006734a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4fb40298-846f-4244-bd8e-7ab307adedb5 req-8dc9189e-7d9c-47a6-862c-a9a4a3dfb555 service nova] Lock "ef110d5f-afb5-415c-9590-29da006734a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4fb40298-846f-4244-bd8e-7ab307adedb5 req-8dc9189e-7d9c-47a6-862c-a9a4a3dfb555 service nova] Lock "ef110d5f-afb5-415c-9590-29da006734a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG nova.compute.manager [req-4fb40298-846f-4244-bd8e-7ab307adedb5 req-8dc9189e-7d9c-47a6-862c-a9a4a3dfb555 service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] No waiting events found dispatching network-vif-plugged-6adf2de6-8801-4cc9-ab39-9a521201ca8a {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:22:52 user nova-compute[73078]: WARNING nova.compute.manager [req-4fb40298-846f-4244-bd8e-7ab307adedb5 req-8dc9189e-7d9c-47a6-862c-a9a4a3dfb555 service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Received unexpected event network-vif-plugged-6adf2de6-8801-4cc9-ab39-9a521201ca8a for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 18:22:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:22:52 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[281e8c67-09c3-42eb-b0a1-5d31f0d42ca1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb] added
Aug 14 18:22:52 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[11eddcd2-a0f0-468a-bc53-1a93da10adc6]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37fa8fe-5111-4214-8bc3-9cee3f301f63]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PxmiXRqA {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PxmiXRqA" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbb44d1-c22e-4bd1-91d5-6cebdf8644a3]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PxmiXRqA'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b160df-f087-4ca5-99c6-c3236cc96124]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7390ace5-6d64-47a3-addd-243618de7a00]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 (non-flash)
Aug 14 18:22:52 user nova-compute[73078]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:22:52 user nova-compute[73078]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:22:52 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 (non-flash)
Aug 14 18:22:52 user nova-compute[73078]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:22:52 user nova-compute[73078]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:22:52 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a170f999-f0b8-4b02-b19b-3e99d2e00e07]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb, portal: 172.16.0.220,3260]
Aug 14 18:22:52 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb, portal: 172.16.0.220,3260] successful.
Aug 14 18:22:52 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5b5448-a610-4ee4-bdc3-231febca84cc]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae76a75-98ec-4475-8aa3-e89669056161]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 (non-flash)
Aug 14 18:22:52 user nova-compute[73078]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:22:52 user nova-compute[73078]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:22:52 user nova-compute[73078]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:22:52 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 (non-flash)
Aug 14 18:22:52 user nova-compute[73078]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:22:52 user nova-compute[73078]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:22:52 user nova-compute[73078]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:22:52 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.396s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab43e7b-12df-4bb9-8f02-66b339f93c85]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: None {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:53 user nova-compute[73078]: DEBUG nova.compute.manager [req-8b7a05e6-7da9-4629-93d6-3431204b283a req-4402665c-75c2-408f-929f-063462ae3ddd service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Received event network-changed-183ecc4d-2001-4254-9f1b-af3a43c362dc {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:22:53 user nova-compute[73078]: DEBUG nova.compute.manager [req-8b7a05e6-7da9-4629-93d6-3431204b283a req-4402665c-75c2-408f-929f-063462ae3ddd service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Refreshing instance network info cache due to event network-changed-183ecc4d-2001-4254-9f1b-af3a43c362dc. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:22:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-8b7a05e6-7da9-4629-93d6-3431204b283a req-4402665c-75c2-408f-929f-063462ae3ddd service nova] Acquiring lock "refresh_cache-f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:22:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-8b7a05e6-7da9-4629-93d6-3431204b283a req-4402665c-75c2-408f-929f-063462ae3ddd service nova] Acquired lock "refresh_cache-f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:22:53 user nova-compute[73078]: DEBUG nova.network.neutron [req-8b7a05e6-7da9-4629-93d6-3431204b283a req-4402665c-75c2-408f-929f-063462ae3ddd service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Refreshing network info cache for port 183ecc4d-2001-4254-9f1b-af3a43c362dc {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:22:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:53 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:22:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxmiXRqA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:22:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.434s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:22:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] <== connect_volume: return (1436ms) {'type': 'block', 'scsi_wwn': '23364613930663831', 'path': '/dev/sde'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:22:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364613930663831', 'path': '/dev/sde'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:22:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:22:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1344711315',display_name='tempest-ServerActionsTestOtherA-server-1344711315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1344711315',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuBLKmid5aFtC8N9oGYPXkgiYGtDjSt/w1+99DQRyNH3SIh+uGteRP9ufywJ7TgR1607B3dJ2h6LnLGhohKOdL1yNPsWQsmTBErDFfyfHJa2VycZ+ceyQwLi9NhHpa6xg==',key_name='tempest-keypair-1366091689',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='993dd55f40454640824687ffb6a3c581',ramdisk_id='',reservation_id='r-o28i8x37',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1876890021',owner_user_name='tempest-ServerActionsTestOtherA-1876890021-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:22:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cca1112ab354f9fb31658e18c0d03b1',uuid=8ebc48e0-0a24-4421-b180-f14eacc636ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de400e10-3372-4eb4-b121-48ed70e471d3", "address": "fa:16:3e:9d:54:60", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde400e10-33", "ovs_interfaceid": "de400e10-3372-4eb4-b121-48ed70e471d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:22:53 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Converting VIF {"id": "de400e10-3372-4eb4-b121-48ed70e471d3", "address": "fa:16:3e:9d:54:60", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde400e10-33", "ovs_interfaceid": "de400e10-3372-4eb4-b121-48ed70e471d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:22:53 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:54:60,bridge_name='br-int',has_traffic_filtering=True,id=de400e10-3372-4eb4-b121-48ed70e471d3,network=Network(bfef9745-5a40-44b6-a6d5-2ef1e77fc5db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde400e10-33') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:22:53 user nova-compute[73078]: DEBUG nova.objects.instance [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ebc48e0-0a24-4421-b180-f14eacc636ad {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:22:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG nova.network.neutron [req-8b7a05e6-7da9-4629-93d6-3431204b283a req-4402665c-75c2-408f-929f-063462ae3ddd service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Updated VIF entry in instance network info cache for port 183ecc4d-2001-4254-9f1b-af3a43c362dc. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG nova.network.neutron [req-8b7a05e6-7da9-4629-93d6-3431204b283a req-4402665c-75c2-408f-929f-063462ae3ddd service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Updating instance_info_cache with network_info: [{"id": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "address": "fa:16:3e:4a:28:05", "network": {"id": "4c337404-9329-43e7-bed1-7b5dc32f6cd9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-902748542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6461284f1d491c9cd726d8550a445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183ecc4d-20", "ovs_interfaceid": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:22:54 user nova-compute[73078]:   <uuid>8ebc48e0-0a24-4421-b180-f14eacc636ad</uuid>
Aug 14 18:22:54 user nova-compute[73078]:   <name>instance-0000001d</name>
Aug 14 18:22:54 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:22:54 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:22:54 user nova-compute[73078]:   <metadata>
Aug 14 18:22:54 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:22:54 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:22:54 user nova-compute[73078]:       <nova:name>tempest-ServerActionsTestOtherA-server-1344711315</nova:name>
Aug 14 18:22:54 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:22:52</nova:creationTime>
Aug 14 18:22:54 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:22:54 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:22:54 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:22:54 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:22:54 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:22:54 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:22:54 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:22:54 user nova-compute[73078]:       <nova:owner>
Aug 14 18:22:54 user nova-compute[73078]:         <nova:user uuid="0cca1112ab354f9fb31658e18c0d03b1">tempest-ServerActionsTestOtherA-1876890021-project-member</nova:user>
Aug 14 18:22:54 user nova-compute[73078]:         <nova:project uuid="993dd55f40454640824687ffb6a3c581">tempest-ServerActionsTestOtherA-1876890021</nova:project>
Aug 14 18:22:54 user nova-compute[73078]:       </nova:owner>
Aug 14 18:22:54 user nova-compute[73078]:       <nova:ports>
Aug 14 18:22:54 user nova-compute[73078]:         <nova:port uuid="de400e10-3372-4eb4-b121-48ed70e471d3">
Aug 14 18:22:54 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 14 18:22:54 user nova-compute[73078]:         </nova:port>
Aug 14 18:22:54 user nova-compute[73078]:       </nova:ports>
Aug 14 18:22:54 user nova-compute[73078]:     </nova:instance>
Aug 14 18:22:54 user nova-compute[73078]:   </metadata>
Aug 14 18:22:54 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:22:54 user nova-compute[73078]:     <system>
Aug 14 18:22:54 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:22:54 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:22:54 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:22:54 user nova-compute[73078]:       <entry name="serial">8ebc48e0-0a24-4421-b180-f14eacc636ad</entry>
Aug 14 18:22:54 user nova-compute[73078]:       <entry name="uuid">8ebc48e0-0a24-4421-b180-f14eacc636ad</entry>
Aug 14 18:22:54 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:22:54 user nova-compute[73078]:     </system>
Aug 14 18:22:54 user nova-compute[73078]:   </sysinfo>
Aug 14 18:22:54 user nova-compute[73078]:   <os>
Aug 14 18:22:54 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:22:54 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:22:54 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:22:54 user nova-compute[73078]:   </os>
Aug 14 18:22:54 user nova-compute[73078]:   <features>
Aug 14 18:22:54 user nova-compute[73078]:     <acpi/>
Aug 14 18:22:54 user nova-compute[73078]:     <apic/>
Aug 14 18:22:54 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:22:54 user nova-compute[73078]:   </features>
Aug 14 18:22:54 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:22:54 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:22:54 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:22:54 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:22:54 user nova-compute[73078]:   </clock>
Aug 14 18:22:54 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:22:54 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:22:54 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:22:54 user nova-compute[73078]:   </cpu>
Aug 14 18:22:54 user nova-compute[73078]:   <devices>
Aug 14 18:22:54 user nova-compute[73078]:     <disk type="block" device="disk">
Aug 14 18:22:54 user nova-compute[73078]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:22:54 user nova-compute[73078]:       <source dev="/dev/sde"/>
Aug 14 18:22:54 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:22:54 user nova-compute[73078]:       <serial>394c2c9e-1cec-4548-8c12-2699fdd049cb</serial>
Aug 14 18:22:54 user nova-compute[73078]:     </disk>
Aug 14 18:22:54 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:22:54 user nova-compute[73078]:       <mac address="fa:16:3e:9d:54:60"/>
Aug 14 18:22:54 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:22:54 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:22:54 user nova-compute[73078]:       <target dev="tapde400e10-33"/>
Aug 14 18:22:54 user nova-compute[73078]:     </interface>
Aug 14 18:22:54 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:22:54 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/8ebc48e0-0a24-4421-b180-f14eacc636ad/console.log" append="off"/>
Aug 14 18:22:54 user nova-compute[73078]:     </serial>
Aug 14 18:22:54 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:22:54 user nova-compute[73078]:     <video>
Aug 14 18:22:54 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:22:54 user nova-compute[73078]:     </video>
Aug 14 18:22:54 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:22:54 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:22:54 user nova-compute[73078]:     </rng>
Aug 14 18:22:54 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:22:54 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:22:54 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:22:54 user nova-compute[73078]:     </memballoon>
Aug 14 18:22:54 user nova-compute[73078]:   </devices>
Aug 14 18:22:54 user nova-compute[73078]: </domain>
Aug 14 18:22:54 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:22:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1344711315',display_name='tempest-ServerActionsTestOtherA-server-1344711315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1344711315',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuBLKmid5aFtC8N9oGYPXkgiYGtDjSt/w1+99DQRyNH3SIh+uGteRP9ufywJ7TgR1607B3dJ2h6LnLGhohKOdL1yNPsWQsmTBErDFfyfHJa2VycZ+ceyQwLi9NhHpa6xg==',key_name='tempest-keypair-1366091689',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='993dd55f40454640824687ffb6a3c581',ramdisk_id='',reservation_id='r-o28i8x37',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1876890021',owner_user_name='tempest-ServerActionsTestOtherA-1876890021-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:22:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cca1112ab354f9fb31658e18c0d03b1',uuid=8ebc48e0-0a24-4421-b180-f14eacc636ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de400e10-3372-4eb4-b121-48ed70e471d3", "address": "fa:16:3e:9d:54:60", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde400e10-33", "ovs_interfaceid": "de400e10-3372-4eb4-b121-48ed70e471d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Converting VIF {"id": "de400e10-3372-4eb4-b121-48ed70e471d3", "address": "fa:16:3e:9d:54:60", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde400e10-33", "ovs_interfaceid": "de400e10-3372-4eb4-b121-48ed70e471d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:54:60,bridge_name='br-int',has_traffic_filtering=True,id=de400e10-3372-4eb4-b121-48ed70e471d3,network=Network(bfef9745-5a40-44b6-a6d5-2ef1e77fc5db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde400e10-33') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG os_vif [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:54:60,bridge_name='br-int',has_traffic_filtering=True,id=de400e10-3372-4eb4-b121-48ed70e471d3,network=Network(bfef9745-5a40-44b6-a6d5-2ef1e77fc5db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde400e10-33') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-8b7a05e6-7da9-4629-93d6-3431204b283a req-4402665c-75c2-408f-929f-063462ae3ddd service nova] Releasing lock "refresh_cache-f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde400e10-33, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapde400e10-33, col_values=(('external_ids', {'iface-id': 'de400e10-3372-4eb4-b121-48ed70e471d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:54:60', 'vm-uuid': '8ebc48e0-0a24-4421-b180-f14eacc636ad'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:54 user nova-compute[73078]: INFO os_vif [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:54:60,bridge_name='br-int',has_traffic_filtering=True,id=de400e10-3372-4eb4-b121-48ed70e471d3,network=Network(bfef9745-5a40-44b6-a6d5-2ef1e77fc5db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde400e10-33')
Aug 14 18:22:54 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] No VIF found with MAC fa:16:3e:9d:54:60, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35bb08ed-fa84-4157-a27a-f0dd0dee0408/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG nova.compute.manager [req-768f98e8-741b-4503-bbca-4f17442c768b req-7ead123f-27e5-462b-945a-0f392b37cf67 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Received event network-changed-183ecc4d-2001-4254-9f1b-af3a43c362dc {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG nova.compute.manager [req-768f98e8-741b-4503-bbca-4f17442c768b req-7ead123f-27e5-462b-945a-0f392b37cf67 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Refreshing instance network info cache due to event network-changed-183ecc4d-2001-4254-9f1b-af3a43c362dc. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-768f98e8-741b-4503-bbca-4f17442c768b req-7ead123f-27e5-462b-945a-0f392b37cf67 service nova] Acquiring lock "refresh_cache-f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-768f98e8-741b-4503-bbca-4f17442c768b req-7ead123f-27e5-462b-945a-0f392b37cf67 service nova] Acquired lock "refresh_cache-f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG nova.network.neutron [req-768f98e8-741b-4503-bbca-4f17442c768b req-7ead123f-27e5-462b-945a-0f392b37cf67 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Refreshing network info cache for port 183ecc4d-2001-4254-9f1b-af3a43c362dc {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037374.541845, ef110d5f-afb5-415c-9590-29da006734a9 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:22:54 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ef110d5f-afb5-415c-9590-29da006734a9] VM Resumed (Lifecycle Event)
Aug 14 18:22:54 user nova-compute[73078]: DEBUG nova.compute.manager [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG nova.compute.manager [req-9cb68cb1-7699-4847-8129-c6e88146a672 req-27441334-d906-47bf-b542-ca2213a38b1f service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Received event network-vif-plugged-6adf2de6-8801-4cc9-ab39-9a521201ca8a {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9cb68cb1-7699-4847-8129-c6e88146a672 req-27441334-d906-47bf-b542-ca2213a38b1f service nova] Acquiring lock "ef110d5f-afb5-415c-9590-29da006734a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9cb68cb1-7699-4847-8129-c6e88146a672 req-27441334-d906-47bf-b542-ca2213a38b1f service nova] Lock "ef110d5f-afb5-415c-9590-29da006734a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9cb68cb1-7699-4847-8129-c6e88146a672 req-27441334-d906-47bf-b542-ca2213a38b1f service nova] Lock "ef110d5f-afb5-415c-9590-29da006734a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG nova.compute.manager [req-9cb68cb1-7699-4847-8129-c6e88146a672 req-27441334-d906-47bf-b542-ca2213a38b1f service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] No waiting events found dispatching network-vif-plugged-6adf2de6-8801-4cc9-ab39-9a521201ca8a {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:22:54 user nova-compute[73078]: WARNING nova.compute.manager [req-9cb68cb1-7699-4847-8129-c6e88146a672 req-27441334-d906-47bf-b542-ca2213a38b1f service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Received unexpected event network-vif-plugged-6adf2de6-8801-4cc9-ab39-9a521201ca8a for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 18:22:54 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35bb08ed-fa84-4157-a27a-f0dd0dee0408/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35bb08ed-fa84-4157-a27a-f0dd0dee0408/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0aa5b215-d781-4ded-b1c6-84a582942cbb tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0aa5b215-d781-4ded-b1c6-84a582942cbb tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:22:54 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Instance spawned successfully.
Aug 14 18:22:54 user nova-compute[73078]: DEBUG nova.compute.manager [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:22:54 user nova-compute[73078]: INFO nova.compute.manager [None req-0aa5b215-d781-4ded-b1c6-84a582942cbb tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Detaching volume b45567c2-1040-47dc-bf5e-57d8f2867b61
Aug 14 18:22:54 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:22:54 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ef110d5f-afb5-415c-9590-29da006734a9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:22:54 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037374.5440145, ef110d5f-afb5-415c-9590-29da006734a9 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:22:54 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ef110d5f-afb5-415c-9590-29da006734a9] VM Started (Lifecycle Event)
Aug 14 18:22:54 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:22:54 user nova-compute[73078]: INFO nova.virt.block_device [None req-0aa5b215-d781-4ded-b1c6-84a582942cbb tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Attempting to driver detach volume b45567c2-1040-47dc-bf5e-57d8f2867b61 from mountpoint /dev/vdb
Aug 14 18:22:54 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ef110d5f-afb5-415c-9590-29da006734a9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:22:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-75e93633-7a53-42aa-a84f-783b81247725 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lock "ef110d5f-afb5-415c-9590-29da006734a9" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 16.777s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35bb08ed-fa84-4157-a27a-f0dd0dee0408/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-0aa5b215-d781-4ded-b1c6-84a582942cbb tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Attempting to detach device vdb from instance f61b5dc6-4b63-439b-9b3d-62ee0a4056d3 from the persistent domain config. {{(pid=73078) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-0aa5b215-d781-4ded-b1c6-84a582942cbb tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:22:54 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:22:54 user nova-compute[73078]:   <source dev="/dev/sdc"/>
Aug 14 18:22:54 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:22:54 user nova-compute[73078]:   <serial>b45567c2-1040-47dc-bf5e-57d8f2867b61</serial>
Aug 14 18:22:54 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 18:22:54 user nova-compute[73078]: </disk>
Aug 14 18:22:54 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:22:54 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-0aa5b215-d781-4ded-b1c6-84a582942cbb tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Successfully detached device vdb from instance f61b5dc6-4b63-439b-9b3d-62ee0a4056d3 from the persistent domain config.
Aug 14 18:22:54 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-0aa5b215-d781-4ded-b1c6-84a582942cbb tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f61b5dc6-4b63-439b-9b3d-62ee0a4056d3 from the live domain config. {{(pid=73078) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 18:22:54 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-0aa5b215-d781-4ded-b1c6-84a582942cbb tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:22:54 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:22:54 user nova-compute[73078]:   <source dev="/dev/sdc"/>
Aug 14 18:22:54 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:22:54 user nova-compute[73078]:   <serial>b45567c2-1040-47dc-bf5e-57d8f2867b61</serial>
Aug 14 18:22:54 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 18:22:54 user nova-compute[73078]: </disk>
Aug 14 18:22:54 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Received event <DeviceRemovedEvent: 1692037375.4393086, f61b5dc6-4b63-439b-9b3d-62ee0a4056d3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73078) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037378.1959324, 8ebc48e0-0a24-4421-b180-f14eacc636ad => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:22:58 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] VM Resumed (Lifecycle Event)
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.compute.manager [req-ab4055bc-a74f-4145-b70a-8382cf9c1dfd req-9fb62326-1900-495f-bdbc-8b2c40224903 service nova] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Received event network-vif-plugged-de400e10-3372-4eb4-b121-48ed70e471d3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ab4055bc-a74f-4145-b70a-8382cf9c1dfd req-9fb62326-1900-495f-bdbc-8b2c40224903 service nova] Acquiring lock "8ebc48e0-0a24-4421-b180-f14eacc636ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ab4055bc-a74f-4145-b70a-8382cf9c1dfd req-9fb62326-1900-495f-bdbc-8b2c40224903 service nova] Lock "8ebc48e0-0a24-4421-b180-f14eacc636ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ab4055bc-a74f-4145-b70a-8382cf9c1dfd req-9fb62326-1900-495f-bdbc-8b2c40224903 service nova] Lock "8ebc48e0-0a24-4421-b180-f14eacc636ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.compute.manager [req-ab4055bc-a74f-4145-b70a-8382cf9c1dfd req-9fb62326-1900-495f-bdbc-8b2c40224903 service nova] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] No waiting events found dispatching network-vif-plugged-de400e10-3372-4eb4-b121-48ed70e471d3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:22:58 user nova-compute[73078]: WARNING nova.compute.manager [req-ab4055bc-a74f-4145-b70a-8382cf9c1dfd req-9fb62326-1900-495f-bdbc-8b2c40224903 service nova] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Received unexpected event network-vif-plugged-de400e10-3372-4eb4-b121-48ed70e471d3 for instance with vm_state building and task_state spawning.
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.compute.manager [req-61baded5-dfb6-4122-860b-cf1f4d4e4a2b req-01361622-cafd-40f1-97b1-07e3c58bb30d service nova] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Received event network-vif-plugged-de400e10-3372-4eb4-b121-48ed70e471d3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-61baded5-dfb6-4122-860b-cf1f4d4e4a2b req-01361622-cafd-40f1-97b1-07e3c58bb30d service nova] Acquiring lock "8ebc48e0-0a24-4421-b180-f14eacc636ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-61baded5-dfb6-4122-860b-cf1f4d4e4a2b req-01361622-cafd-40f1-97b1-07e3c58bb30d service nova] Lock "8ebc48e0-0a24-4421-b180-f14eacc636ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-61baded5-dfb6-4122-860b-cf1f4d4e4a2b req-01361622-cafd-40f1-97b1-07e3c58bb30d service nova] Lock "8ebc48e0-0a24-4421-b180-f14eacc636ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.compute.manager [req-61baded5-dfb6-4122-860b-cf1f4d4e4a2b req-01361622-cafd-40f1-97b1-07e3c58bb30d service nova] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] No waiting events found dispatching network-vif-plugged-de400e10-3372-4eb4-b121-48ed70e471d3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:22:58 user nova-compute[73078]: WARNING nova.compute.manager [req-61baded5-dfb6-4122-860b-cf1f4d4e4a2b req-01361622-cafd-40f1-97b1-07e3c58bb30d service nova] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Received unexpected event network-vif-plugged-de400e10-3372-4eb4-b121-48ed70e471d3 for instance with vm_state building and task_state spawning.
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-0aa5b215-d781-4ded-b1c6-84a582942cbb tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f61b5dc6-4b63-439b-9b3d-62ee0a4056d3 {{(pid=73078) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.compute.manager [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:22:58 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-0aa5b215-d781-4ded-b1c6-84a582942cbb tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Successfully detached device vdb from instance f61b5dc6-4b63-439b-9b3d-62ee0a4056d3 from the live domain config.
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:22:58 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Instance spawned successfully.
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0aa5b215-d781-4ded-b1c6-84a582942cbb tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa5b215-d781-4ded-b1c6-84a582942cbb tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IzERaeku', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:22:58 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-0aa5b215-d781-4ded-b1c6-84a582942cbb tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:22:58 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-0aa5b215-d781-4ded-b1c6-84a582942cbb tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-0aa5b215-d781-4ded-b1c6-84a582942cbb tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa5b215-d781-4ded-b1c6-84a582942cbb tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:58 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:22:58 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=7100MB free_disk=25.046730041503906GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:22:58 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037378.1988816, 8ebc48e0-0a24-4421-b180-f14eacc636ad => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:22:58 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] VM Started (Lifecycle Event)
Aug 14 18:22:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f959799e-187a-4ca8-bae1-2f121932f5cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[09784db7-6cf2-4183-81af-ea377bc637a2]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa5b215-d781-4ded-b1c6-84a582942cbb tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 (non-flash)
Aug 14 18:22:58 user nova-compute[73078]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:22:58 user nova-compute[73078]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:22:58 user nova-compute[73078]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:22:58 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa5b215-d781-4ded-b1c6-84a582942cbb tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 (non-flash)
Aug 14 18:22:58 user nova-compute[73078]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:22:58 user nova-compute[73078]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:22:58 user nova-compute[73078]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:22:58 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa5b215-d781-4ded-b1c6-84a582942cbb tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe97826b1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61'): ({'sdc'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-0aa5b215-d781-4ded-b1c6-84a582942cbb tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Removing single pathed devices sdc {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:22:58 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:22:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7e282a-eadf-4f71-9104-188c0970bca3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:58 user nova-compute[73078]: INFO nova.compute.manager [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Took 6.13 seconds to spawn the instance on the hypervisor.
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.compute.manager [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad4943e-7355-41df-8c58-a9c1d6af7531]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-0aa5b215-d781-4ded-b1c6-84a582942cbb tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Flushing IO for device /dev/sdc {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d911bf-8406-4cfe-8361-ded188e4efc7]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-0aa5b215-d781-4ded-b1c6-84a582942cbb tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance de80e188-9385-4613-8a6c-aa72b624ad55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 1f88cb97-4f22-439e-99f2-d7cb8d5aff36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 3c840309-9884-4c8a-a6ee-1acd44f32c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance ea445c0c-e5a1-4e24-8008-2cd64a679f34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance f61b5dc6-4b63-439b-9b3d-62ee0a4056d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance a99aa211-c2a1-4240-90cc-2df068d4f669 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 61dfe42b-c943-4617-bf8e-745eaf1a1bb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance adcf1ea7-e7d7-4499-b340-689d25667899 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 35bb08ed-fa84-4157-a27a-f0dd0dee0408 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 4569b529-5c8f-45ec-94fe-58c60f6bcc8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance ef110d5f-afb5-415c-9590-29da006734a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 8ebc48e0-0a24-4421-b180-f14eacc636ad actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c5b28f-c6ef-46b1-aa6b-2f70f4feb9f1]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-0aa5b215-d781-4ded-b1c6-84a582942cbb tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-0aa5b215-d781-4ded-b1c6-84a582942cbb tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] SCSI volumes sdc have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa5b215-d781-4ded-b1c6-84a582942cbb tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:58 user nova-compute[73078]: INFO nova.compute.manager [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Took 17.47 seconds to build instance.
Aug 14 18:22:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b70d26-ecb1-46a6-90e6-f234a66faf60]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-7813a980-930e-4df3-a28a-e6deeb3634f5 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "8ebc48e0-0a24-4421-b180-f14eacc636ad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.614s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa5b215-d781-4ded-b1c6-84a582942cbb tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.network.neutron [req-768f98e8-741b-4503-bbca-4f17442c768b req-7ead123f-27e5-462b-945a-0f392b37cf67 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Updated VIF entry in instance network info cache for port 183ecc4d-2001-4254-9f1b-af3a43c362dc. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.network.neutron [req-768f98e8-741b-4503-bbca-4f17442c768b req-7ead123f-27e5-462b-945a-0f392b37cf67 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Updating instance_info_cache with network_info: [{"id": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "address": "fa:16:3e:4a:28:05", "network": {"id": "4c337404-9329-43e7-bed1-7b5dc32f6cd9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-902748542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6461284f1d491c9cd726d8550a445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183ecc4d-20", "ovs_interfaceid": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81d384e-83ce-404d-add3-723fc13be8a1]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa5b215-d781-4ded-b1c6-84a582942cbb tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61, portal: 172.16.0.220,3260]
Aug 14 18:22:58 user nova-compute[73078]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61, portal: 172.16.0.220,3260] successful.
Aug 14 18:22:58 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b45567c2-1040-47dc-bf5e-57d8f2867b61 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[14aeea9c-39c9-4858-bfa8-8cb1c67fbfdf]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa5b215-d781-4ded-b1c6-84a582942cbb tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-0aa5b215-d781-4ded-b1c6-84a582942cbb tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa5b215-d781-4ded-b1c6-84a582942cbb tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] <== disconnect_volume: return (366ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0aa5b215-d781-4ded-b1c6-84a582942cbb tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:22:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-768f98e8-741b-4503-bbca-4f17442c768b req-7ead123f-27e5-462b-945a-0f392b37cf67 service nova] Releasing lock "refresh_cache-f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:22:59 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:22:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:22:59 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:22:59 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:22:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.685s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:22:59 user nova-compute[73078]: DEBUG nova.objects.instance [None req-0aa5b215-d781-4ded-b1c6-84a582942cbb tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lazy-loading 'flavor' on Instance uuid f61b5dc6-4b63-439b-9b3d-62ee0a4056d3 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:22:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-0aa5b215-d781-4ded-b1c6-84a582942cbb tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.094s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:23:00 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:23:00 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:23:00 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:23:00 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:23:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-4569b529-5c8f-45ec-94fe-58c60f6bcc8a" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:23:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-4569b529-5c8f-45ec-94fe-58c60f6bcc8a" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:23:00 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:23:00 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Updating instance_info_cache with network_info: [{"id": "08a212c4-6236-4adc-a3ec-6b76341585b3", "address": "fa:16:3e:4f:04:0e", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a212c4-62", "ovs_interfaceid": "08a212c4-6236-4adc-a3ec-6b76341585b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:23:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-4569b529-5c8f-45ec-94fe-58c60f6bcc8a" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:23:00 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:23:00 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:23:00 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:23:00 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:23:00 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:23:00 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:23:00 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:23:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:08 user nova-compute[73078]: DEBUG nova.compute.manager [None req-57b57658-816e-4af5-afab-cf459327f9eb tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:23:08 user nova-compute[73078]: INFO nova.compute.manager [None req-57b57658-816e-4af5-afab-cf459327f9eb tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] instance snapshotting
Aug 14 18:23:08 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-57b57658-816e-4af5-afab-cf459327f9eb tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Beginning live snapshot process
Aug 14 18:23:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-57b57658-816e-4af5-afab-cf459327f9eb tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json -f qcow2 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:23:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:23:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-57b57658-816e-4af5-afab-cf459327f9eb tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json -f qcow2" returned: 0 in 0.194s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:23:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-57b57658-816e-4af5-afab-cf459327f9eb tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json -f qcow2 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:23:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-57b57658-816e-4af5-afab-cf459327f9eb tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:23:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-57b57658-816e-4af5-afab-cf459327f9eb tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:23:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-57b57658-816e-4af5-afab-cf459327f9eb tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.190s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:23:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-57b57658-816e-4af5-afab-cf459327f9eb tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpk3acqpxk/067a878388b6478387f2f4435e35a138.delta 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:23:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-57b57658-816e-4af5-afab-cf459327f9eb tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpk3acqpxk/067a878388b6478387f2f4435e35a138.delta 1073741824" returned: 0 in 0.058s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:23:09 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-57b57658-816e-4af5-afab-cf459327f9eb tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 14 18:23:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-57b57658-816e-4af5-afab-cf459327f9eb tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] COPY block job progress, current cursor: 983040 final cursor: 75497472 {{(pid=73078) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 18:23:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-57b57658-816e-4af5-afab-cf459327f9eb tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73078) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 18:23:10 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-57b57658-816e-4af5-afab-cf459327f9eb tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 18:23:10 user nova-compute[73078]: DEBUG nova.privsep.utils [None req-57b57658-816e-4af5-afab-cf459327f9eb tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73078) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 18:23:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-57b57658-816e-4af5-afab-cf459327f9eb tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpk3acqpxk/067a878388b6478387f2f4435e35a138.delta /opt/stack/data/nova/instances/snapshots/tmpk3acqpxk/067a878388b6478387f2f4435e35a138 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:23:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-57b57658-816e-4af5-afab-cf459327f9eb tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpk3acqpxk/067a878388b6478387f2f4435e35a138.delta /opt/stack/data/nova/instances/snapshots/tmpk3acqpxk/067a878388b6478387f2f4435e35a138" returned: 0 in 0.656s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:23:11 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-57b57658-816e-4af5-afab-cf459327f9eb tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Snapshot extracted, beginning image upload
Aug 14 18:23:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:14 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-57b57658-816e-4af5-afab-cf459327f9eb tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Snapshot image upload complete
Aug 14 18:23:14 user nova-compute[73078]: INFO nova.compute.manager [None req-57b57658-816e-4af5-afab-cf459327f9eb tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Took 5.56 seconds to snapshot the instance on the hypervisor.
Aug 14 18:23:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-35a1b3b7-9fb6-4f27-b093-cec3b9fe7612 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Acquiring lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:23:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-35a1b3b7-9fb6-4f27-b093-cec3b9fe7612 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:23:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-35a1b3b7-9fb6-4f27-b093-cec3b9fe7612 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Acquiring lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:23:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-35a1b3b7-9fb6-4f27-b093-cec3b9fe7612 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:23:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-35a1b3b7-9fb6-4f27-b093-cec3b9fe7612 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:23:15 user nova-compute[73078]: INFO nova.compute.manager [None req-35a1b3b7-9fb6-4f27-b093-cec3b9fe7612 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Terminating instance
Aug 14 18:23:15 user nova-compute[73078]: DEBUG nova.compute.manager [None req-35a1b3b7-9fb6-4f27-b093-cec3b9fe7612 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:23:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:15 user nova-compute[73078]: DEBUG nova.compute.manager [req-d2c2baf5-c5f4-4956-8aca-dbcf8e4a23ca req-928611df-c8f5-458f-9351-5a3cf196b6c2 service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Received event network-vif-unplugged-3a008b18-c1c3-4656-9ada-f437888cdee6 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:23:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d2c2baf5-c5f4-4956-8aca-dbcf8e4a23ca req-928611df-c8f5-458f-9351-5a3cf196b6c2 service nova] Acquiring lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:23:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d2c2baf5-c5f4-4956-8aca-dbcf8e4a23ca req-928611df-c8f5-458f-9351-5a3cf196b6c2 service nova] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:23:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d2c2baf5-c5f4-4956-8aca-dbcf8e4a23ca req-928611df-c8f5-458f-9351-5a3cf196b6c2 service nova] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:23:15 user nova-compute[73078]: DEBUG nova.compute.manager [req-d2c2baf5-c5f4-4956-8aca-dbcf8e4a23ca req-928611df-c8f5-458f-9351-5a3cf196b6c2 service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] No waiting events found dispatching network-vif-unplugged-3a008b18-c1c3-4656-9ada-f437888cdee6 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:23:15 user nova-compute[73078]: DEBUG nova.compute.manager [req-d2c2baf5-c5f4-4956-8aca-dbcf8e4a23ca req-928611df-c8f5-458f-9351-5a3cf196b6c2 service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Received event network-vif-unplugged-3a008b18-c1c3-4656-9ada-f437888cdee6 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:23:16 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Instance destroyed successfully.
Aug 14 18:23:16 user nova-compute[73078]: DEBUG nova.objects.instance [None req-35a1b3b7-9fb6-4f27-b093-cec3b9fe7612 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lazy-loading 'resources' on Instance uuid ea445c0c-e5a1-4e24-8008-2cd64a679f34 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:23:16 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-35a1b3b7-9fb6-4f27-b093-cec3b9fe7612 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:15:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1491685202',display_name='tempest-ServerStableDeviceRescueTest-server-1491685202',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1491685202',id=18,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSTDg2a3FdDwHLS5eghJchIu9zBpTAzj/gcbB/c+1H/CD2nkhiGbofjc2p/swBhyY2DVBNVOfggutnqRrWuq96pedEA+ZYoofu9LuMUjdduc37Lprb2vTrGWcdyssj9AA==',key_name='tempest-keypair-113748248',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:20:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9a739612a674c5c82fad631a64c57ba',ramdisk_id='',reservation_id='r-lbnq00mr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-79994875',owner_user_name='tempest-ServerStableDeviceRescueTest-79994875-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:21:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc572af82fa544ab8d0af9dcc3470136',uuid=ea445c0c-e5a1-4e24-8008-2cd64a679f34,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a008b18-c1c3-4656-9ada-f437888cdee6", "address": "fa:16:3e:a3:fb:e1", "network": {"id": "45b49a52-f99e-437a-aa8d-440f4f6b1099", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1520302261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9a739612a674c5c82fad631a64c57ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a008b18-c1", "ovs_interfaceid": "3a008b18-c1c3-4656-9ada-f437888cdee6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:23:16 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-35a1b3b7-9fb6-4f27-b093-cec3b9fe7612 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Converting VIF {"id": "3a008b18-c1c3-4656-9ada-f437888cdee6", "address": "fa:16:3e:a3:fb:e1", "network": {"id": "45b49a52-f99e-437a-aa8d-440f4f6b1099", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1520302261-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9a739612a674c5c82fad631a64c57ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a008b18-c1", "ovs_interfaceid": "3a008b18-c1c3-4656-9ada-f437888cdee6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:23:16 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-35a1b3b7-9fb6-4f27-b093-cec3b9fe7612 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:fb:e1,bridge_name='br-int',has_traffic_filtering=True,id=3a008b18-c1c3-4656-9ada-f437888cdee6,network=Network(45b49a52-f99e-437a-aa8d-440f4f6b1099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a008b18-c1') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:23:16 user nova-compute[73078]: DEBUG os_vif [None req-35a1b3b7-9fb6-4f27-b093-cec3b9fe7612 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:fb:e1,bridge_name='br-int',has_traffic_filtering=True,id=3a008b18-c1c3-4656-9ada-f437888cdee6,network=Network(45b49a52-f99e-437a-aa8d-440f4f6b1099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a008b18-c1') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:23:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a008b18-c1, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:23:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:23:16 user nova-compute[73078]: INFO os_vif [None req-35a1b3b7-9fb6-4f27-b093-cec3b9fe7612 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:fb:e1,bridge_name='br-int',has_traffic_filtering=True,id=3a008b18-c1c3-4656-9ada-f437888cdee6,network=Network(45b49a52-f99e-437a-aa8d-440f4f6b1099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a008b18-c1')
Aug 14 18:23:16 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-35a1b3b7-9fb6-4f27-b093-cec3b9fe7612 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Deleting instance files /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34_del
Aug 14 18:23:16 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-35a1b3b7-9fb6-4f27-b093-cec3b9fe7612 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Deletion of /opt/stack/data/nova/instances/ea445c0c-e5a1-4e24-8008-2cd64a679f34_del complete
Aug 14 18:23:16 user nova-compute[73078]: INFO nova.compute.manager [None req-35a1b3b7-9fb6-4f27-b093-cec3b9fe7612 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 14 18:23:16 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-35a1b3b7-9fb6-4f27-b093-cec3b9fe7612 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:23:16 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:23:16 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:23:17 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:23:17 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Took 0.85 seconds to deallocate network for instance.
Aug 14 18:23:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-35a1b3b7-9fb6-4f27-b093-cec3b9fe7612 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:23:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-35a1b3b7-9fb6-4f27-b093-cec3b9fe7612 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:23:17 user nova-compute[73078]: DEBUG nova.compute.manager [req-9e6718c6-3803-4e38-8587-b0334aa4b816 req-9915e576-0b8c-453d-a852-a2d9be10e525 service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Received event network-vif-deleted-3a008b18-c1c3-4656-9ada-f437888cdee6 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:23:17 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-35a1b3b7-9fb6-4f27-b093-cec3b9fe7612 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:23:17 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-35a1b3b7-9fb6-4f27-b093-cec3b9fe7612 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:23:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-35a1b3b7-9fb6-4f27-b093-cec3b9fe7612 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.505s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:23:18 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-35a1b3b7-9fb6-4f27-b093-cec3b9fe7612 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Deleted allocations for instance ea445c0c-e5a1-4e24-8008-2cd64a679f34
Aug 14 18:23:18 user nova-compute[73078]: DEBUG nova.compute.manager [req-2542fcef-985b-4803-b54d-3cf9a16efefe req-0f8f82dd-a0be-4509-a015-22dde85235a0 service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Received event network-vif-plugged-3a008b18-c1c3-4656-9ada-f437888cdee6 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:23:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-2542fcef-985b-4803-b54d-3cf9a16efefe req-0f8f82dd-a0be-4509-a015-22dde85235a0 service nova] Acquiring lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:23:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-2542fcef-985b-4803-b54d-3cf9a16efefe req-0f8f82dd-a0be-4509-a015-22dde85235a0 service nova] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:23:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-2542fcef-985b-4803-b54d-3cf9a16efefe req-0f8f82dd-a0be-4509-a015-22dde85235a0 service nova] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:23:18 user nova-compute[73078]: DEBUG nova.compute.manager [req-2542fcef-985b-4803-b54d-3cf9a16efefe req-0f8f82dd-a0be-4509-a015-22dde85235a0 service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] No waiting events found dispatching network-vif-plugged-3a008b18-c1c3-4656-9ada-f437888cdee6 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:23:18 user nova-compute[73078]: WARNING nova.compute.manager [req-2542fcef-985b-4803-b54d-3cf9a16efefe req-0f8f82dd-a0be-4509-a015-22dde85235a0 service nova] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Received unexpected event network-vif-plugged-3a008b18-c1c3-4656-9ada-f437888cdee6 for instance with vm_state deleted and task_state None.
Aug 14 18:23:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-35a1b3b7-9fb6-4f27-b093-cec3b9fe7612 tempest-ServerStableDeviceRescueTest-79994875 tempest-ServerStableDeviceRescueTest-79994875-project-member] Lock "ea445c0c-e5a1-4e24-8008-2cd64a679f34" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.445s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:23:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:27 user nova-compute[73078]: INFO nova.compute.manager [None req-52ca356c-5a71-4537-b300-508d8f4e0767 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Unrescuing
Aug 14 18:23:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-52ca356c-5a71-4537-b300-508d8f4e0767 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "refresh_cache-a99aa211-c2a1-4240-90cc-2df068d4f669" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:23:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-52ca356c-5a71-4537-b300-508d8f4e0767 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquired lock "refresh_cache-a99aa211-c2a1-4240-90cc-2df068d4f669" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:23:27 user nova-compute[73078]: DEBUG nova.network.neutron [None req-52ca356c-5a71-4537-b300-508d8f4e0767 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:23:27 user nova-compute[73078]: DEBUG nova.network.neutron [None req-52ca356c-5a71-4537-b300-508d8f4e0767 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Updating instance_info_cache with network_info: [{"id": "5262c4ac-db58-4c3d-9546-7252ee76c730", "address": "fa:16:3e:e4:7f:9e", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5262c4ac-db", "ovs_interfaceid": "5262c4ac-db58-4c3d-9546-7252ee76c730", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:23:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-52ca356c-5a71-4537-b300-508d8f4e0767 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Releasing lock "refresh_cache-a99aa211-c2a1-4240-90cc-2df068d4f669" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:23:27 user nova-compute[73078]: DEBUG nova.objects.instance [None req-52ca356c-5a71-4537-b300-508d8f4e0767 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lazy-loading 'flavor' on Instance uuid a99aa211-c2a1-4240-90cc-2df068d4f669 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:23:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:28 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Instance destroyed successfully.
Aug 14 18:23:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:29 user nova-compute[73078]: DEBUG nova.compute.manager [req-d042ec10-edb3-47ea-a6b9-a2edff47143b req-ee9450cb-f253-4da4-b011-da4a92b9364f service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Received event network-vif-unplugged-5262c4ac-db58-4c3d-9546-7252ee76c730 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:23:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d042ec10-edb3-47ea-a6b9-a2edff47143b req-ee9450cb-f253-4da4-b011-da4a92b9364f service nova] Acquiring lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:23:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d042ec10-edb3-47ea-a6b9-a2edff47143b req-ee9450cb-f253-4da4-b011-da4a92b9364f service nova] Lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:23:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d042ec10-edb3-47ea-a6b9-a2edff47143b req-ee9450cb-f253-4da4-b011-da4a92b9364f service nova] Lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:23:29 user nova-compute[73078]: DEBUG nova.compute.manager [req-d042ec10-edb3-47ea-a6b9-a2edff47143b req-ee9450cb-f253-4da4-b011-da4a92b9364f service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] No waiting events found dispatching network-vif-unplugged-5262c4ac-db58-4c3d-9546-7252ee76c730 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:23:29 user nova-compute[73078]: WARNING nova.compute.manager [req-d042ec10-edb3-47ea-a6b9-a2edff47143b req-ee9450cb-f253-4da4-b011-da4a92b9364f service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Received unexpected event network-vif-unplugged-5262c4ac-db58-4c3d-9546-7252ee76c730 for instance with vm_state rescued and task_state unrescuing.
Aug 14 18:23:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:31 user nova-compute[73078]: DEBUG nova.compute.manager [req-9602ca2e-19db-40e6-800e-92e652fba851 req-41244802-a6ef-4526-adae-4ec206ddf42a service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Received event network-vif-plugged-5262c4ac-db58-4c3d-9546-7252ee76c730 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:23:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9602ca2e-19db-40e6-800e-92e652fba851 req-41244802-a6ef-4526-adae-4ec206ddf42a service nova] Acquiring lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:23:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9602ca2e-19db-40e6-800e-92e652fba851 req-41244802-a6ef-4526-adae-4ec206ddf42a service nova] Lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:23:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9602ca2e-19db-40e6-800e-92e652fba851 req-41244802-a6ef-4526-adae-4ec206ddf42a service nova] Lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:23:31 user nova-compute[73078]: DEBUG nova.compute.manager [req-9602ca2e-19db-40e6-800e-92e652fba851 req-41244802-a6ef-4526-adae-4ec206ddf42a service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] No waiting events found dispatching network-vif-plugged-5262c4ac-db58-4c3d-9546-7252ee76c730 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:23:31 user nova-compute[73078]: WARNING nova.compute.manager [req-9602ca2e-19db-40e6-800e-92e652fba851 req-41244802-a6ef-4526-adae-4ec206ddf42a service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Received unexpected event network-vif-plugged-5262c4ac-db58-4c3d-9546-7252ee76c730 for instance with vm_state rescued and task_state unrescuing.
Aug 14 18:23:31 user nova-compute[73078]: DEBUG nova.compute.manager [req-9602ca2e-19db-40e6-800e-92e652fba851 req-41244802-a6ef-4526-adae-4ec206ddf42a service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Received event network-vif-plugged-5262c4ac-db58-4c3d-9546-7252ee76c730 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:23:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9602ca2e-19db-40e6-800e-92e652fba851 req-41244802-a6ef-4526-adae-4ec206ddf42a service nova] Acquiring lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:23:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9602ca2e-19db-40e6-800e-92e652fba851 req-41244802-a6ef-4526-adae-4ec206ddf42a service nova] Lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:23:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9602ca2e-19db-40e6-800e-92e652fba851 req-41244802-a6ef-4526-adae-4ec206ddf42a service nova] Lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:23:31 user nova-compute[73078]: DEBUG nova.compute.manager [req-9602ca2e-19db-40e6-800e-92e652fba851 req-41244802-a6ef-4526-adae-4ec206ddf42a service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] No waiting events found dispatching network-vif-plugged-5262c4ac-db58-4c3d-9546-7252ee76c730 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:23:31 user nova-compute[73078]: WARNING nova.compute.manager [req-9602ca2e-19db-40e6-800e-92e652fba851 req-41244802-a6ef-4526-adae-4ec206ddf42a service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Received unexpected event network-vif-plugged-5262c4ac-db58-4c3d-9546-7252ee76c730 for instance with vm_state rescued and task_state unrescuing.
Aug 14 18:23:31 user nova-compute[73078]: DEBUG nova.compute.manager [req-9602ca2e-19db-40e6-800e-92e652fba851 req-41244802-a6ef-4526-adae-4ec206ddf42a service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Received event network-vif-plugged-5262c4ac-db58-4c3d-9546-7252ee76c730 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:23:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9602ca2e-19db-40e6-800e-92e652fba851 req-41244802-a6ef-4526-adae-4ec206ddf42a service nova] Acquiring lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:23:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9602ca2e-19db-40e6-800e-92e652fba851 req-41244802-a6ef-4526-adae-4ec206ddf42a service nova] Lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:23:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9602ca2e-19db-40e6-800e-92e652fba851 req-41244802-a6ef-4526-adae-4ec206ddf42a service nova] Lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:23:31 user nova-compute[73078]: DEBUG nova.compute.manager [req-9602ca2e-19db-40e6-800e-92e652fba851 req-41244802-a6ef-4526-adae-4ec206ddf42a service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] No waiting events found dispatching network-vif-plugged-5262c4ac-db58-4c3d-9546-7252ee76c730 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:23:31 user nova-compute[73078]: WARNING nova.compute.manager [req-9602ca2e-19db-40e6-800e-92e652fba851 req-41244802-a6ef-4526-adae-4ec206ddf42a service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Received unexpected event network-vif-plugged-5262c4ac-db58-4c3d-9546-7252ee76c730 for instance with vm_state rescued and task_state unrescuing.
Aug 14 18:23:31 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692037396.481348, ea445c0c-e5a1-4e24-8008-2cd64a679f34 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:23:31 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] VM Stopped (Lifecycle Event)
Aug 14 18:23:31 user nova-compute[73078]: DEBUG nova.compute.manager [None req-ee4534ca-f6f5-42b0-a8f2-034d4c5619ca None None] [instance: ea445c0c-e5a1-4e24-8008-2cd64a679f34] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:23:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:32 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Removed pending event for a99aa211-c2a1-4240-90cc-2df068d4f669 due to event {{(pid=73078) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 18:23:32 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037412.0407238, a99aa211-c2a1-4240-90cc-2df068d4f669 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:23:32 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] VM Resumed (Lifecycle Event)
Aug 14 18:23:32 user nova-compute[73078]: DEBUG nova.compute.manager [None req-52ca356c-5a71-4537-b300-508d8f4e0767 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:23:32 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:23:32 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:23:32 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 18:23:32 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037412.0426066, a99aa211-c2a1-4240-90cc-2df068d4f669 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:23:32 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] VM Started (Lifecycle Event)
Aug 14 18:23:32 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:23:32 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:23:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:23:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "92b0eed8-2a32-4141-ab62-d7914fc6c150" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:23:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "92b0eed8-2a32-4141-ab62-d7914fc6c150" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:23:48 user nova-compute[73078]: DEBUG nova.compute.manager [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:23:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:23:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:23:48 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:23:48 user nova-compute[73078]: INFO nova.compute.claims [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Claim successful on node user
Aug 14 18:23:48 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:23:48 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:23:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:23:48 user nova-compute[73078]: DEBUG nova.compute.manager [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:23:48 user nova-compute[73078]: DEBUG nova.compute.manager [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:23:48 user nova-compute[73078]: DEBUG nova.network.neutron [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:23:48 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:23:48 user nova-compute[73078]: DEBUG nova.compute.manager [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:23:48 user nova-compute[73078]: INFO nova.virt.block_device [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Booting with volume snapshot 3d178e5c-daa3-491f-b87b-5e8f170fcc08 at /dev/vda
Aug 14 18:23:48 user nova-compute[73078]: DEBUG nova.policy [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe79455616584e0fb80e6007edf0b706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7142101014c4defa7261a34fb9f28e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:23:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:49 user nova-compute[73078]: DEBUG nova.network.neutron [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Successfully created port: 765affb6-4f4c-4efb-a870-fb693de04c6c {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:23:50 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:23:50 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:23:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:23:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:23:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:23:50 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:23:50 user nova-compute[73078]: DEBUG nova.network.neutron [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Successfully updated port: 765affb6-4f4c-4efb-a870-fb693de04c6c {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:23:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "refresh_cache-92b0eed8-2a32-4141-ab62-d7914fc6c150" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:23:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquired lock "refresh_cache-92b0eed8-2a32-4141-ab62-d7914fc6c150" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:23:50 user nova-compute[73078]: DEBUG nova.network.neutron [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:23:50 user nova-compute[73078]: DEBUG nova.compute.manager [req-3d787c8e-263e-46f0-8423-644eae75aabd req-e9b0723e-db32-4ef4-bc69-8741beaa266b service nova] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Received event network-changed-765affb6-4f4c-4efb-a870-fb693de04c6c {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:23:50 user nova-compute[73078]: DEBUG nova.compute.manager [req-3d787c8e-263e-46f0-8423-644eae75aabd req-e9b0723e-db32-4ef4-bc69-8741beaa266b service nova] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Refreshing instance network info cache due to event network-changed-765affb6-4f4c-4efb-a870-fb693de04c6c. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:23:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3d787c8e-263e-46f0-8423-644eae75aabd req-e9b0723e-db32-4ef4-bc69-8741beaa266b service nova] Acquiring lock "refresh_cache-92b0eed8-2a32-4141-ab62-d7914fc6c150" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:23:50 user nova-compute[73078]: DEBUG nova.network.neutron [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:23:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:23:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:23:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:23:50 user nova-compute[73078]: DEBUG nova.network.neutron [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Updating instance_info_cache with network_info: [{"id": "765affb6-4f4c-4efb-a870-fb693de04c6c", "address": "fa:16:3e:dd:d5:68", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765affb6-4f", "ovs_interfaceid": "765affb6-4f4c-4efb-a870-fb693de04c6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:23:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Releasing lock "refresh_cache-92b0eed8-2a32-4141-ab62-d7914fc6c150" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:23:50 user nova-compute[73078]: DEBUG nova.compute.manager [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Instance network_info: |[{"id": "765affb6-4f4c-4efb-a870-fb693de04c6c", "address": "fa:16:3e:dd:d5:68", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765affb6-4f", "ovs_interfaceid": "765affb6-4f4c-4efb-a870-fb693de04c6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:23:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3d787c8e-263e-46f0-8423-644eae75aabd req-e9b0723e-db32-4ef4-bc69-8741beaa266b service nova] Acquired lock "refresh_cache-92b0eed8-2a32-4141-ab62-d7914fc6c150" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:23:50 user nova-compute[73078]: DEBUG nova.network.neutron [req-3d787c8e-263e-46f0-8423-644eae75aabd req-e9b0723e-db32-4ef4-bc69-8741beaa266b service nova] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Refreshing network info cache for port 765affb6-4f4c-4efb-a870-fb693de04c6c {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:23:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:23:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:23:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:23:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:23:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:23:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:23:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf1ea7-e7d7-4499-b340-689d25667899/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:23:51 user nova-compute[73078]: DEBUG nova.network.neutron [req-3d787c8e-263e-46f0-8423-644eae75aabd req-e9b0723e-db32-4ef4-bc69-8741beaa266b service nova] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Updated VIF entry in instance network info cache for port 765affb6-4f4c-4efb-a870-fb693de04c6c. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:23:51 user nova-compute[73078]: DEBUG nova.network.neutron [req-3d787c8e-263e-46f0-8423-644eae75aabd req-e9b0723e-db32-4ef4-bc69-8741beaa266b service nova] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Updating instance_info_cache with network_info: [{"id": "765affb6-4f4c-4efb-a870-fb693de04c6c", "address": "fa:16:3e:dd:d5:68", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765affb6-4f", "ovs_interfaceid": "765affb6-4f4c-4efb-a870-fb693de04c6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:23:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3d787c8e-263e-46f0-8423-644eae75aabd req-e9b0723e-db32-4ef4-bc69-8741beaa266b service nova] Releasing lock "refresh_cache-92b0eed8-2a32-4141-ab62-d7914fc6c150" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:23:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf1ea7-e7d7-4499-b340-689d25667899/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:23:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf1ea7-e7d7-4499-b340-689d25667899/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:23:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf1ea7-e7d7-4499-b340-689d25667899/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:23:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:23:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d56ffd55-831d-46bf-9868-a2657bcdcaf6 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:23:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d56ffd55-831d-46bf-9868-a2657bcdcaf6 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:23:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d56ffd55-831d-46bf-9868-a2657bcdcaf6 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:23:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d56ffd55-831d-46bf-9868-a2657bcdcaf6 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:23:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d56ffd55-831d-46bf-9868-a2657bcdcaf6 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:23:51 user nova-compute[73078]: INFO nova.compute.manager [None req-d56ffd55-831d-46bf-9868-a2657bcdcaf6 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Terminating instance
Aug 14 18:23:51 user nova-compute[73078]: DEBUG nova.compute.manager [None req-d56ffd55-831d-46bf-9868-a2657bcdcaf6 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:23:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:23:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:23:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-bb2d41f9-ecb3-4c9f-8964-74fe04afe049 req-41d993d6-3e14-4740-b9b4-00370e2f900a service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Received event network-vif-unplugged-183ecc4d-2001-4254-9f1b-af3a43c362dc {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:23:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-bb2d41f9-ecb3-4c9f-8964-74fe04afe049 req-41d993d6-3e14-4740-b9b4-00370e2f900a service nova] Acquiring lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:23:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-bb2d41f9-ecb3-4c9f-8964-74fe04afe049 req-41d993d6-3e14-4740-b9b4-00370e2f900a service nova] Lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:23:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-bb2d41f9-ecb3-4c9f-8964-74fe04afe049 req-41d993d6-3e14-4740-b9b4-00370e2f900a service nova] Lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:23:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-bb2d41f9-ecb3-4c9f-8964-74fe04afe049 req-41d993d6-3e14-4740-b9b4-00370e2f900a service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] No waiting events found dispatching network-vif-unplugged-183ecc4d-2001-4254-9f1b-af3a43c362dc {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:23:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-bb2d41f9-ecb3-4c9f-8964-74fe04afe049 req-41d993d6-3e14-4740-b9b4-00370e2f900a service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Received event network-vif-unplugged-183ecc4d-2001-4254-9f1b-af3a43c362dc for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:23:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:23:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:23:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35bb08ed-fa84-4157-a27a-f0dd0dee0408/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:23:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35bb08ed-fa84-4157-a27a-f0dd0dee0408/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:23:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35bb08ed-fa84-4157-a27a-f0dd0dee0408/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:23:52 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Instance destroyed successfully.
Aug 14 18:23:52 user nova-compute[73078]: DEBUG nova.objects.instance [None req-d56ffd55-831d-46bf-9868-a2657bcdcaf6 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lazy-loading 'resources' on Instance uuid f61b5dc6-4b63-439b-9b3d-62ee0a4056d3 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:23:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-d56ffd55-831d-46bf-9868-a2657bcdcaf6 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:18:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1957182722',display_name='tempest-TestMinimumBasicScenario-server-1957182722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1957182722',id=23,image_ref='5e7413b1-16bd-4339-a215-31981164558b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjJC77llA3l7SUHq/hdkyC+9XFeVKxXNkUb+w5/DdLo+f1BeNe0yWHGVzXJxkhWwKbQcpDIu12NoXM5bJGoIURQlOaFuP0tnE3q8Bzd1rGOHAZD4ANRxT9WAGQT7bMi9A==',key_name='tempest-TestMinimumBasicScenario-1154723146',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:18:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d6461284f1d491c9cd726d8550a445b',ramdisk_id='',reservation_id='r-dghlbzh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e7413b1-16bd-4339-a215-31981164558b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-703150932',owner_user_name='tempest-TestMinimumBasicScenario-703150932-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:21:10Z,user_data=None,user_id='6ffd9b3d18374103918d71165106f131',uuid=f61b5dc6-4b63-439b-9b3d-62ee0a4056d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "address": "fa:16:3e:4a:28:05", "network": {"id": "4c337404-9329-43e7-bed1-7b5dc32f6cd9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-902748542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6461284f1d491c9cd726d8550a445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183ecc4d-20", "ovs_interfaceid": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:23:52 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-d56ffd55-831d-46bf-9868-a2657bcdcaf6 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Converting VIF {"id": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "address": "fa:16:3e:4a:28:05", "network": {"id": "4c337404-9329-43e7-bed1-7b5dc32f6cd9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-902748542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6461284f1d491c9cd726d8550a445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183ecc4d-20", "ovs_interfaceid": "183ecc4d-2001-4254-9f1b-af3a43c362dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:23:52 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-d56ffd55-831d-46bf-9868-a2657bcdcaf6 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:28:05,bridge_name='br-int',has_traffic_filtering=True,id=183ecc4d-2001-4254-9f1b-af3a43c362dc,network=Network(4c337404-9329-43e7-bed1-7b5dc32f6cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183ecc4d-20') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:23:52 user nova-compute[73078]: DEBUG os_vif [None req-d56ffd55-831d-46bf-9868-a2657bcdcaf6 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:28:05,bridge_name='br-int',has_traffic_filtering=True,id=183ecc4d-2001-4254-9f1b-af3a43c362dc,network=Network(4c337404-9329-43e7-bed1-7b5dc32f6cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183ecc4d-20') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:23:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35bb08ed-fa84-4157-a27a-f0dd0dee0408/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:23:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap183ecc4d-20, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:23:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:23:52 user nova-compute[73078]: INFO os_vif [None req-d56ffd55-831d-46bf-9868-a2657bcdcaf6 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:28:05,bridge_name='br-int',has_traffic_filtering=True,id=183ecc4d-2001-4254-9f1b-af3a43c362dc,network=Network(4c337404-9329-43e7-bed1-7b5dc32f6cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183ecc4d-20')
Aug 14 18:23:52 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-d56ffd55-831d-46bf-9868-a2657bcdcaf6 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Deleting instance files /opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3_del
Aug 14 18:23:52 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-d56ffd55-831d-46bf-9868-a2657bcdcaf6 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Deletion of /opt/stack/data/nova/instances/f61b5dc6-4b63-439b-9b3d-62ee0a4056d3_del complete
Aug 14 18:23:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:23:52 user nova-compute[73078]: INFO nova.compute.manager [None req-d56ffd55-831d-46bf-9868-a2657bcdcaf6 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 14 18:23:52 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-d56ffd55-831d-46bf-9868-a2657bcdcaf6 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:23:52 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:23:52 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:23:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:23:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:23:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:23:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:23:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:23:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:23:53 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:23:53 user nova-compute[73078]: DEBUG nova.compute.manager [req-6c3f2588-e982-41ac-a9e8-4d151773bf6c req-5c6832a5-0c9e-413a-9e42-5bedff59f49d service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Received event network-vif-deleted-183ecc4d-2001-4254-9f1b-af3a43c362dc {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:23:53 user nova-compute[73078]: INFO nova.compute.manager [req-6c3f2588-e982-41ac-a9e8-4d151773bf6c req-5c6832a5-0c9e-413a-9e42-5bedff59f49d service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Neutron deleted interface 183ecc4d-2001-4254-9f1b-af3a43c362dc; detaching it from the instance and deleting it from the info cache
Aug 14 18:23:53 user nova-compute[73078]: DEBUG nova.network.neutron [req-6c3f2588-e982-41ac-a9e8-4d151773bf6c req-5c6832a5-0c9e-413a-9e42-5bedff59f49d service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:23:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:53 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Took 0.62 seconds to deallocate network for instance.
Aug 14 18:23:53 user nova-compute[73078]: DEBUG nova.compute.manager [req-6c3f2588-e982-41ac-a9e8-4d151773bf6c req-5c6832a5-0c9e-413a-9e42-5bedff59f49d service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Detach interface failed, port_id=183ecc4d-2001-4254-9f1b-af3a43c362dc, reason: Instance f61b5dc6-4b63-439b-9b3d-62ee0a4056d3 could not be found. {{(pid=73078) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 18:23:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d56ffd55-831d-46bf-9868-a2657bcdcaf6 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:23:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d56ffd55-831d-46bf-9868-a2657bcdcaf6 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:23:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:23:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:23:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:23:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:23:53 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-d56ffd55-831d-46bf-9868-a2657bcdcaf6 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:23:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:23:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:23:53 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-d56ffd55-831d-46bf-9868-a2657bcdcaf6 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:23:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d56ffd55-831d-46bf-9868-a2657bcdcaf6 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.532s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:23:53 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-d56ffd55-831d-46bf-9868-a2657bcdcaf6 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Deleted allocations for instance f61b5dc6-4b63-439b-9b3d-62ee0a4056d3
Aug 14 18:23:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:23:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:23:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d56ffd55-831d-46bf-9868-a2657bcdcaf6 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.330s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:23:53 user nova-compute[73078]: DEBUG nova.compute.manager [req-d178e240-65d9-4608-87d9-b01211f92181 req-3d1a094b-96d1-460b-9f9a-62aea5610ee2 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Received event network-vif-plugged-183ecc4d-2001-4254-9f1b-af3a43c362dc {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:23:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d178e240-65d9-4608-87d9-b01211f92181 req-3d1a094b-96d1-460b-9f9a-62aea5610ee2 service nova] Acquiring lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:23:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d178e240-65d9-4608-87d9-b01211f92181 req-3d1a094b-96d1-460b-9f9a-62aea5610ee2 service nova] Lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:23:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d178e240-65d9-4608-87d9-b01211f92181 req-3d1a094b-96d1-460b-9f9a-62aea5610ee2 service nova] Lock "f61b5dc6-4b63-439b-9b3d-62ee0a4056d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:23:53 user nova-compute[73078]: DEBUG nova.compute.manager [req-d178e240-65d9-4608-87d9-b01211f92181 req-3d1a094b-96d1-460b-9f9a-62aea5610ee2 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] No waiting events found dispatching network-vif-plugged-183ecc4d-2001-4254-9f1b-af3a43c362dc {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:23:53 user nova-compute[73078]: WARNING nova.compute.manager [req-d178e240-65d9-4608-87d9-b01211f92181 req-3d1a094b-96d1-460b-9f9a-62aea5610ee2 service nova] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Received unexpected event network-vif-plugged-183ecc4d-2001-4254-9f1b-af3a43c362dc for instance with vm_state deleted and task_state None.
Aug 14 18:23:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:23:54 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:23:54 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Error from libvirt while getting description of instance-00000017: [Error Code 42] Domain not found: no domain with matching uuid 'f61b5dc6-4b63-439b-9b3d-62ee0a4056d3' (instance-00000017): libvirt.libvirtError: Domain not found: no domain with matching uuid 'f61b5dc6-4b63-439b-9b3d-62ee0a4056d3' (instance-00000017)
Aug 14 18:23:54 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:23:54 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:23:54 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=7058MB free_disk=25.110206604003906GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:23:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:23:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:23:54 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance de80e188-9385-4613-8a6c-aa72b624ad55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:23:54 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 1f88cb97-4f22-439e-99f2-d7cb8d5aff36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:23:54 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 3c840309-9884-4c8a-a6ee-1acd44f32c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:23:54 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance a99aa211-c2a1-4240-90cc-2df068d4f669 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:23:54 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 61dfe42b-c943-4617-bf8e-745eaf1a1bb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:23:54 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance adcf1ea7-e7d7-4499-b340-689d25667899 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:23:54 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 35bb08ed-fa84-4157-a27a-f0dd0dee0408 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:23:54 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 4569b529-5c8f-45ec-94fe-58c60f6bcc8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:23:54 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance ef110d5f-afb5-415c-9590-29da006734a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:23:54 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 8ebc48e0-0a24-4421-b180-f14eacc636ad actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:23:54 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 92b0eed8-2a32-4141-ab62-d7914fc6c150 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:23:54 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:23:54 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:23:54 user nova-compute[73078]: DEBUG os_brick.utils [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:23:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:23:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:23:54 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[89be915e-6506-4f6a-8dae-3def3cab85b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:23:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:23:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:23:54 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0994624b-ecda-4e5d-8a69-9ad5df25b403]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:23:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:23:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:23:54 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69b52c6-07d3-4f40-a39f-8f8989c10d81]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:23:54 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2082b372-0062-4909-885e-5da8fce47dcf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:23:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:23:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:23:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:23:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:23:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:23:54 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:23:54 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef293dc0-0372-4486-aa65-419cd2f1852a]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:23:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:23:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:23:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:23:54 user nova-compute[73078]: DEBUG os_brick.utils [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:23:54 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Updating existing volume attachment record: e28ea6ab-119a-49ef-addd-60a00363927c {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:23:55 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:23:55 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:23:55 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:23:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.525s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:23:56 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:23:56 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:23:56 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:23:56 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Didn't find any instances for network info cache update. {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 18:23:56 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:23:56 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:23:56 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:23:56 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:23:56 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:23:56 user nova-compute[73078]: DEBUG nova.compute.manager [req-ac7a41a7-5933-41ed-9a0a-8e1d48be5f2c req-41d1cd04-85c9-45da-8d97-6878645b42e2 service nova] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Received event network-changed-99f07cab-5679-4800-a3ec-cb5e13875eca {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:23:56 user nova-compute[73078]: DEBUG nova.compute.manager [req-ac7a41a7-5933-41ed-9a0a-8e1d48be5f2c req-41d1cd04-85c9-45da-8d97-6878645b42e2 service nova] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Refreshing instance network info cache due to event network-changed-99f07cab-5679-4800-a3ec-cb5e13875eca. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:23:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ac7a41a7-5933-41ed-9a0a-8e1d48be5f2c req-41d1cd04-85c9-45da-8d97-6878645b42e2 service nova] Acquiring lock "refresh_cache-adcf1ea7-e7d7-4499-b340-689d25667899" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:23:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ac7a41a7-5933-41ed-9a0a-8e1d48be5f2c req-41d1cd04-85c9-45da-8d97-6878645b42e2 service nova] Acquired lock "refresh_cache-adcf1ea7-e7d7-4499-b340-689d25667899" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:23:56 user nova-compute[73078]: DEBUG nova.network.neutron [req-ac7a41a7-5933-41ed-9a0a-8e1d48be5f2c req-41d1cd04-85c9-45da-8d97-6878645b42e2 service nova] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Refreshing network info cache for port 99f07cab-5679-4800-a3ec-cb5e13875eca {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:23:56 user nova-compute[73078]: DEBUG nova.network.neutron [req-ac7a41a7-5933-41ed-9a0a-8e1d48be5f2c req-41d1cd04-85c9-45da-8d97-6878645b42e2 service nova] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Updated VIF entry in instance network info cache for port 99f07cab-5679-4800-a3ec-cb5e13875eca. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:23:56 user nova-compute[73078]: DEBUG nova.network.neutron [req-ac7a41a7-5933-41ed-9a0a-8e1d48be5f2c req-41d1cd04-85c9-45da-8d97-6878645b42e2 service nova] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Updating instance_info_cache with network_info: [{"id": "99f07cab-5679-4800-a3ec-cb5e13875eca", "address": "fa:16:3e:66:92:5c", "network": {"id": "48dd4d92-4939-4d78-a62e-e1f8251e0ca9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-788877171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f4a8df8cb194ca49e33819fdca6ad1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f07cab-56", "ovs_interfaceid": "99f07cab-5679-4800-a3ec-cb5e13875eca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:23:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ac7a41a7-5933-41ed-9a0a-8e1d48be5f2c req-41d1cd04-85c9-45da-8d97-6878645b42e2 service nova] Releasing lock "refresh_cache-adcf1ea7-e7d7-4499-b340-689d25667899" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:23:57 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:58 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:23:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-56950901-6864-45ee-a489-1b6b08fb883d tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Acquiring lock "35bb08ed-fa84-4157-a27a-f0dd0dee0408" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:23:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-56950901-6864-45ee-a489-1b6b08fb883d tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Lock "35bb08ed-fa84-4157-a27a-f0dd0dee0408" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:23:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-56950901-6864-45ee-a489-1b6b08fb883d tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Acquiring lock "35bb08ed-fa84-4157-a27a-f0dd0dee0408-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:23:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-56950901-6864-45ee-a489-1b6b08fb883d tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Lock "35bb08ed-fa84-4157-a27a-f0dd0dee0408-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:23:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-56950901-6864-45ee-a489-1b6b08fb883d tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Lock "35bb08ed-fa84-4157-a27a-f0dd0dee0408-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:23:58 user nova-compute[73078]: INFO nova.compute.manager [None req-56950901-6864-45ee-a489-1b6b08fb883d tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Terminating instance
Aug 14 18:23:58 user nova-compute[73078]: DEBUG nova.compute.manager [None req-56950901-6864-45ee-a489-1b6b08fb883d tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:23:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:59 user nova-compute[73078]: DEBUG nova.compute.manager [req-cc50d462-85b5-41b4-94e3-577272b923a0 req-d90115c9-f974-40c2-979c-0173d154041f service nova] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Received event network-vif-unplugged-3fca973c-b77d-440c-acef-5c93a377bd97 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:23:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-cc50d462-85b5-41b4-94e3-577272b923a0 req-d90115c9-f974-40c2-979c-0173d154041f service nova] Acquiring lock "35bb08ed-fa84-4157-a27a-f0dd0dee0408-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:23:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-cc50d462-85b5-41b4-94e3-577272b923a0 req-d90115c9-f974-40c2-979c-0173d154041f service nova] Lock "35bb08ed-fa84-4157-a27a-f0dd0dee0408-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:23:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-cc50d462-85b5-41b4-94e3-577272b923a0 req-d90115c9-f974-40c2-979c-0173d154041f service nova] Lock "35bb08ed-fa84-4157-a27a-f0dd0dee0408-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:23:59 user nova-compute[73078]: DEBUG nova.compute.manager [req-cc50d462-85b5-41b4-94e3-577272b923a0 req-d90115c9-f974-40c2-979c-0173d154041f service nova] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] No waiting events found dispatching network-vif-unplugged-3fca973c-b77d-440c-acef-5c93a377bd97 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:23:59 user nova-compute[73078]: DEBUG nova.compute.manager [req-cc50d462-85b5-41b4-94e3-577272b923a0 req-d90115c9-f974-40c2-979c-0173d154041f service nova] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Received event network-vif-unplugged-3fca973c-b77d-440c-acef-5c93a377bd97 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:23:59 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Instance destroyed successfully.
Aug 14 18:23:59 user nova-compute[73078]: DEBUG nova.objects.instance [None req-56950901-6864-45ee-a489-1b6b08fb883d tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Lazy-loading 'resources' on Instance uuid 35bb08ed-fa84-4157-a27a-f0dd0dee0408 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:23:59 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-56950901-6864-45ee-a489-1b6b08fb883d tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:22:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-867205447',display_name='tempest-VolumesNegativeTest-instance-867205447',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-867205447',id=28,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:22:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20af5b7e636141fd9a66b093d31cc402',ramdisk_id='',reservation_id='r-ctvoxr36',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1898058481',owner_user_name='tempest-VolumesNegativeTest-1898058481-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:22:17Z,user_data=None,user_id='629ed9aedb14440cbab218c4b7d2015b',uuid=35bb08ed-fa84-4157-a27a-f0dd0dee0408,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3fca973c-b77d-440c-acef-5c93a377bd97", "address": "fa:16:3e:1e:0f:c2", "network": {"id": "3408f138-e61d-4540-b517-56b583c571b5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9d74e47e937341ec928819ea23835937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fca973c-b7", "ovs_interfaceid": "3fca973c-b77d-440c-acef-5c93a377bd97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:23:59 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-56950901-6864-45ee-a489-1b6b08fb883d tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Converting VIF {"id": "3fca973c-b77d-440c-acef-5c93a377bd97", "address": "fa:16:3e:1e:0f:c2", "network": {"id": "3408f138-e61d-4540-b517-56b583c571b5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9d74e47e937341ec928819ea23835937", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fca973c-b7", "ovs_interfaceid": "3fca973c-b77d-440c-acef-5c93a377bd97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:23:59 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-56950901-6864-45ee-a489-1b6b08fb883d tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:0f:c2,bridge_name='br-int',has_traffic_filtering=True,id=3fca973c-b77d-440c-acef-5c93a377bd97,network=Network(3408f138-e61d-4540-b517-56b583c571b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fca973c-b7') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:23:59 user nova-compute[73078]: DEBUG os_vif [None req-56950901-6864-45ee-a489-1b6b08fb883d tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:0f:c2,bridge_name='br-int',has_traffic_filtering=True,id=3fca973c-b77d-440c-acef-5c93a377bd97,network=Network(3408f138-e61d-4540-b517-56b583c571b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fca973c-b7') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:23:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3fca973c-b7, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:23:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:23:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:23:59 user nova-compute[73078]: INFO os_vif [None req-56950901-6864-45ee-a489-1b6b08fb883d tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:0f:c2,bridge_name='br-int',has_traffic_filtering=True,id=3fca973c-b77d-440c-acef-5c93a377bd97,network=Network(3408f138-e61d-4540-b517-56b583c571b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fca973c-b7')
Aug 14 18:23:59 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-56950901-6864-45ee-a489-1b6b08fb883d tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Deleting instance files /opt/stack/data/nova/instances/35bb08ed-fa84-4157-a27a-f0dd0dee0408_del
Aug 14 18:23:59 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-56950901-6864-45ee-a489-1b6b08fb883d tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Deletion of /opt/stack/data/nova/instances/35bb08ed-fa84-4157-a27a-f0dd0dee0408_del complete
Aug 14 18:23:59 user nova-compute[73078]: INFO nova.compute.manager [None req-56950901-6864-45ee-a489-1b6b08fb883d tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Took 0.68 seconds to destroy the instance on the hypervisor.
Aug 14 18:23:59 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-56950901-6864-45ee-a489-1b6b08fb883d tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:23:59 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:23:59 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:24:00 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:24:00 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Took 0.52 seconds to deallocate network for instance.
Aug 14 18:24:00 user nova-compute[73078]: DEBUG nova.compute.manager [req-05396aba-cee8-461c-ae67-0e1d90afb50d req-b7b7aadb-376c-40ab-a58d-faf4d9324ba0 service nova] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Received event network-vif-deleted-3fca973c-b77d-440c-acef-5c93a377bd97 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:24:00 user nova-compute[73078]: INFO nova.compute.manager [req-05396aba-cee8-461c-ae67-0e1d90afb50d req-b7b7aadb-376c-40ab-a58d-faf4d9324ba0 service nova] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Neutron deleted interface 3fca973c-b77d-440c-acef-5c93a377bd97; detaching it from the instance and deleting it from the info cache
Aug 14 18:24:00 user nova-compute[73078]: DEBUG nova.network.neutron [req-05396aba-cee8-461c-ae67-0e1d90afb50d req-b7b7aadb-376c-40ab-a58d-faf4d9324ba0 service nova] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:24:00 user nova-compute[73078]: DEBUG nova.compute.manager [req-05396aba-cee8-461c-ae67-0e1d90afb50d req-b7b7aadb-376c-40ab-a58d-faf4d9324ba0 service nova] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Detach interface failed, port_id=3fca973c-b77d-440c-acef-5c93a377bd97, reason: Instance 35bb08ed-fa84-4157-a27a-f0dd0dee0408 could not be found. {{(pid=73078) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 18:24:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-56950901-6864-45ee-a489-1b6b08fb883d tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-56950901-6864-45ee-a489-1b6b08fb883d tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:00 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-56950901-6864-45ee-a489-1b6b08fb883d tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:24:00 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-56950901-6864-45ee-a489-1b6b08fb883d tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:24:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-56950901-6864-45ee-a489-1b6b08fb883d tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:00 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-56950901-6864-45ee-a489-1b6b08fb883d tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Deleted allocations for instance 35bb08ed-fa84-4157-a27a-f0dd0dee0408
Aug 14 18:24:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-56950901-6864-45ee-a489-1b6b08fb883d tempest-VolumesNegativeTest-1898058481 tempest-VolumesNegativeTest-1898058481-project-member] Lock "35bb08ed-fa84-4157-a27a-f0dd0dee0408" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.680s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:01 user nova-compute[73078]: DEBUG nova.compute.manager [req-e4bf5463-80d3-4491-a1f9-c2972f63225b req-c6b7367f-4e38-4c49-a0f7-7d2142026b26 service nova] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Received event network-vif-plugged-3fca973c-b77d-440c-acef-5c93a377bd97 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:24:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e4bf5463-80d3-4491-a1f9-c2972f63225b req-c6b7367f-4e38-4c49-a0f7-7d2142026b26 service nova] Acquiring lock "35bb08ed-fa84-4157-a27a-f0dd0dee0408-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e4bf5463-80d3-4491-a1f9-c2972f63225b req-c6b7367f-4e38-4c49-a0f7-7d2142026b26 service nova] Lock "35bb08ed-fa84-4157-a27a-f0dd0dee0408-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e4bf5463-80d3-4491-a1f9-c2972f63225b req-c6b7367f-4e38-4c49-a0f7-7d2142026b26 service nova] Lock "35bb08ed-fa84-4157-a27a-f0dd0dee0408-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:01 user nova-compute[73078]: DEBUG nova.compute.manager [req-e4bf5463-80d3-4491-a1f9-c2972f63225b req-c6b7367f-4e38-4c49-a0f7-7d2142026b26 service nova] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] No waiting events found dispatching network-vif-plugged-3fca973c-b77d-440c-acef-5c93a377bd97 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:24:01 user nova-compute[73078]: WARNING nova.compute.manager [req-e4bf5463-80d3-4491-a1f9-c2972f63225b req-c6b7367f-4e38-4c49-a0f7-7d2142026b26 service nova] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Received unexpected event network-vif-plugged-3fca973c-b77d-440c-acef-5c93a377bd97 for instance with vm_state deleted and task_state None.
Aug 14 18:24:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Acquiring lock "adcf1ea7-e7d7-4499-b340-689d25667899" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Lock "adcf1ea7-e7d7-4499-b340-689d25667899" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:01 user nova-compute[73078]: DEBUG nova.objects.instance [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Lazy-loading 'flavor' on Instance uuid adcf1ea7-e7d7-4499-b340-689d25667899 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:24:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Lock "adcf1ea7-e7d7-4499-b340-689d25667899" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Acquiring lock "adcf1ea7-e7d7-4499-b340-689d25667899" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Lock "adcf1ea7-e7d7-4499-b340-689d25667899" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:01 user nova-compute[73078]: INFO nova.compute.manager [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Attaching volume 38e13e0e-c970-4851-b91a-cb8e956df934 to /dev/vdb
Aug 14 18:24:01 user nova-compute[73078]: DEBUG os_brick.utils [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:24:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:01 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89baee3-4b02-4a84-84ed-c408b92dec27]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:01 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[16508872-86ec-402a-8b06-ec07759d2756]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:01 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d880a205-9cbf-4f80-9458-f87c3418f6df]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:01 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[29540984-0504-4dfd-a8d9-846a698669a6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:24:01 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:24:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:24:01 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:24:01 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d89852-7fc1-41ab-979f-8e7d90c0b84c]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:01 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:24:01 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:24:01 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:24:01 user nova-compute[73078]: DEBUG os_brick.utils [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:24:01 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Updating existing volume attachment record: fbcd8f53-0d07-413a-8675-e4c73c1524a8 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:24:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG nova.compute.manager [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:24:06 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Creating image(s)
Aug 14 18:24:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Did not create local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Ensure instance console log exists: /opt/stack/data/nova/instances/92b0eed8-2a32-4141-ab62-d7914fc6c150/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Start _get_guest_xml network_info=[{"id": "765affb6-4f4c-4efb-a870-fb693de04c6c", "address": "fa:16:3e:dd:d5:68", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765affb6-4f", "ovs_interfaceid": "765affb6-4f4c-4efb-a870-fb693de04c6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'e28ea6ab-119a-49ef-addd-60a00363927c', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'soalpEIn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '92b0eed8-2a32-4141-ab62-d7914fc6c150', 'attached_at': '', 'detached_at': '', 'volume_id': 'f339d02c-1c41-48c3-b358-f3f8d99530e8', 'serial': 'f339d02c-1c41-48c3-b358-f3f8d99530e8'}, 'volume_type': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:24:06 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:24:06 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:24:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'soalpEIn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:24:06 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:24:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:24:06 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:24:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:24:06 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:24:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6760e37b-52c5-4c65-9856-900cfc2fdbfa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:24:06 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e390895-c4ef-4c09-8f30-5e88747b9612]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8] added
Aug 14 18:24:06 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b156b6-7070-4dfd-946e-d9581d0f53ee]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a80bbb6-9763-49ee-a3f0-57b97a75036e]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v soalpEIn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v soalpEIn" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e59aeff-7542-47b4-ad2b-2d5de3a1d590]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'soalpEIn'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[56118dac-bdb3-46e6-98dc-46ba8216ad42]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd35995-611e-45d2-8f69-584b4ecda224]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:24:07 user nova-compute[73078]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:24:07 user nova-compute[73078]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:24:07 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:24:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:24:07 user nova-compute[73078]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:24:07 user nova-compute[73078]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:24:07 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:24:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca2e164-0bd0-4cf8-9eba-5c0de03d6b61]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8, portal: 172.16.0.220,3260]
Aug 14 18:24:07 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8, portal: 172.16.0.220,3260] successful.
Aug 14 18:24:07 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed3873d-8525-48b2-ad4a-12ae24cea5fb]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86116d3-3ba4-4fa7-b02c-ed9a58150719]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:24:07 user nova-compute[73078]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:24:07 user nova-compute[73078]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:24:07 user nova-compute[73078]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 (non-flash)
Aug 14 18:24:07 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:24:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:24:07 user nova-compute[73078]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:24:07 user nova-compute[73078]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:24:07 user nova-compute[73078]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 (non-flash)
Aug 14 18:24:07 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:24:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:24:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:24:07 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:24:07 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:24:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9390ec0e-094f-4a04-8e3c-b932b3e37bf8]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:07 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:24:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'soalpEIn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:24:07 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692037432.3658512, f61b5dc6-4b63-439b-9b3d-62ee0a4056d3 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:24:07 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] VM Stopped (Lifecycle Event)
Aug 14 18:24:07 user nova-compute[73078]: DEBUG nova.compute.manager [None req-244dc1fe-0297-401c-83c9-46421cbd9b51 None None] [instance: f61b5dc6-4b63-439b-9b3d-62ee0a4056d3] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:24:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-3b1bc610-9a04-436e-8971-215ff73faac5 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-3b1bc610-9a04-436e-8971-215ff73faac5 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-3b1bc610-9a04-436e-8971-215ff73faac5 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-3b1bc610-9a04-436e-8971-215ff73faac5 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-3b1bc610-9a04-436e-8971-215ff73faac5 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:07 user nova-compute[73078]: INFO nova.compute.manager [None req-3b1bc610-9a04-436e-8971-215ff73faac5 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Terminating instance
Aug 14 18:24:07 user nova-compute[73078]: DEBUG nova.compute.manager [None req-3b1bc610-9a04-436e-8971-215ff73faac5 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:24:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23137383062363163', 'path': '/dev/sdc'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137383062363163', 'path': '/dev/sdc'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:23:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1710990244',display_name='tempest-TestVolumeBootPattern-server-1710990244',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1710990244',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7142101014c4defa7261a34fb9f28e4',ramdisk_id='',reservation_id='r-oi2d0knd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1889877750',owner_user_name='tempest-TestVolumeBootPattern-1889877750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:23:49Z,user_data=None,user_id='fe79455616584e0fb80e6007edf0b706',uuid=92b0eed8-2a32-4141-ab62-d7914fc6c150,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "765affb6-4f4c-4efb-a870-fb693de04c6c", "address": "fa:16:3e:dd:d5:68", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765affb6-4f", "ovs_interfaceid": "765affb6-4f4c-4efb-a870-fb693de04c6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Converting VIF {"id": "765affb6-4f4c-4efb-a870-fb693de04c6c", "address": "fa:16:3e:dd:d5:68", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765affb6-4f", "ovs_interfaceid": "765affb6-4f4c-4efb-a870-fb693de04c6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:d5:68,bridge_name='br-int',has_traffic_filtering=True,id=765affb6-4f4c-4efb-a870-fb693de04c6c,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap765affb6-4f') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG nova.objects.instance [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lazy-loading 'pci_devices' on Instance uuid 92b0eed8-2a32-4141-ab62-d7914fc6c150 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:24:08 user nova-compute[73078]:   <uuid>92b0eed8-2a32-4141-ab62-d7914fc6c150</uuid>
Aug 14 18:24:08 user nova-compute[73078]:   <name>instance-0000001e</name>
Aug 14 18:24:08 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:24:08 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:24:08 user nova-compute[73078]:   <metadata>
Aug 14 18:24:08 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:24:08 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:24:08 user nova-compute[73078]:       <nova:name>tempest-TestVolumeBootPattern-server-1710990244</nova:name>
Aug 14 18:24:08 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:24:06</nova:creationTime>
Aug 14 18:24:08 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:24:08 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:24:08 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:24:08 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:24:08 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:24:08 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:24:08 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:24:08 user nova-compute[73078]:       <nova:owner>
Aug 14 18:24:08 user nova-compute[73078]:         <nova:user uuid="fe79455616584e0fb80e6007edf0b706">tempest-TestVolumeBootPattern-1889877750-project-member</nova:user>
Aug 14 18:24:08 user nova-compute[73078]:         <nova:project uuid="e7142101014c4defa7261a34fb9f28e4">tempest-TestVolumeBootPattern-1889877750</nova:project>
Aug 14 18:24:08 user nova-compute[73078]:       </nova:owner>
Aug 14 18:24:08 user nova-compute[73078]:       <nova:ports>
Aug 14 18:24:08 user nova-compute[73078]:         <nova:port uuid="765affb6-4f4c-4efb-a870-fb693de04c6c">
Aug 14 18:24:08 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 18:24:08 user nova-compute[73078]:         </nova:port>
Aug 14 18:24:08 user nova-compute[73078]:       </nova:ports>
Aug 14 18:24:08 user nova-compute[73078]:     </nova:instance>
Aug 14 18:24:08 user nova-compute[73078]:   </metadata>
Aug 14 18:24:08 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:24:08 user nova-compute[73078]:     <system>
Aug 14 18:24:08 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:24:08 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:24:08 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:24:08 user nova-compute[73078]:       <entry name="serial">92b0eed8-2a32-4141-ab62-d7914fc6c150</entry>
Aug 14 18:24:08 user nova-compute[73078]:       <entry name="uuid">92b0eed8-2a32-4141-ab62-d7914fc6c150</entry>
Aug 14 18:24:08 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:24:08 user nova-compute[73078]:     </system>
Aug 14 18:24:08 user nova-compute[73078]:   </sysinfo>
Aug 14 18:24:08 user nova-compute[73078]:   <os>
Aug 14 18:24:08 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:24:08 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:24:08 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:24:08 user nova-compute[73078]:   </os>
Aug 14 18:24:08 user nova-compute[73078]:   <features>
Aug 14 18:24:08 user nova-compute[73078]:     <acpi/>
Aug 14 18:24:08 user nova-compute[73078]:     <apic/>
Aug 14 18:24:08 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:24:08 user nova-compute[73078]:   </features>
Aug 14 18:24:08 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:24:08 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:24:08 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:24:08 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:24:08 user nova-compute[73078]:   </clock>
Aug 14 18:24:08 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:24:08 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:24:08 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:24:08 user nova-compute[73078]:   </cpu>
Aug 14 18:24:08 user nova-compute[73078]:   <devices>
Aug 14 18:24:08 user nova-compute[73078]:     <disk type="block" device="disk">
Aug 14 18:24:08 user nova-compute[73078]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:24:08 user nova-compute[73078]:       <source dev="/dev/sdc"/>
Aug 14 18:24:08 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:24:08 user nova-compute[73078]:       <serial>f339d02c-1c41-48c3-b358-f3f8d99530e8</serial>
Aug 14 18:24:08 user nova-compute[73078]:     </disk>
Aug 14 18:24:08 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:24:08 user nova-compute[73078]:       <mac address="fa:16:3e:dd:d5:68"/>
Aug 14 18:24:08 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:24:08 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:24:08 user nova-compute[73078]:       <target dev="tap765affb6-4f"/>
Aug 14 18:24:08 user nova-compute[73078]:     </interface>
Aug 14 18:24:08 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:24:08 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/92b0eed8-2a32-4141-ab62-d7914fc6c150/console.log" append="off"/>
Aug 14 18:24:08 user nova-compute[73078]:     </serial>
Aug 14 18:24:08 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:24:08 user nova-compute[73078]:     <video>
Aug 14 18:24:08 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:24:08 user nova-compute[73078]:     </video>
Aug 14 18:24:08 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:24:08 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:24:08 user nova-compute[73078]:     </rng>
Aug 14 18:24:08 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:24:08 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:24:08 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:24:08 user nova-compute[73078]:     </memballoon>
Aug 14 18:24:08 user nova-compute[73078]:   </devices>
Aug 14 18:24:08 user nova-compute[73078]: </domain>
Aug 14 18:24:08 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:23:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1710990244',display_name='tempest-TestVolumeBootPattern-server-1710990244',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1710990244',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7142101014c4defa7261a34fb9f28e4',ramdisk_id='',reservation_id='r-oi2d0knd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1889877750',owner_user_name='tempest-TestVolumeBootPattern-1889877750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:23:49Z,user_data=None,user_id='fe79455616584e0fb80e6007edf0b706',uuid=92b0eed8-2a32-4141-ab62-d7914fc6c150,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "765affb6-4f4c-4efb-a870-fb693de04c6c", "address": "fa:16:3e:dd:d5:68", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765affb6-4f", "ovs_interfaceid": "765affb6-4f4c-4efb-a870-fb693de04c6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Converting VIF {"id": "765affb6-4f4c-4efb-a870-fb693de04c6c", "address": "fa:16:3e:dd:d5:68", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765affb6-4f", "ovs_interfaceid": "765affb6-4f4c-4efb-a870-fb693de04c6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:d5:68,bridge_name='br-int',has_traffic_filtering=True,id=765affb6-4f4c-4efb-a870-fb693de04c6c,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap765affb6-4f') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG os_vif [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:d5:68,bridge_name='br-int',has_traffic_filtering=True,id=765affb6-4f4c-4efb-a870-fb693de04c6c,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap765affb6-4f') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap765affb6-4f, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap765affb6-4f, col_values=(('external_ids', {'iface-id': '765affb6-4f4c-4efb-a870-fb693de04c6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:d5:68', 'vm-uuid': '92b0eed8-2a32-4141-ab62-d7914fc6c150'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:08 user nova-compute[73078]: INFO os_vif [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:d5:68,bridge_name='br-int',has_traffic_filtering=True,id=765affb6-4f4c-4efb-a870-fb693de04c6c,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap765affb6-4f')
Aug 14 18:24:08 user nova-compute[73078]: DEBUG nova.compute.manager [req-e976fbec-e6df-4389-8a93-bec737711ae1 req-cfee6b7b-2189-4e82-8d67-2828162adc93 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Received event network-vif-unplugged-08a212c4-6236-4adc-a3ec-6b76341585b3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e976fbec-e6df-4389-8a93-bec737711ae1 req-cfee6b7b-2189-4e82-8d67-2828162adc93 service nova] Acquiring lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e976fbec-e6df-4389-8a93-bec737711ae1 req-cfee6b7b-2189-4e82-8d67-2828162adc93 service nova] Lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e976fbec-e6df-4389-8a93-bec737711ae1 req-cfee6b7b-2189-4e82-8d67-2828162adc93 service nova] Lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG nova.compute.manager [req-e976fbec-e6df-4389-8a93-bec737711ae1 req-cfee6b7b-2189-4e82-8d67-2828162adc93 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] No waiting events found dispatching network-vif-unplugged-08a212c4-6236-4adc-a3ec-6b76341585b3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG nova.compute.manager [req-e976fbec-e6df-4389-8a93-bec737711ae1 req-cfee6b7b-2189-4e82-8d67-2828162adc93 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Received event network-vif-unplugged-08a212c4-6236-4adc-a3ec-6b76341585b3 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] No VIF found with MAC fa:16:3e:dd:d5:68, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:24:08 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Instance destroyed successfully.
Aug 14 18:24:08 user nova-compute[73078]: DEBUG nova.objects.instance [None req-3b1bc610-9a04-436e-8971-215ff73faac5 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lazy-loading 'resources' on Instance uuid 4569b529-5c8f-45ec-94fe-58c60f6bcc8a {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-3b1bc610-9a04-436e-8971-215ff73faac5 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T18:18:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-747135967',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-747135967',id=22,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBen6FWZ25Rn4AUFT59E6dGpvbFjj5V25k1Dtd5tlTQ8uteSHDv2JBkULY0OdKYhFtwts5/QeT/t58JgQY7L7c1Vp8+VsK8w/J53StMt+e8AdH3CtgsWBpB1AniYT9Ch0w==',key_name='tempest-keypair-452969408',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:22:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f00de2496804d6eb570f93307f3f088',ramdisk_id='',reservation_id='r-9qv8yi0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1593185714',owner_user_name='tempest-AttachVolumeShelveTestJSON-1593185714-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:22:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b07aecccb704835b6b765325b1d18bf',uuid=4569b529-5c8f-45ec-94fe-58c60f6bcc8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08a212c4-6236-4adc-a3ec-6b76341585b3", "address": "fa:16:3e:4f:04:0e", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a212c4-62", "ovs_interfaceid": "08a212c4-6236-4adc-a3ec-6b76341585b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-3b1bc610-9a04-436e-8971-215ff73faac5 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Converting VIF {"id": "08a212c4-6236-4adc-a3ec-6b76341585b3", "address": "fa:16:3e:4f:04:0e", "network": {"id": "a3adc062-ecf8-4c88-84ab-69425b236920", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1867861806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f00de2496804d6eb570f93307f3f088", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a212c4-62", "ovs_interfaceid": "08a212c4-6236-4adc-a3ec-6b76341585b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-3b1bc610-9a04-436e-8971-215ff73faac5 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:04:0e,bridge_name='br-int',has_traffic_filtering=True,id=08a212c4-6236-4adc-a3ec-6b76341585b3,network=Network(a3adc062-ecf8-4c88-84ab-69425b236920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08a212c4-62') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG os_vif [None req-3b1bc610-9a04-436e-8971-215ff73faac5 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:04:0e,bridge_name='br-int',has_traffic_filtering=True,id=08a212c4-6236-4adc-a3ec-6b76341585b3,network=Network(a3adc062-ecf8-4c88-84ab-69425b236920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08a212c4-62') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08a212c4-62, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:24:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:08 user nova-compute[73078]: INFO os_vif [None req-3b1bc610-9a04-436e-8971-215ff73faac5 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:04:0e,bridge_name='br-int',has_traffic_filtering=True,id=08a212c4-6236-4adc-a3ec-6b76341585b3,network=Network(a3adc062-ecf8-4c88-84ab-69425b236920),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08a212c4-62')
Aug 14 18:24:08 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-3b1bc610-9a04-436e-8971-215ff73faac5 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Deleting instance files /opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a_del
Aug 14 18:24:09 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-3b1bc610-9a04-436e-8971-215ff73faac5 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Deletion of /opt/stack/data/nova/instances/4569b529-5c8f-45ec-94fe-58c60f6bcc8a_del complete
Aug 14 18:24:09 user nova-compute[73078]: INFO nova.compute.manager [None req-3b1bc610-9a04-436e-8971-215ff73faac5 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 14 18:24:09 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-3b1bc610-9a04-436e-8971-215ff73faac5 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:24:09 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:24:09 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:24:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:10 user nova-compute[73078]: DEBUG nova.compute.manager [req-e2b5d308-bdef-4319-9b34-1500291186db req-4c2675e8-cb44-4089-8040-c50c7827aa6a service nova] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Received event network-vif-plugged-765affb6-4f4c-4efb-a870-fb693de04c6c {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:24:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e2b5d308-bdef-4319-9b34-1500291186db req-4c2675e8-cb44-4089-8040-c50c7827aa6a service nova] Acquiring lock "92b0eed8-2a32-4141-ab62-d7914fc6c150-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e2b5d308-bdef-4319-9b34-1500291186db req-4c2675e8-cb44-4089-8040-c50c7827aa6a service nova] Lock "92b0eed8-2a32-4141-ab62-d7914fc6c150-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e2b5d308-bdef-4319-9b34-1500291186db req-4c2675e8-cb44-4089-8040-c50c7827aa6a service nova] Lock "92b0eed8-2a32-4141-ab62-d7914fc6c150-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:10 user nova-compute[73078]: DEBUG nova.compute.manager [req-e2b5d308-bdef-4319-9b34-1500291186db req-4c2675e8-cb44-4089-8040-c50c7827aa6a service nova] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] No waiting events found dispatching network-vif-plugged-765affb6-4f4c-4efb-a870-fb693de04c6c {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:24:10 user nova-compute[73078]: WARNING nova.compute.manager [req-e2b5d308-bdef-4319-9b34-1500291186db req-4c2675e8-cb44-4089-8040-c50c7827aa6a service nova] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Received unexpected event network-vif-plugged-765affb6-4f4c-4efb-a870-fb693de04c6c for instance with vm_state building and task_state spawning.
Aug 14 18:24:10 user nova-compute[73078]: DEBUG nova.compute.manager [req-d12b6381-a665-4875-b36f-9d5f441bd43c req-f9f2c02e-5512-40a0-bb50-61f49726a898 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Received event network-vif-plugged-08a212c4-6236-4adc-a3ec-6b76341585b3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:24:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d12b6381-a665-4875-b36f-9d5f441bd43c req-f9f2c02e-5512-40a0-bb50-61f49726a898 service nova] Acquiring lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d12b6381-a665-4875-b36f-9d5f441bd43c req-f9f2c02e-5512-40a0-bb50-61f49726a898 service nova] Lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d12b6381-a665-4875-b36f-9d5f441bd43c req-f9f2c02e-5512-40a0-bb50-61f49726a898 service nova] Lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:10 user nova-compute[73078]: DEBUG nova.compute.manager [req-d12b6381-a665-4875-b36f-9d5f441bd43c req-f9f2c02e-5512-40a0-bb50-61f49726a898 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] No waiting events found dispatching network-vif-plugged-08a212c4-6236-4adc-a3ec-6b76341585b3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:24:10 user nova-compute[73078]: WARNING nova.compute.manager [req-d12b6381-a665-4875-b36f-9d5f441bd43c req-f9f2c02e-5512-40a0-bb50-61f49726a898 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Received unexpected event network-vif-plugged-08a212c4-6236-4adc-a3ec-6b76341585b3 for instance with vm_state active and task_state deleting.
Aug 14 18:24:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:10 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:24:10 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Took 1.70 seconds to deallocate network for instance.
Aug 14 18:24:10 user nova-compute[73078]: DEBUG nova.compute.manager [req-9d700f27-4bf7-4313-b1fe-d08bf42db6a6 req-7b9ffef4-6563-486b-ac41-f12cd818f2b6 service nova] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Received event network-vif-deleted-08a212c4-6236-4adc-a3ec-6b76341585b3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:24:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-3b1bc610-9a04-436e-8971-215ff73faac5 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-3b1bc610-9a04-436e-8971-215ff73faac5 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:11 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-3b1bc610-9a04-436e-8971-215ff73faac5 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:24:11 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-3b1bc610-9a04-436e-8971-215ff73faac5 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:24:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-3b1bc610-9a04-436e-8971-215ff73faac5 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:11 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-3b1bc610-9a04-436e-8971-215ff73faac5 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Deleted allocations for instance 4569b529-5c8f-45ec-94fe-58c60f6bcc8a
Aug 14 18:24:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-3b1bc610-9a04-436e-8971-215ff73faac5 tempest-AttachVolumeShelveTestJSON-1593185714 tempest-AttachVolumeShelveTestJSON-1593185714-project-member] Lock "4569b529-5c8f-45ec-94fe-58c60f6bcc8a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.340s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:12 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037452.0536048, 92b0eed8-2a32-4141-ab62-d7914fc6c150 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:24:12 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] VM Resumed (Lifecycle Event)
Aug 14 18:24:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:24:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:24:12 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Instance spawned successfully.
Aug 14 18:24:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:24:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:24:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:24:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:24:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:24:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:24:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:24:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:24:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:24:12 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:24:12 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037452.053757, 92b0eed8-2a32-4141-ab62-d7914fc6c150 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:24:12 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] VM Started (Lifecycle Event)
Aug 14 18:24:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:24:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:24:12 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:24:12 user nova-compute[73078]: INFO nova.compute.manager [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Took 5.40 seconds to spawn the instance on the hypervisor.
Aug 14 18:24:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:24:12 user nova-compute[73078]: DEBUG nova.compute.manager [req-3621b79c-312a-4488-80b3-5b58218f0411 req-5e4ceb71-a6d3-4073-ab99-8f7ad87002bb service nova] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Received event network-vif-plugged-765affb6-4f4c-4efb-a870-fb693de04c6c {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:24:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3621b79c-312a-4488-80b3-5b58218f0411 req-5e4ceb71-a6d3-4073-ab99-8f7ad87002bb service nova] Acquiring lock "92b0eed8-2a32-4141-ab62-d7914fc6c150-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3621b79c-312a-4488-80b3-5b58218f0411 req-5e4ceb71-a6d3-4073-ab99-8f7ad87002bb service nova] Lock "92b0eed8-2a32-4141-ab62-d7914fc6c150-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3621b79c-312a-4488-80b3-5b58218f0411 req-5e4ceb71-a6d3-4073-ab99-8f7ad87002bb service nova] Lock "92b0eed8-2a32-4141-ab62-d7914fc6c150-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:12 user nova-compute[73078]: DEBUG nova.compute.manager [req-3621b79c-312a-4488-80b3-5b58218f0411 req-5e4ceb71-a6d3-4073-ab99-8f7ad87002bb service nova] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] No waiting events found dispatching network-vif-plugged-765affb6-4f4c-4efb-a870-fb693de04c6c {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:24:12 user nova-compute[73078]: WARNING nova.compute.manager [req-3621b79c-312a-4488-80b3-5b58218f0411 req-5e4ceb71-a6d3-4073-ab99-8f7ad87002bb service nova] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Received unexpected event network-vif-plugged-765affb6-4f4c-4efb-a870-fb693de04c6c for instance with vm_state building and task_state spawning.
Aug 14 18:24:12 user nova-compute[73078]: INFO nova.compute.manager [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Took 24.13 seconds to build instance.
Aug 14 18:24:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8eb70cb2-13f2-41f8-98ef-541f5f2f8dd0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "92b0eed8-2a32-4141-ab62-d7914fc6c150" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.251s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:14 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692037439.4221168, 35bb08ed-fa84-4157-a27a-f0dd0dee0408 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:24:14 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] VM Stopped (Lifecycle Event)
Aug 14 18:24:14 user nova-compute[73078]: DEBUG nova.compute.manager [None req-20548264-3f06-4ffa-8b72-85d1d5f3f23d None None] [instance: 35bb08ed-fa84-4157-a27a-f0dd0dee0408] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnsvIEfF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:24:15 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:24:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:24:15 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:24:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:24:15 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:24:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cdceea-7ba2-43d4-aeaf-b1842279b4dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:24:15 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb09d6d-e1dc-4ddb-8a5a-25751b7dc174]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934] added
Aug 14 18:24:15 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59d21ac-4036-46c6-a0f6-4d0d338f69d5]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6964d1e7-4af8-489a-9344-85b37b6b0ced]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MnsvIEfF {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MnsvIEfF" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[df25dd69-da4d-4ac7-92c2-b9a78ef8fec9]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MnsvIEfF'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2866da86-0866-42ae-afeb-f3645381c7e5]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c6c549-fa05-4310-9d5f-abb5584907d0]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:24:15 user nova-compute[73078]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:24:15 user nova-compute[73078]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:24:15 user nova-compute[73078]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 (non-flash)
Aug 14 18:24:15 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:24:15 user nova-compute[73078]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:24:15 user nova-compute[73078]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:24:15 user nova-compute[73078]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 (non-flash)
Aug 14 18:24:15 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e238bf-5416-4399-978c-a52dcf89e40c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934, portal: 172.16.0.220,3260]
Aug 14 18:24:15 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934, portal: 172.16.0.220,3260] successful.
Aug 14 18:24:15 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8f84df-5c0c-4263-8ae3-e8f0b8978746]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b588939-e8e3-4baa-9052-17c0f76c9a4f]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:24:15 user nova-compute[73078]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:24:15 user nova-compute[73078]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:24:15 user nova-compute[73078]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 (non-flash)
Aug 14 18:24:15 user nova-compute[73078]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934 (non-flash)
Aug 14 18:24:15 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:24:15 user nova-compute[73078]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:24:15 user nova-compute[73078]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:24:15 user nova-compute[73078]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 (non-flash)
Aug 14 18:24:15 user nova-compute[73078]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934 (non-flash)
Aug 14 18:24:15 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] HCTL ('37', '-', '-', 0) found on session 36 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c71473b-e88a-4b22-8332-d5b126ed7d01]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:24:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnsvIEfF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:24:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "3088da30-65b7-4801-b425-93df4fca6ad8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "3088da30-65b7-4801-b425-93df4fca6ad8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:16 user nova-compute[73078]: DEBUG nova.compute.manager [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:24:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:16 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:24:16 user nova-compute[73078]: INFO nova.compute.claims [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Claim successful on node user
Aug 14 18:24:17 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:24:17 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23262363366646133', 'path': '/dev/sdf'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:24:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262363366646133', 'path': '/dev/sdf'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:24:17 user nova-compute[73078]: DEBUG nova.objects.instance [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Lazy-loading 'flavor' on Instance uuid adcf1ea7-e7d7-4499-b340-689d25667899 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:24:17 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:24:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 18:24:17 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:24:17 user nova-compute[73078]:   <source dev="/dev/sdf"/>
Aug 14 18:24:17 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:24:17 user nova-compute[73078]:   <serial>38e13e0e-c970-4851-b91a-cb8e956df934</serial>
Aug 14 18:24:17 user nova-compute[73078]: </disk>
Aug 14 18:24:17 user nova-compute[73078]:  {{(pid=73078) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 18:24:17 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:24:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:17 user nova-compute[73078]: DEBUG nova.compute.manager [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:24:17 user nova-compute[73078]: DEBUG nova.compute.manager [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:24:17 user nova-compute[73078]: DEBUG nova.network.neutron [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:24:17 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:24:17 user nova-compute[73078]: DEBUG nova.compute.manager [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:24:17 user nova-compute[73078]: DEBUG nova.policy [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0bff079d90d942bb8ab3ba53fb007125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e938ed650845d0a64b49273c9f6287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:24:17 user nova-compute[73078]: INFO nova.virt.block_device [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Booting with blank volume at /dev/vda
Aug 14 18:24:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:24:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:24:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] No VIF found with MAC fa:16:3e:66:92:5c, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:24:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ba1ed7b2-9dd5-45c5-804c-b7a6d8fba95d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Lock "adcf1ea7-e7d7-4499-b340-689d25667899" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.913s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:17 user nova-compute[73078]: DEBUG nova.network.neutron [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Successfully created port: 52e93284-9b32-4191-8f06-ab9c4497579c {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:24:18 user nova-compute[73078]: DEBUG nova.network.neutron [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Successfully updated port: 52e93284-9b32-4191-8f06-ab9c4497579c {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:24:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "refresh_cache-3088da30-65b7-4801-b425-93df4fca6ad8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:24:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquired lock "refresh_cache-3088da30-65b7-4801-b425-93df4fca6ad8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:24:18 user nova-compute[73078]: DEBUG nova.network.neutron [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:24:18 user nova-compute[73078]: DEBUG nova.compute.manager [req-f509f4de-3558-4305-9408-33d7fca3e40e req-ad2a562b-b1b5-4d29-aeff-7a963321ddbc service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Received event network-changed-52e93284-9b32-4191-8f06-ab9c4497579c {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:24:18 user nova-compute[73078]: DEBUG nova.compute.manager [req-f509f4de-3558-4305-9408-33d7fca3e40e req-ad2a562b-b1b5-4d29-aeff-7a963321ddbc service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Refreshing instance network info cache due to event network-changed-52e93284-9b32-4191-8f06-ab9c4497579c. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:24:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-f509f4de-3558-4305-9408-33d7fca3e40e req-ad2a562b-b1b5-4d29-aeff-7a963321ddbc service nova] Acquiring lock "refresh_cache-3088da30-65b7-4801-b425-93df4fca6ad8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:24:18 user nova-compute[73078]: DEBUG nova.network.neutron [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:24:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-5a707c3c-1df1-4359-8ea9-c181e5bb0285 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Acquiring lock "adcf1ea7-e7d7-4499-b340-689d25667899" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-5a707c3c-1df1-4359-8ea9-c181e5bb0285 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Lock "adcf1ea7-e7d7-4499-b340-689d25667899" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:18 user nova-compute[73078]: INFO nova.compute.manager [None req-5a707c3c-1df1-4359-8ea9-c181e5bb0285 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Detaching volume 38e13e0e-c970-4851-b91a-cb8e956df934
Aug 14 18:24:18 user nova-compute[73078]: INFO nova.virt.block_device [None req-5a707c3c-1df1-4359-8ea9-c181e5bb0285 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Attempting to driver detach volume 38e13e0e-c970-4851-b91a-cb8e956df934 from mountpoint /dev/vdb
Aug 14 18:24:18 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-5a707c3c-1df1-4359-8ea9-c181e5bb0285 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Attempting to detach device vdb from instance adcf1ea7-e7d7-4499-b340-689d25667899 from the persistent domain config. {{(pid=73078) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 18:24:18 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-5a707c3c-1df1-4359-8ea9-c181e5bb0285 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:24:18 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:24:18 user nova-compute[73078]:   <source dev="/dev/sdf"/>
Aug 14 18:24:18 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:24:18 user nova-compute[73078]:   <serial>38e13e0e-c970-4851-b91a-cb8e956df934</serial>
Aug 14 18:24:18 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:24:18 user nova-compute[73078]: </disk>
Aug 14 18:24:18 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:24:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:18 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-5a707c3c-1df1-4359-8ea9-c181e5bb0285 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Successfully detached device vdb from instance adcf1ea7-e7d7-4499-b340-689d25667899 from the persistent domain config.
Aug 14 18:24:18 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-5a707c3c-1df1-4359-8ea9-c181e5bb0285 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance adcf1ea7-e7d7-4499-b340-689d25667899 from the live domain config. {{(pid=73078) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 18:24:18 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-5a707c3c-1df1-4359-8ea9-c181e5bb0285 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:24:18 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:24:18 user nova-compute[73078]:   <source dev="/dev/sdf"/>
Aug 14 18:24:18 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:24:18 user nova-compute[73078]:   <serial>38e13e0e-c970-4851-b91a-cb8e956df934</serial>
Aug 14 18:24:18 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:24:18 user nova-compute[73078]: </disk>
Aug 14 18:24:18 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG nova.network.neutron [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Updating instance_info_cache with network_info: [{"id": "52e93284-9b32-4191-8f06-ab9c4497579c", "address": "fa:16:3e:ec:04:07", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e93284-9b", "ovs_interfaceid": "52e93284-9b32-4191-8f06-ab9c4497579c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Releasing lock "refresh_cache-3088da30-65b7-4801-b425-93df4fca6ad8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG nova.compute.manager [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Instance network_info: |[{"id": "52e93284-9b32-4191-8f06-ab9c4497579c", "address": "fa:16:3e:ec:04:07", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e93284-9b", "ovs_interfaceid": "52e93284-9b32-4191-8f06-ab9c4497579c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-f509f4de-3558-4305-9408-33d7fca3e40e req-ad2a562b-b1b5-4d29-aeff-7a963321ddbc service nova] Acquired lock "refresh_cache-3088da30-65b7-4801-b425-93df4fca6ad8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG nova.network.neutron [req-f509f4de-3558-4305-9408-33d7fca3e40e req-ad2a562b-b1b5-4d29-aeff-7a963321ddbc service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Refreshing network info cache for port 52e93284-9b32-4191-8f06-ab9c4497579c {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Received event <DeviceRemovedEvent: 1692037459.4304814, adcf1ea7-e7d7-4499-b340-689d25667899 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73078) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-5a707c3c-1df1-4359-8ea9-c181e5bb0285 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance adcf1ea7-e7d7-4499-b340-689d25667899 {{(pid=73078) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 18:24:19 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-5a707c3c-1df1-4359-8ea9-c181e5bb0285 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Successfully detached device vdb from instance adcf1ea7-e7d7-4499-b340-689d25667899 from the live domain config.
Aug 14 18:24:19 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a707c3c-1df1-4359-8ea9-c181e5bb0285 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a707c3c-1df1-4359-8ea9-c181e5bb0285 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnsvIEfF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:24:19 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-5a707c3c-1df1-4359-8ea9-c181e5bb0285 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:24:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-5a707c3c-1df1-4359-8ea9-c181e5bb0285 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-5a707c3c-1df1-4359-8ea9-c181e5bb0285 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a707c3c-1df1-4359-8ea9-c181e5bb0285 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[205b32c9-315e-40dd-8b73-0f9849b16833]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2067b8-52b9-4a58-a755-6a3277bade16]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a707c3c-1df1-4359-8ea9-c181e5bb0285 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:24:19 user nova-compute[73078]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:24:19 user nova-compute[73078]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:24:19 user nova-compute[73078]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 (non-flash)
Aug 14 18:24:19 user nova-compute[73078]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934 (non-flash)
Aug 14 18:24:19 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a707c3c-1df1-4359-8ea9-c181e5bb0285 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:24:19 user nova-compute[73078]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:24:19 user nova-compute[73078]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:24:19 user nova-compute[73078]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 (non-flash)
Aug 14 18:24:19 user nova-compute[73078]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934 (non-flash)
Aug 14 18:24:19 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a707c3c-1df1-4359-8ea9-c181e5bb0285 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe992bd0790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934'): ({'sdf'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-5a707c3c-1df1-4359-8ea9-c181e5bb0285 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Removing single pathed devices sdf {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[308ac6d7-c78d-4620-98fc-4f55fc3a8170]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8c094f-e72d-4c9c-96a5-96ba21c37764]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-5a707c3c-1df1-4359-8ea9-c181e5bb0285 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Flushing IO for device /dev/sdf {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed6a18a-9fcb-48fc-b6a3-d228043c44d3]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-5a707c3c-1df1-4359-8ea9-c181e5bb0285 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG nova.network.neutron [req-f509f4de-3558-4305-9408-33d7fca3e40e req-ad2a562b-b1b5-4d29-aeff-7a963321ddbc service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Updated VIF entry in instance network info cache for port 52e93284-9b32-4191-8f06-ab9c4497579c. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG nova.network.neutron [req-f509f4de-3558-4305-9408-33d7fca3e40e req-ad2a562b-b1b5-4d29-aeff-7a963321ddbc service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Updating instance_info_cache with network_info: [{"id": "52e93284-9b32-4191-8f06-ab9c4497579c", "address": "fa:16:3e:ec:04:07", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e93284-9b", "ovs_interfaceid": "52e93284-9b32-4191-8f06-ab9c4497579c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.053s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-f509f4de-3558-4305-9408-33d7fca3e40e req-ad2a562b-b1b5-4d29-aeff-7a963321ddbc service nova] Releasing lock "refresh_cache-3088da30-65b7-4801-b425-93df4fca6ad8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dace602-2b27-47f5-8f17-9e7bf12c0244]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-5a707c3c-1df1-4359-8ea9-c181e5bb0285 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-5a707c3c-1df1-4359-8ea9-c181e5bb0285 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] SCSI volumes sdf have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a707c3c-1df1-4359-8ea9-c181e5bb0285 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1406834-a845-46e9-b38a-709f46ab455f]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a707c3c-1df1-4359-8ea9-c181e5bb0285 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[232f5d02-5cd2-46e0-a382-81d11d734d36]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a707c3c-1df1-4359-8ea9-c181e5bb0285 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934, portal: 172.16.0.220,3260]
Aug 14 18:24:19 user nova-compute[73078]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934, portal: 172.16.0.220,3260] successful.
Aug 14 18:24:19 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38e13e0e-c970-4851-b91a-cb8e956df934 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4609442-7e8d-4017-83b6-8673f0368360]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a707c3c-1df1-4359-8ea9-c181e5bb0285 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-5a707c3c-1df1-4359-8ea9-c181e5bb0285 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a707c3c-1df1-4359-8ea9-c181e5bb0285 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] <== disconnect_volume: return (313ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:24:19 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a707c3c-1df1-4359-8ea9-c181e5bb0285 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:24:21 user nova-compute[73078]: DEBUG nova.objects.instance [None req-5a707c3c-1df1-4359-8ea9-c181e5bb0285 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Lazy-loading 'flavor' on Instance uuid adcf1ea7-e7d7-4499-b340-689d25667899 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:24:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-5a707c3c-1df1-4359-8ea9-c181e5bb0285 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Lock "adcf1ea7-e7d7-4499-b340-689d25667899" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.717s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:22 user nova-compute[73078]: DEBUG os_brick.utils [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:24:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f071d28a-9c6a-452b-8aad-19843479d908]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5621b1a-7653-4705-b769-86039635bc14]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4446992b-59d3-4240-88b3-358a36b89225]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6469bd74-eb79-4e8a-abdc-37b5674f5e8a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:24:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:24:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:24:22 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:24:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f76d116-5bda-4960-b34f-d0eecd1b3290]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:24:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:24:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:24:22 user nova-compute[73078]: DEBUG os_brick.utils [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:24:22 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Updating existing volume attachment record: 4a21871e-a2a2-4aab-b66d-b87dcb8711c3 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:24:23 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692037448.9417686, 4569b529-5c8f-45ec-94fe-58c60f6bcc8a => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:24:23 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] VM Stopped (Lifecycle Event)
Aug 14 18:24:23 user nova-compute[73078]: DEBUG nova.compute.manager [None req-a9d87635-c974-4666-841d-813d03b00b29 None None] [instance: 4569b529-5c8f-45ec-94fe-58c60f6bcc8a] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:24:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:29 user nova-compute[73078]: DEBUG nova.compute.manager [req-895bff83-cf71-4661-80c0-d1dfb35f3e0b req-66531aae-b875-4176-b313-d0c6d455da31 service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Received event network-changed-6adf2de6-8801-4cc9-ab39-9a521201ca8a {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:24:29 user nova-compute[73078]: DEBUG nova.compute.manager [req-895bff83-cf71-4661-80c0-d1dfb35f3e0b req-66531aae-b875-4176-b313-d0c6d455da31 service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Refreshing instance network info cache due to event network-changed-6adf2de6-8801-4cc9-ab39-9a521201ca8a. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:24:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-895bff83-cf71-4661-80c0-d1dfb35f3e0b req-66531aae-b875-4176-b313-d0c6d455da31 service nova] Acquiring lock "refresh_cache-ef110d5f-afb5-415c-9590-29da006734a9" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:24:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-895bff83-cf71-4661-80c0-d1dfb35f3e0b req-66531aae-b875-4176-b313-d0c6d455da31 service nova] Acquired lock "refresh_cache-ef110d5f-afb5-415c-9590-29da006734a9" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:24:29 user nova-compute[73078]: DEBUG nova.network.neutron [req-895bff83-cf71-4661-80c0-d1dfb35f3e0b req-66531aae-b875-4176-b313-d0c6d455da31 service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Refreshing network info cache for port 6adf2de6-8801-4cc9-ab39-9a521201ca8a {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:24:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Acquiring lock "ef110d5f-afb5-415c-9590-29da006734a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lock "ef110d5f-afb5-415c-9590-29da006734a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Acquiring lock "ef110d5f-afb5-415c-9590-29da006734a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lock "ef110d5f-afb5-415c-9590-29da006734a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lock "ef110d5f-afb5-415c-9590-29da006734a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:29 user nova-compute[73078]: INFO nova.compute.manager [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Terminating instance
Aug 14 18:24:29 user nova-compute[73078]: DEBUG nova.compute.manager [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:24:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:29 user nova-compute[73078]: DEBUG nova.compute.manager [req-959a94c3-496d-4daa-8cb1-66758d2506b7 req-d40bb16b-6c1c-4214-a7e0-fd530dabc255 service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Received event network-vif-unplugged-6adf2de6-8801-4cc9-ab39-9a521201ca8a {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:24:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-959a94c3-496d-4daa-8cb1-66758d2506b7 req-d40bb16b-6c1c-4214-a7e0-fd530dabc255 service nova] Acquiring lock "ef110d5f-afb5-415c-9590-29da006734a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-959a94c3-496d-4daa-8cb1-66758d2506b7 req-d40bb16b-6c1c-4214-a7e0-fd530dabc255 service nova] Lock "ef110d5f-afb5-415c-9590-29da006734a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-959a94c3-496d-4daa-8cb1-66758d2506b7 req-d40bb16b-6c1c-4214-a7e0-fd530dabc255 service nova] Lock "ef110d5f-afb5-415c-9590-29da006734a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:29 user nova-compute[73078]: DEBUG nova.compute.manager [req-959a94c3-496d-4daa-8cb1-66758d2506b7 req-d40bb16b-6c1c-4214-a7e0-fd530dabc255 service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] No waiting events found dispatching network-vif-unplugged-6adf2de6-8801-4cc9-ab39-9a521201ca8a {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:24:29 user nova-compute[73078]: DEBUG nova.compute.manager [req-959a94c3-496d-4daa-8cb1-66758d2506b7 req-d40bb16b-6c1c-4214-a7e0-fd530dabc255 service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Received event network-vif-unplugged-6adf2de6-8801-4cc9-ab39-9a521201ca8a for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG nova.network.neutron [req-895bff83-cf71-4661-80c0-d1dfb35f3e0b req-66531aae-b875-4176-b313-d0c6d455da31 service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Updated VIF entry in instance network info cache for port 6adf2de6-8801-4cc9-ab39-9a521201ca8a. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG nova.network.neutron [req-895bff83-cf71-4661-80c0-d1dfb35f3e0b req-66531aae-b875-4176-b313-d0c6d455da31 service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Updating instance_info_cache with network_info: [{"id": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "address": "fa:16:3e:b7:d1:09", "network": {"id": "7ba1366f-4346-4830-ae29-621591ee55ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-525338528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a97c5c314a94a52b01778d69561d862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6adf2de6-88", "ovs_interfaceid": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-895bff83-cf71-4661-80c0-d1dfb35f3e0b req-66531aae-b875-4176-b313-d0c6d455da31 service nova] Releasing lock "refresh_cache-ef110d5f-afb5-415c-9590-29da006734a9" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:24:30 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Instance destroyed successfully.
Aug 14 18:24:30 user nova-compute[73078]: DEBUG nova.objects.instance [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lazy-loading 'resources' on Instance uuid ef110d5f-afb5-415c-9590-29da006734a9 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T18:18:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1130985749',display_name='tempest-TestShelveInstance-server-1130985749',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1130985749',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1reYlKMKDhreiCvN3W7qUj0UlbkG5KSoN3QC/382Ndyb3kjNdbjplmq8LyPXLlg05YViPAovHDAOEaQZ24+ExLMyfMwYR4qnV7J8GNCTl9uyhPqp6oJkqxxApcu8exrw==',key_name='tempest-TestShelveInstance-979618800',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:22:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a97c5c314a94a52b01778d69561d862',ramdisk_id='',reservation_id='r-lm0zi19n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1474594410',owner_user_name='tempest-TestShelveInstance-1474594410-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:22:55Z,user_data=None,user_id='006108eda23a45df96d06af8cc7c3b42',uuid=ef110d5f-afb5-415c-9590-29da006734a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "address": "fa:16:3e:b7:d1:09", "network": {"id": "7ba1366f-4346-4830-ae29-621591ee55ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-525338528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a97c5c314a94a52b01778d69561d862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6adf2de6-88", "ovs_interfaceid": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Converting VIF {"id": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "address": "fa:16:3e:b7:d1:09", "network": {"id": "7ba1366f-4346-4830-ae29-621591ee55ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-525338528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a97c5c314a94a52b01778d69561d862", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6adf2de6-88", "ovs_interfaceid": "6adf2de6-8801-4cc9-ab39-9a521201ca8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:d1:09,bridge_name='br-int',has_traffic_filtering=True,id=6adf2de6-8801-4cc9-ab39-9a521201ca8a,network=Network(7ba1366f-4346-4830-ae29-621591ee55ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6adf2de6-88') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG os_vif [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:d1:09,bridge_name='br-int',has_traffic_filtering=True,id=6adf2de6-8801-4cc9-ab39-9a521201ca8a,network=Network(7ba1366f-4346-4830-ae29-621591ee55ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6adf2de6-88') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6adf2de6-88, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:24:30 user nova-compute[73078]: INFO os_vif [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:d1:09,bridge_name='br-int',has_traffic_filtering=True,id=6adf2de6-8801-4cc9-ab39-9a521201ca8a,network=Network(7ba1366f-4346-4830-ae29-621591ee55ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6adf2de6-88')
Aug 14 18:24:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bCVKUxwE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:24:30 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:24:30 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a291f1-1f85-4978-b788-253b2f27a7fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fec4318-f216-47fa-b33b-cc6b5111ab3f]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:24:30 user nova-compute[73078]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:24:30 user nova-compute[73078]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:24:30 user nova-compute[73078]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 (non-flash)
Aug 14 18:24:30 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:24:30 user nova-compute[73078]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac (non-flash)
Aug 14 18:24:30 user nova-compute[73078]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:24:30 user nova-compute[73078]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 (non-flash)
Aug 14 18:24:30 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe95479b010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac'): ({'sdb'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Removing single pathed devices sdb {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfeb472-6a59-4743-8464-fff0ed12eae1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e04ab5-19f7-403d-8c50-b7cdefa98d7c]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Flushing IO for device /dev/sdb {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08b2157-f8bb-419a-8258-a8ed8ef12b92]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1baf2e49-6259-42f3-8934-2ebe8139494f]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] SCSI volumes sdb have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO647e2d2b-5ccc62e3113e8df5', '/dev/disk/by-id/scsi-23563636336326533', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_647e2d2b') {{(pid=84732) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7beee3-e6fb-4f6b-8e44-36f1d69c2b34]: (4, None) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3115b7-69fc-45e7-a7fe-762a13bc8a6c]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa5d793-0a7c-4b5e-b606-54931effaf47]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac, portal: 172.16.0.220,3260]
Aug 14 18:24:30 user nova-compute[73078]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac, portal: 172.16.0.220,3260] successful.
Aug 14 18:24:30 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a26fa6ac-06c8-4563-bcc9-ea19c5604eac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bea0cd7-270e-428b-af6b-1d7d8255204b]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] <== disconnect_volume: return (318ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:24:30 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Deleting instance files /opt/stack/data/nova/instances/ef110d5f-afb5-415c-9590-29da006734a9_del
Aug 14 18:24:30 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Deletion of /opt/stack/data/nova/instances/ef110d5f-afb5-415c-9590-29da006734a9_del complete
Aug 14 18:24:30 user nova-compute[73078]: INFO nova.compute.manager [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 14 18:24:30 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: ef110d5f-afb5-415c-9590-29da006734a9] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:24:30 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:24:31 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Took 0.42 seconds to deallocate network for instance.
Aug 14 18:24:31 user nova-compute[73078]: INFO nova.compute.manager [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Took 0.76 seconds to detach 1 volumes for instance.
Aug 14 18:24:31 user nova-compute[73078]: DEBUG nova.compute.manager [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Deleting volume: a26fa6ac-06c8-4563-bcc9-ea19c5604eac {{(pid=73078) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 18:24:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:31 user nova-compute[73078]: DEBUG nova.compute.manager [req-bde82a43-f73c-420a-829f-6c49970ae353 req-00c95999-67d1-4d9d-a939-b5a8ecc7d618 service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Received event network-vif-plugged-6adf2de6-8801-4cc9-ab39-9a521201ca8a {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:24:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-bde82a43-f73c-420a-829f-6c49970ae353 req-00c95999-67d1-4d9d-a939-b5a8ecc7d618 service nova] Acquiring lock "ef110d5f-afb5-415c-9590-29da006734a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-bde82a43-f73c-420a-829f-6c49970ae353 req-00c95999-67d1-4d9d-a939-b5a8ecc7d618 service nova] Lock "ef110d5f-afb5-415c-9590-29da006734a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-bde82a43-f73c-420a-829f-6c49970ae353 req-00c95999-67d1-4d9d-a939-b5a8ecc7d618 service nova] Lock "ef110d5f-afb5-415c-9590-29da006734a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:31 user nova-compute[73078]: DEBUG nova.compute.manager [req-bde82a43-f73c-420a-829f-6c49970ae353 req-00c95999-67d1-4d9d-a939-b5a8ecc7d618 service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] No waiting events found dispatching network-vif-plugged-6adf2de6-8801-4cc9-ab39-9a521201ca8a {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:24:31 user nova-compute[73078]: WARNING nova.compute.manager [req-bde82a43-f73c-420a-829f-6c49970ae353 req-00c95999-67d1-4d9d-a939-b5a8ecc7d618 service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Received unexpected event network-vif-plugged-6adf2de6-8801-4cc9-ab39-9a521201ca8a for instance with vm_state deleted and task_state None.
Aug 14 18:24:31 user nova-compute[73078]: DEBUG nova.compute.manager [req-bde82a43-f73c-420a-829f-6c49970ae353 req-00c95999-67d1-4d9d-a939-b5a8ecc7d618 service nova] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Received event network-vif-deleted-6adf2de6-8801-4cc9-ab39-9a521201ca8a {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:24:32 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:24:32 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:24:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:32 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Deleted allocations for instance ef110d5f-afb5-415c-9590-29da006734a9
Aug 14 18:24:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-85264739-d06b-4126-8dfc-2fbd1706bec0 tempest-TestShelveInstance-1474594410 tempest-TestShelveInstance-1474594410-project-member] Lock "ef110d5f-afb5-415c-9590-29da006734a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.018s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:32 user nova-compute[73078]: DEBUG nova.compute.manager [req-ba9edfca-87fe-4cd4-b5d3-6782c45e09d6 req-79ff165a-efb7-4211-9e1f-38d486023b83 service nova] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Received event network-changed-8df77a26-faab-47ca-a39b-3df6930cd1d5 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:24:32 user nova-compute[73078]: DEBUG nova.compute.manager [req-ba9edfca-87fe-4cd4-b5d3-6782c45e09d6 req-79ff165a-efb7-4211-9e1f-38d486023b83 service nova] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Refreshing instance network info cache due to event network-changed-8df77a26-faab-47ca-a39b-3df6930cd1d5. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:24:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ba9edfca-87fe-4cd4-b5d3-6782c45e09d6 req-79ff165a-efb7-4211-9e1f-38d486023b83 service nova] Acquiring lock "refresh_cache-1f88cb97-4f22-439e-99f2-d7cb8d5aff36" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:24:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ba9edfca-87fe-4cd4-b5d3-6782c45e09d6 req-79ff165a-efb7-4211-9e1f-38d486023b83 service nova] Acquired lock "refresh_cache-1f88cb97-4f22-439e-99f2-d7cb8d5aff36" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:24:32 user nova-compute[73078]: DEBUG nova.network.neutron [req-ba9edfca-87fe-4cd4-b5d3-6782c45e09d6 req-79ff165a-efb7-4211-9e1f-38d486023b83 service nova] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Refreshing network info cache for port 8df77a26-faab-47ca-a39b-3df6930cd1d5 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:24:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:33 user nova-compute[73078]: DEBUG nova.network.neutron [req-ba9edfca-87fe-4cd4-b5d3-6782c45e09d6 req-79ff165a-efb7-4211-9e1f-38d486023b83 service nova] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Updated VIF entry in instance network info cache for port 8df77a26-faab-47ca-a39b-3df6930cd1d5. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:24:33 user nova-compute[73078]: DEBUG nova.network.neutron [req-ba9edfca-87fe-4cd4-b5d3-6782c45e09d6 req-79ff165a-efb7-4211-9e1f-38d486023b83 service nova] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Updating instance_info_cache with network_info: [{"id": "8df77a26-faab-47ca-a39b-3df6930cd1d5", "address": "fa:16:3e:2d:25:52", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df77a26-fa", "ovs_interfaceid": "8df77a26-faab-47ca-a39b-3df6930cd1d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:24:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ba9edfca-87fe-4cd4-b5d3-6782c45e09d6 req-79ff165a-efb7-4211-9e1f-38d486023b83 service nova] Releasing lock "refresh_cache-1f88cb97-4f22-439e-99f2-d7cb8d5aff36" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:24:34 user nova-compute[73078]: DEBUG nova.compute.manager [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Stashing vm_state: active {{(pid=73078) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 14 18:24:34 user nova-compute[73078]: DEBUG nova.compute.manager [req-2cb2146e-9a39-4194-892e-790469863d61 req-07d8c744-71fe-4b3c-80b6-c5e2d6464ce2 service nova] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Received event network-changed-de400e10-3372-4eb4-b121-48ed70e471d3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:24:34 user nova-compute[73078]: DEBUG nova.compute.manager [req-2cb2146e-9a39-4194-892e-790469863d61 req-07d8c744-71fe-4b3c-80b6-c5e2d6464ce2 service nova] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Refreshing instance network info cache due to event network-changed-de400e10-3372-4eb4-b121-48ed70e471d3. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:24:34 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-2cb2146e-9a39-4194-892e-790469863d61 req-07d8c744-71fe-4b3c-80b6-c5e2d6464ce2 service nova] Acquiring lock "refresh_cache-8ebc48e0-0a24-4421-b180-f14eacc636ad" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:24:34 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-2cb2146e-9a39-4194-892e-790469863d61 req-07d8c744-71fe-4b3c-80b6-c5e2d6464ce2 service nova] Acquired lock "refresh_cache-8ebc48e0-0a24-4421-b180-f14eacc636ad" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:24:34 user nova-compute[73078]: DEBUG nova.network.neutron [req-2cb2146e-9a39-4194-892e-790469863d61 req-07d8c744-71fe-4b3c-80b6-c5e2d6464ce2 service nova] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Refreshing network info cache for port de400e10-3372-4eb4-b121-48ed70e471d3 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:24:34 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:34 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:34 user nova-compute[73078]: DEBUG nova.objects.instance [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lazy-loading 'pci_requests' on Instance uuid 8ebc48e0-0a24-4421-b180-f14eacc636ad {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:24:34 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:24:34 user nova-compute[73078]: INFO nova.compute.claims [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Claim successful on node user
Aug 14 18:24:34 user nova-compute[73078]: DEBUG nova.objects.instance [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lazy-loading 'resources' on Instance uuid 8ebc48e0-0a24-4421-b180-f14eacc636ad {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG nova.objects.instance [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ebc48e0-0a24-4421-b180-f14eacc636ad {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:24:35 user nova-compute[73078]: INFO nova.compute.resource_tracker [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Updating resource usage from migration 8f3f7164-14dc-4325-8d9b-bc821bb58ccd
Aug 14 18:24:35 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG nova.network.neutron [req-2cb2146e-9a39-4194-892e-790469863d61 req-07d8c744-71fe-4b3c-80b6-c5e2d6464ce2 service nova] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Updated VIF entry in instance network info cache for port de400e10-3372-4eb4-b121-48ed70e471d3. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG nova.network.neutron [req-2cb2146e-9a39-4194-892e-790469863d61 req-07d8c744-71fe-4b3c-80b6-c5e2d6464ce2 service nova] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Updating instance_info_cache with network_info: [{"id": "de400e10-3372-4eb4-b121-48ed70e471d3", "address": "fa:16:3e:9d:54:60", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde400e10-33", "ovs_interfaceid": "de400e10-3372-4eb4-b121-48ed70e471d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-2cb2146e-9a39-4194-892e-790469863d61 req-07d8c744-71fe-4b3c-80b6-c5e2d6464ce2 service nova] Releasing lock "refresh_cache-8ebc48e0-0a24-4421-b180-f14eacc636ad" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.472s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:35 user nova-compute[73078]: INFO nova.compute.manager [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Migrating
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "refresh_cache-8ebc48e0-0a24-4421-b180-f14eacc636ad" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquired lock "refresh_cache-8ebc48e0-0a24-4421-b180-f14eacc636ad" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG nova.network.neutron [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG nova.compute.manager [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:24:35 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Creating image(s)
Aug 14 18:24:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Did not create local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Ensure instance console log exists: /opt/stack/data/nova/instances/3088da30-65b7-4801-b425-93df4fca6ad8/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Start _get_guest_xml network_info=[{"id": "52e93284-9b32-4191-8f06-ab9c4497579c", "address": "fa:16:3e:ec:04:07", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e93284-9b", "ovs_interfaceid": "52e93284-9b32-4191-8f06-ab9c4497579c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '4a21871e-a2a2-4aab-b66d-b87dcb8711c3', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rVZtSKwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3088da30-65b7-4801-b425-93df4fca6ad8', 'attached_at': '', 'detached_at': '', 'volume_id': '5c2186e7-99c9-4655-b4a6-ca20280ec7eb', 'serial': '5c2186e7-99c9-4655-b4a6-ca20280ec7eb'}, 'volume_type': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:24:35 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:24:35 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:24:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rVZtSKwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:24:35 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:24:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:24:35 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:24:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:24:35 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5070aa04-3fc8-4425-93d1-e175c0f4e5ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:24:35 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17b3f04-01dd-4331-b557-937ec751d4f5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb] added
Aug 14 18:24:35 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[32425ed3-dc60-4eca-b914-38f7745a2034]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0232feb1-4b30-439e-bb82-627792cd46f3]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rVZtSKwf {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rVZtSKwf" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb28dac-68b4-4375-b76e-13748ccba7e4]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rVZtSKwf'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[665e5239-a53e-432d-a87f-373b12cbfb7f]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c5e890-b037-40ec-af75-c537ba15d522]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:24:35 user nova-compute[73078]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:24:35 user nova-compute[73078]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 (non-flash)
Aug 14 18:24:35 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:24:35 user nova-compute[73078]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:24:35 user nova-compute[73078]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 (non-flash)
Aug 14 18:24:35 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab5e840-0f69-47b8-9862-a7fe8b9bf15b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb, portal: 172.16.0.220,3260]
Aug 14 18:24:35 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb, portal: 172.16.0.220,3260] successful.
Aug 14 18:24:35 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd95bee2-887e-4ebd-936c-6310b5925d58]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[91577b27-765a-401c-b7c8-a2e0ea5eece3]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:24:35 user nova-compute[73078]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:24:35 user nova-compute[73078]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 (non-flash)
Aug 14 18:24:35 user nova-compute[73078]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:24:35 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:24:35 user nova-compute[73078]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:24:35 user nova-compute[73078]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 (non-flash)
Aug 14 18:24:35 user nova-compute[73078]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:24:35 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd14e1d9-7374-43e7-ba99-0c428be14ec7]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rVZtSKwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG nova.network.neutron [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Updating instance_info_cache with network_info: [{"id": "de400e10-3372-4eb4-b121-48ed70e471d3", "address": "fa:16:3e:9d:54:60", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde400e10-33", "ovs_interfaceid": "de400e10-3372-4eb4-b121-48ed70e471d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:24:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Releasing lock "refresh_cache-8ebc48e0-0a24-4421-b180-f14eacc636ad" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Starting migrate_disk_and_power_off {{(pid=73078) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG nova.compute.manager [req-59c8c859-5e22-4327-9eb6-35925586a174 req-cabbca72-9b0e-49d3-bce0-1066ce36f97f service nova] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Received event network-vif-unplugged-de400e10-3372-4eb4-b121-48ed70e471d3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-59c8c859-5e22-4327-9eb6-35925586a174 req-cabbca72-9b0e-49d3-bce0-1066ce36f97f service nova] Acquiring lock "8ebc48e0-0a24-4421-b180-f14eacc636ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-59c8c859-5e22-4327-9eb6-35925586a174 req-cabbca72-9b0e-49d3-bce0-1066ce36f97f service nova] Lock "8ebc48e0-0a24-4421-b180-f14eacc636ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-59c8c859-5e22-4327-9eb6-35925586a174 req-cabbca72-9b0e-49d3-bce0-1066ce36f97f service nova] Lock "8ebc48e0-0a24-4421-b180-f14eacc636ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG nova.compute.manager [req-59c8c859-5e22-4327-9eb6-35925586a174 req-cabbca72-9b0e-49d3-bce0-1066ce36f97f service nova] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] No waiting events found dispatching network-vif-unplugged-de400e10-3372-4eb4-b121-48ed70e471d3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:24:36 user nova-compute[73078]: WARNING nova.compute.manager [req-59c8c859-5e22-4327-9eb6-35925586a174 req-cabbca72-9b0e-49d3-bce0-1066ce36f97f service nova] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Received unexpected event network-vif-unplugged-de400e10-3372-4eb4-b121-48ed70e471d3 for instance with vm_state active and task_state resize_migrating.
Aug 14 18:24:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:36 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Instance destroyed successfully.
Aug 14 18:24:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:22:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1344711315',display_name='tempest-ServerActionsTestOtherA-server-1344711315',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1344711315',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuBLKmid5aFtC8N9oGYPXkgiYGtDjSt/w1+99DQRyNH3SIh+uGteRP9ufywJ7TgR1607B3dJ2h6LnLGhohKOdL1yNPsWQsmTBErDFfyfHJa2VycZ+ceyQwLi9NhHpa6xg==',key_name='tempest-keypair-1366091689',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:22:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='993dd55f40454640824687ffb6a3c581',ramdisk_id='',reservation_id='r-o28i8x37',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1876890021',owner_user_name='tempest-ServerActionsTestOtherA-1876890021-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:24:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cca1112ab354f9fb31658e18c0d03b1',uuid=8ebc48e0-0a24-4421-b180-f14eacc636ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de400e10-3372-4eb4-b121-48ed70e471d3", "address": "fa:16:3e:9d:54:60", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1624554992-network", "vif_mac": "fa:16:3e:9d:54:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde400e10-33", "ovs_interfaceid": "de400e10-3372-4eb4-b121-48ed70e471d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Converting VIF {"id": "de400e10-3372-4eb4-b121-48ed70e471d3", "address": "fa:16:3e:9d:54:60", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1624554992-network", "vif_mac": "fa:16:3e:9d:54:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde400e10-33", "ovs_interfaceid": "de400e10-3372-4eb4-b121-48ed70e471d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:54:60,bridge_name='br-int',has_traffic_filtering=True,id=de400e10-3372-4eb4-b121-48ed70e471d3,network=Network(bfef9745-5a40-44b6-a6d5-2ef1e77fc5db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde400e10-33') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG os_vif [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:54:60,bridge_name='br-int',has_traffic_filtering=True,id=de400e10-3372-4eb4-b121-48ed70e471d3,network=Network(bfef9745-5a40-44b6-a6d5-2ef1e77fc5db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde400e10-33') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23863663435396465', 'path': '/dev/sdb'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863663435396465', 'path': '/dev/sdb'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde400e10-33, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:24:36 user nova-compute[73078]: INFO os_vif [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:54:60,bridge_name='br-int',has_traffic_filtering=True,id=de400e10-3372-4eb4-b121-48ed70e471d3,network=Network(bfef9745-5a40-44b6-a6d5-2ef1e77fc5db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde400e10-33')
Aug 14 18:24:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxmiXRqA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:24:36 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:24:36 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:24:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1775384835',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1775384835',id=31,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16e938ed650845d0a64b49273c9f6287',ramdisk_id='',reservation_id='r-ac9ip7h8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1267883434',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:24:17Z,user_data=None,user_id='0bff079d90d942bb8ab3ba53fb007125',uuid=3088da30-65b7-4801-b425-93df4fca6ad8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52e93284-9b32-4191-8f06-ab9c4497579c", "address": "fa:16:3e:ec:04:07", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e93284-9b", "ovs_interfaceid": "52e93284-9b32-4191-8f06-ab9c4497579c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Converting VIF {"id": "52e93284-9b32-4191-8f06-ab9c4497579c", "address": "fa:16:3e:ec:04:07", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e93284-9b", "ovs_interfaceid": "52e93284-9b32-4191-8f06-ab9c4497579c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:04:07,bridge_name='br-int',has_traffic_filtering=True,id=52e93284-9b32-4191-8f06-ab9c4497579c,network=Network(98a29135-c5de-46a6-a2bf-46c90b4e255b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e93284-9b') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG nova.objects.instance [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lazy-loading 'pci_devices' on Instance uuid 3088da30-65b7-4801-b425-93df4fca6ad8 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:24:36 user nova-compute[73078]:   <uuid>3088da30-65b7-4801-b425-93df4fca6ad8</uuid>
Aug 14 18:24:36 user nova-compute[73078]:   <name>instance-0000001f</name>
Aug 14 18:24:36 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:24:36 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:24:36 user nova-compute[73078]:   <metadata>
Aug 14 18:24:36 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:24:36 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:24:36 user nova-compute[73078]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1775384835</nova:name>
Aug 14 18:24:36 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:24:35</nova:creationTime>
Aug 14 18:24:36 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:24:36 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:24:36 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:24:36 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:24:36 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:24:36 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:24:36 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:24:36 user nova-compute[73078]:       <nova:owner>
Aug 14 18:24:36 user nova-compute[73078]:         <nova:user uuid="0bff079d90d942bb8ab3ba53fb007125">tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member</nova:user>
Aug 14 18:24:36 user nova-compute[73078]:         <nova:project uuid="16e938ed650845d0a64b49273c9f6287">tempest-ServerBootFromVolumeStableRescueTest-1267883434</nova:project>
Aug 14 18:24:36 user nova-compute[73078]:       </nova:owner>
Aug 14 18:24:36 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:24:36 user nova-compute[73078]:       <nova:ports>
Aug 14 18:24:36 user nova-compute[73078]:         <nova:port uuid="52e93284-9b32-4191-8f06-ab9c4497579c">
Aug 14 18:24:36 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 18:24:36 user nova-compute[73078]:         </nova:port>
Aug 14 18:24:36 user nova-compute[73078]:       </nova:ports>
Aug 14 18:24:36 user nova-compute[73078]:     </nova:instance>
Aug 14 18:24:36 user nova-compute[73078]:   </metadata>
Aug 14 18:24:36 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:24:36 user nova-compute[73078]:     <system>
Aug 14 18:24:36 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:24:36 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:24:36 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:24:36 user nova-compute[73078]:       <entry name="serial">3088da30-65b7-4801-b425-93df4fca6ad8</entry>
Aug 14 18:24:36 user nova-compute[73078]:       <entry name="uuid">3088da30-65b7-4801-b425-93df4fca6ad8</entry>
Aug 14 18:24:36 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:24:36 user nova-compute[73078]:     </system>
Aug 14 18:24:36 user nova-compute[73078]:   </sysinfo>
Aug 14 18:24:36 user nova-compute[73078]:   <os>
Aug 14 18:24:36 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:24:36 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:24:36 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:24:36 user nova-compute[73078]:   </os>
Aug 14 18:24:36 user nova-compute[73078]:   <features>
Aug 14 18:24:36 user nova-compute[73078]:     <acpi/>
Aug 14 18:24:36 user nova-compute[73078]:     <apic/>
Aug 14 18:24:36 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:24:36 user nova-compute[73078]:   </features>
Aug 14 18:24:36 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:24:36 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:24:36 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:24:36 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:24:36 user nova-compute[73078]:   </clock>
Aug 14 18:24:36 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:24:36 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:24:36 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:24:36 user nova-compute[73078]:   </cpu>
Aug 14 18:24:36 user nova-compute[73078]:   <devices>
Aug 14 18:24:36 user nova-compute[73078]:     <disk type="block" device="disk">
Aug 14 18:24:36 user nova-compute[73078]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:24:36 user nova-compute[73078]:       <source dev="/dev/sdb"/>
Aug 14 18:24:36 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:24:36 user nova-compute[73078]:       <serial>5c2186e7-99c9-4655-b4a6-ca20280ec7eb</serial>
Aug 14 18:24:36 user nova-compute[73078]:     </disk>
Aug 14 18:24:36 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:24:36 user nova-compute[73078]:       <mac address="fa:16:3e:ec:04:07"/>
Aug 14 18:24:36 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:24:36 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:24:36 user nova-compute[73078]:       <target dev="tap52e93284-9b"/>
Aug 14 18:24:36 user nova-compute[73078]:     </interface>
Aug 14 18:24:36 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:24:36 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/3088da30-65b7-4801-b425-93df4fca6ad8/console.log" append="off"/>
Aug 14 18:24:36 user nova-compute[73078]:     </serial>
Aug 14 18:24:36 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:24:36 user nova-compute[73078]:     <video>
Aug 14 18:24:36 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:24:36 user nova-compute[73078]:     </video>
Aug 14 18:24:36 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:24:36 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:24:36 user nova-compute[73078]:     </rng>
Aug 14 18:24:36 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:24:36 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:24:36 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:24:36 user nova-compute[73078]:     </memballoon>
Aug 14 18:24:36 user nova-compute[73078]:   </devices>
Aug 14 18:24:36 user nova-compute[73078]: </domain>
Aug 14 18:24:36 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:24:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1775384835',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1775384835',id=31,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16e938ed650845d0a64b49273c9f6287',ramdisk_id='',reservation_id='r-ac9ip7h8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1267883434',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:24:17Z,user_data=None,user_id='0bff079d90d942bb8ab3ba53fb007125',uuid=3088da30-65b7-4801-b425-93df4fca6ad8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52e93284-9b32-4191-8f06-ab9c4497579c", "address": "fa:16:3e:ec:04:07", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e93284-9b", "ovs_interfaceid": "52e93284-9b32-4191-8f06-ab9c4497579c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Converting VIF {"id": "52e93284-9b32-4191-8f06-ab9c4497579c", "address": "fa:16:3e:ec:04:07", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e93284-9b", "ovs_interfaceid": "52e93284-9b32-4191-8f06-ab9c4497579c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:04:07,bridge_name='br-int',has_traffic_filtering=True,id=52e93284-9b32-4191-8f06-ab9c4497579c,network=Network(98a29135-c5de-46a6-a2bf-46c90b4e255b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e93284-9b') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG os_vif [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:04:07,bridge_name='br-int',has_traffic_filtering=True,id=52e93284-9b32-4191-8f06-ab9c4497579c,network=Network(98a29135-c5de-46a6-a2bf-46c90b4e255b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e93284-9b') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee812c2-4ed8-4b59-bdc8-3162a64ccef6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap52e93284-9b, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap52e93284-9b, col_values=(('external_ids', {'iface-id': '52e93284-9b32-4191-8f06-ab9c4497579c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:04:07', 'vm-uuid': '3088da30-65b7-4801-b425-93df4fca6ad8'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:36 user nova-compute[73078]: INFO os_vif [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:04:07,bridge_name='br-int',has_traffic_filtering=True,id=52e93284-9b32-4191-8f06-ab9c4497579c,network=Network(98a29135-c5de-46a6-a2bf-46c90b4e255b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e93284-9b')
Aug 14 18:24:36 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa194b0-4383-494f-b3ec-17f9da47f6e0]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:24:36 user nova-compute[73078]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:24:36 user nova-compute[73078]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 (non-flash)
Aug 14 18:24:36 user nova-compute[73078]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:24:36 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:24:36 user nova-compute[73078]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:24:36 user nova-compute[73078]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 (non-flash)
Aug 14 18:24:36 user nova-compute[73078]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:24:36 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe978258e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb'): ({'sde'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Removing single pathed devices sde {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b85ba3-9be5-4052-9b0e-78e50d917180]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:36 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:37 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[497e4e3d-6b07-4a4a-ae35-c0b1e678c744]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:37 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Flushing IO for device /dev/sde {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:24:37 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:24:37 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] No VIF found with MAC fa:16:3e:ec:04:07, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:24:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:37 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db8552a-30ee-4c74-90c6-b2738e3ab305]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:37 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:24:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:37 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9cafac-6988-485c-9f02-fd0eb570bca3]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:37 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:24:37 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] SCSI volumes sde have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:24:37 user nova-compute[73078]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23364613930663831', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8faef669', '/dev/disk/by-id/scsi-1SCST_BIO8faef669-3da90f81d448772a') {{(pid=84732) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 18:24:37 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc44d5ba-b4a7-4eb8-a90f-11f5b1cd0df6]: (4, None) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:37 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:24:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:37 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c19368-0d7b-4675-8c18-3be14fd44844]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:37 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:37 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a081954b-3e09-4fc3-9004-c156a42fdae2]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:37 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb, portal: 172.16.0.220,3260]
Aug 14 18:24:37 user nova-compute[73078]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb, portal: 172.16.0.220,3260] successful.
Aug 14 18:24:37 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:37 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9e7551-334a-4bb9-9771-730c6ee0a0dd]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:37 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:37 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:24:37 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] <== disconnect_volume: return (358ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:24:37 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:24:37 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:24:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:38 user nova-compute[73078]: DEBUG nova.network.neutron [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Port de400e10-3372-4eb4-b121-48ed70e471d3 binding to destination host user is already ACTIVE {{(pid=73078) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 14 18:24:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "8ebc48e0-0a24-4421-b180-f14eacc636ad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "8ebc48e0-0a24-4421-b180-f14eacc636ad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "8ebc48e0-0a24-4421-b180-f14eacc636ad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:38 user nova-compute[73078]: DEBUG nova.compute.manager [req-81801a55-6692-42ab-8b63-a5dd88c1bfc0 req-f08b5e5f-627c-4020-a432-b2b5abdf3989 service nova] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Received event network-vif-plugged-de400e10-3372-4eb4-b121-48ed70e471d3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:24:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-81801a55-6692-42ab-8b63-a5dd88c1bfc0 req-f08b5e5f-627c-4020-a432-b2b5abdf3989 service nova] Acquiring lock "8ebc48e0-0a24-4421-b180-f14eacc636ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-81801a55-6692-42ab-8b63-a5dd88c1bfc0 req-f08b5e5f-627c-4020-a432-b2b5abdf3989 service nova] Lock "8ebc48e0-0a24-4421-b180-f14eacc636ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-81801a55-6692-42ab-8b63-a5dd88c1bfc0 req-f08b5e5f-627c-4020-a432-b2b5abdf3989 service nova] Lock "8ebc48e0-0a24-4421-b180-f14eacc636ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:38 user nova-compute[73078]: DEBUG nova.compute.manager [req-81801a55-6692-42ab-8b63-a5dd88c1bfc0 req-f08b5e5f-627c-4020-a432-b2b5abdf3989 service nova] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] No waiting events found dispatching network-vif-plugged-de400e10-3372-4eb4-b121-48ed70e471d3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:24:38 user nova-compute[73078]: WARNING nova.compute.manager [req-81801a55-6692-42ab-8b63-a5dd88c1bfc0 req-f08b5e5f-627c-4020-a432-b2b5abdf3989 service nova] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Received unexpected event network-vif-plugged-de400e10-3372-4eb4-b121-48ed70e471d3 for instance with vm_state active and task_state resize_migrated.
Aug 14 18:24:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "refresh_cache-8ebc48e0-0a24-4421-b180-f14eacc636ad" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:24:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquired lock "refresh_cache-8ebc48e0-0a24-4421-b180-f14eacc636ad" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:24:38 user nova-compute[73078]: DEBUG nova.network.neutron [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:24:38 user nova-compute[73078]: DEBUG nova.compute.manager [req-56cb3e49-b7d7-4cc0-b7d0-b0af9bf7c58d req-a9034a1b-c996-4b7f-a8a5-1ebe57b12386 service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Received event network-vif-plugged-52e93284-9b32-4191-8f06-ab9c4497579c {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:24:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-56cb3e49-b7d7-4cc0-b7d0-b0af9bf7c58d req-a9034a1b-c996-4b7f-a8a5-1ebe57b12386 service nova] Acquiring lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-56cb3e49-b7d7-4cc0-b7d0-b0af9bf7c58d req-a9034a1b-c996-4b7f-a8a5-1ebe57b12386 service nova] Lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-56cb3e49-b7d7-4cc0-b7d0-b0af9bf7c58d req-a9034a1b-c996-4b7f-a8a5-1ebe57b12386 service nova] Lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:38 user nova-compute[73078]: DEBUG nova.compute.manager [req-56cb3e49-b7d7-4cc0-b7d0-b0af9bf7c58d req-a9034a1b-c996-4b7f-a8a5-1ebe57b12386 service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] No waiting events found dispatching network-vif-plugged-52e93284-9b32-4191-8f06-ab9c4497579c {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:24:38 user nova-compute[73078]: WARNING nova.compute.manager [req-56cb3e49-b7d7-4cc0-b7d0-b0af9bf7c58d req-a9034a1b-c996-4b7f-a8a5-1ebe57b12386 service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Received unexpected event network-vif-plugged-52e93284-9b32-4191-8f06-ab9c4497579c for instance with vm_state building and task_state spawning.
Aug 14 18:24:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:39 user nova-compute[73078]: DEBUG nova.network.neutron [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Updating instance_info_cache with network_info: [{"id": "de400e10-3372-4eb4-b121-48ed70e471d3", "address": "fa:16:3e:9d:54:60", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde400e10-33", "ovs_interfaceid": "de400e10-3372-4eb4-b121-48ed70e471d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:24:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Releasing lock "refresh_cache-8ebc48e0-0a24-4421-b180-f14eacc636ad" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:24:39 user nova-compute[73078]: DEBUG os_brick.utils [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:24:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[99bdf99b-122a-4af3-a1b8-b5f00de04a95]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[335a2595-4d74-4748-a2a6-2cfa748c275e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f2fd4f-6b2e-405d-b7f0-d704d522febf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad94608b-ca19-4f52-aa38-44c146dcdfdb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:24:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:24:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:24:39 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:24:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a713cb-8a95-4abe-8d39-b6ba85faa25d]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:24:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:24:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:24:39 user nova-compute[73078]: DEBUG os_brick.utils [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:24:40 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037480.7081394, 3088da30-65b7-4801-b425-93df4fca6ad8 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:24:40 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] VM Resumed (Lifecycle Event)
Aug 14 18:24:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:24:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:24:40 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Instance spawned successfully.
Aug 14 18:24:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:24:40 user nova-compute[73078]: DEBUG nova.compute.manager [req-b4f82ae7-11ea-4097-95a0-0bb0e598ca28 req-d3a36ade-0b8d-4107-b702-675aea716d5e service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Received event network-vif-plugged-52e93284-9b32-4191-8f06-ab9c4497579c {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:24:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b4f82ae7-11ea-4097-95a0-0bb0e598ca28 req-d3a36ade-0b8d-4107-b702-675aea716d5e service nova] Acquiring lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b4f82ae7-11ea-4097-95a0-0bb0e598ca28 req-d3a36ade-0b8d-4107-b702-675aea716d5e service nova] Lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b4f82ae7-11ea-4097-95a0-0bb0e598ca28 req-d3a36ade-0b8d-4107-b702-675aea716d5e service nova] Lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:40 user nova-compute[73078]: DEBUG nova.compute.manager [req-b4f82ae7-11ea-4097-95a0-0bb0e598ca28 req-d3a36ade-0b8d-4107-b702-675aea716d5e service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] No waiting events found dispatching network-vif-plugged-52e93284-9b32-4191-8f06-ab9c4497579c {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:24:40 user nova-compute[73078]: WARNING nova.compute.manager [req-b4f82ae7-11ea-4097-95a0-0bb0e598ca28 req-d3a36ade-0b8d-4107-b702-675aea716d5e service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Received unexpected event network-vif-plugged-52e93284-9b32-4191-8f06-ab9c4497579c for instance with vm_state building and task_state spawning.
Aug 14 18:24:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:24:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:24:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:24:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:24:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:24:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:24:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:24:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:24:40 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:24:40 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037480.7181256, 3088da30-65b7-4801-b425-93df4fca6ad8 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:24:40 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] VM Started (Lifecycle Event)
Aug 14 18:24:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:24:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:24:40 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:24:40 user nova-compute[73078]: INFO nova.compute.manager [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Took 5.40 seconds to spawn the instance on the hypervisor.
Aug 14 18:24:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:24:40 user nova-compute[73078]: INFO nova.compute.manager [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Took 24.34 seconds to build instance.
Aug 14 18:24:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c7f9a377-3a98-4e2b-9aa8-7f48fa4e0e05 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "3088da30-65b7-4801-b425-93df4fca6ad8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.460s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:43 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:45 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692037470.1484444, ef110d5f-afb5-415c-9590-29da006734a9 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:24:45 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: ef110d5f-afb5-415c-9590-29da006734a9] VM Stopped (Lifecycle Event)
Aug 14 18:24:45 user nova-compute[73078]: DEBUG nova.compute.manager [None req-8e645b22-f83e-4081-8b6e-a2535782a4ee None None] [instance: ef110d5f-afb5-415c-9590-29da006734a9] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:24:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "16abee43-684b-415f-9c77-476ffb7283e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "16abee43-684b-415f-9c77-476ffb7283e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:46 user nova-compute[73078]: DEBUG nova.compute.manager [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:24:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:46 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:24:46 user nova-compute[73078]: INFO nova.compute.claims [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Claim successful on node user
Aug 14 18:24:46 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:24:46 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:24:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.512s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:46 user nova-compute[73078]: DEBUG nova.compute.manager [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:24:46 user nova-compute[73078]: DEBUG nova.compute.manager [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:24:46 user nova-compute[73078]: DEBUG nova.network.neutron [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:24:46 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:24:46 user nova-compute[73078]: DEBUG nova.compute.manager [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:24:46 user nova-compute[73078]: DEBUG nova.policy [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6ffd9b3d18374103918d71165106f131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6461284f1d491c9cd726d8550a445b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:24:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:46 user nova-compute[73078]: DEBUG nova.compute.manager [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:24:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:24:46 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Creating image(s)
Aug 14 18:24:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "/opt/stack/data/nova/instances/16abee43-684b-415f-9c77-476ffb7283e8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "/opt/stack/data/nova/instances/16abee43-684b-415f-9c77-476ffb7283e8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "/opt/stack/data/nova/instances/16abee43-684b-415f-9c77-476ffb7283e8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "3892430236df3abc02187add29a19081a4fd6a74" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "3892430236df3abc02187add29a19081a4fd6a74" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3892430236df3abc02187add29a19081a4fd6a74.part --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:47 user nova-compute[73078]: DEBUG nova.network.neutron [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Successfully created port: ea900923-9066-4aa4-81f3-9d06fc2329f3 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:24:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3892430236df3abc02187add29a19081a4fd6a74.part --force-share --output=json" returned: 0 in 0.206s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:47 user nova-compute[73078]: DEBUG nova.virt.images [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] dc4c33dc-d2f6-41df-b72b-428a95aaba5e was qcow2, converting to raw {{(pid=73078) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 18:24:47 user nova-compute[73078]: DEBUG nova.privsep.utils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73078) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 18:24:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3892430236df3abc02187add29a19081a4fd6a74.part /opt/stack/data/nova/instances/_base/3892430236df3abc02187add29a19081a4fd6a74.converted {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3892430236df3abc02187add29a19081a4fd6a74.part /opt/stack/data/nova/instances/_base/3892430236df3abc02187add29a19081a4fd6a74.converted" returned: 0 in 0.377s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3892430236df3abc02187add29a19081a4fd6a74.converted --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3892430236df3abc02187add29a19081a4fd6a74.converted --force-share --output=json" returned: 0 in 0.195s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "3892430236df3abc02187add29a19081a4fd6a74" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.348s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3892430236df3abc02187add29a19081a4fd6a74 --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3892430236df3abc02187add29a19081a4fd6a74 --force-share --output=json" returned: 0 in 0.176s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "3892430236df3abc02187add29a19081a4fd6a74" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "3892430236df3abc02187add29a19081a4fd6a74" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3892430236df3abc02187add29a19081a4fd6a74 --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3892430236df3abc02187add29a19081a4fd6a74 --force-share --output=json" returned: 0 in 0.199s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3892430236df3abc02187add29a19081a4fd6a74,backing_fmt=raw /opt/stack/data/nova/instances/16abee43-684b-415f-9c77-476ffb7283e8/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3892430236df3abc02187add29a19081a4fd6a74,backing_fmt=raw /opt/stack/data/nova/instances/16abee43-684b-415f-9c77-476ffb7283e8/disk 1073741824" returned: 0 in 0.050s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "3892430236df3abc02187add29a19081a4fd6a74" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3892430236df3abc02187add29a19081a4fd6a74 --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:48 user nova-compute[73078]: DEBUG nova.network.neutron [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Successfully updated port: ea900923-9066-4aa4-81f3-9d06fc2329f3 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:24:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "refresh_cache-16abee43-684b-415f-9c77-476ffb7283e8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:24:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquired lock "refresh_cache-16abee43-684b-415f-9c77-476ffb7283e8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:24:48 user nova-compute[73078]: DEBUG nova.network.neutron [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:24:48 user nova-compute[73078]: DEBUG nova.compute.manager [req-cafa0521-3f3f-4b8d-a0bc-015278fc2067 req-e109373f-4bf1-48f6-a226-d507373aeb1d service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Received event network-changed-ea900923-9066-4aa4-81f3-9d06fc2329f3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:24:48 user nova-compute[73078]: DEBUG nova.compute.manager [req-cafa0521-3f3f-4b8d-a0bc-015278fc2067 req-e109373f-4bf1-48f6-a226-d507373aeb1d service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Refreshing instance network info cache due to event network-changed-ea900923-9066-4aa4-81f3-9d06fc2329f3. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:24:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-cafa0521-3f3f-4b8d-a0bc-015278fc2067 req-e109373f-4bf1-48f6-a226-d507373aeb1d service nova] Acquiring lock "refresh_cache-16abee43-684b-415f-9c77-476ffb7283e8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:24:48 user nova-compute[73078]: DEBUG nova.network.neutron [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:24:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3892430236df3abc02187add29a19081a4fd6a74 --force-share --output=json" returned: 0 in 0.179s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:48 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16abee43-684b-415f-9c77-476ffb7283e8/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:24:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16abee43-684b-415f-9c77-476ffb7283e8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Starting finish_migration {{(pid=73078) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Instance directory exists: not creating {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 18:24:49 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Creating image(s)
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Did not create local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Ensure instance console log exists: /opt/stack/data/nova/instances/8ebc48e0-0a24-4421-b180-f14eacc636ad/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Start _get_guest_xml network_info=[{"id": "de400e10-3372-4eb4-b121-48ed70e471d3", "address": "fa:16:3e:9d:54:60", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1624554992-network", "vif_mac": "fa:16:3e:9d:54:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde400e10-33", "ovs_interfaceid": "de400e10-3372-4eb4-b121-48ed70e471d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '0ba11c11-0452-404c-8510-7de9f16553b7', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxmiXRqA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '8ebc48e0-0a24-4421-b180-f14eacc636ad', 'attached_at': '2023-08-14T18:24:49.000000', 'detached_at': '', 'volume_id': '394c2c9e-1cec-4548-8c12-2699fdd049cb', 'serial': '394c2c9e-1cec-4548-8c12-2699fdd049cb'}, 'volume_type': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:24:49 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:24:49 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.objects.instance [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8ebc48e0-0a24-4421-b180-f14eacc636ad {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16abee43-684b-415f-9c77-476ffb7283e8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Cannot resize image /opt/stack/data/nova/instances/16abee43-684b-415f-9c77-476ffb7283e8/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.objects.instance [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lazy-loading 'migration_context' on Instance uuid 16abee43-684b-415f-9c77-476ffb7283e8 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxmiXRqA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:24:49 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:24:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:24:49 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:24:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:24:49 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Ensure instance console log exists: /opt/stack/data/nova/instances/16abee43-684b-415f-9c77-476ffb7283e8/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e96fc8-c300-4114-8f99-c1c68930591d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:24:49 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb094457-0253-408d-92d5-c9e17016471d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb] added
Aug 14 18:24:49 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1833782f-0c71-4be4-8fec-6658c9d3b6d7]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.network.neutron [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Updating instance_info_cache with network_info: [{"id": "ea900923-9066-4aa4-81f3-9d06fc2329f3", "address": "fa:16:3e:80:d9:0f", "network": {"id": "4c337404-9329-43e7-bed1-7b5dc32f6cd9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-902748542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6461284f1d491c9cd726d8550a445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea900923-90", "ovs_interfaceid": "ea900923-9066-4aa4-81f3-9d06fc2329f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf50369-cd82-4cef-86c4-3ba0a5b6294a]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PxmiXRqA {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Releasing lock "refresh_cache-16abee43-684b-415f-9c77-476ffb7283e8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.compute.manager [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Instance network_info: |[{"id": "ea900923-9066-4aa4-81f3-9d06fc2329f3", "address": "fa:16:3e:80:d9:0f", "network": {"id": "4c337404-9329-43e7-bed1-7b5dc32f6cd9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-902748542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6461284f1d491c9cd726d8550a445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea900923-90", "ovs_interfaceid": "ea900923-9066-4aa4-81f3-9d06fc2329f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-cafa0521-3f3f-4b8d-a0bc-015278fc2067 req-e109373f-4bf1-48f6-a226-d507373aeb1d service nova] Acquired lock "refresh_cache-16abee43-684b-415f-9c77-476ffb7283e8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.network.neutron [req-cafa0521-3f3f-4b8d-a0bc-015278fc2067 req-e109373f-4bf1-48f6-a226-d507373aeb1d service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Refreshing network info cache for port ea900923-9066-4aa4-81f3-9d06fc2329f3 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Start _get_guest_xml network_info=[{"id": "ea900923-9066-4aa4-81f3-9d06fc2329f3", "address": "fa:16:3e:80:d9:0f", "network": {"id": "4c337404-9329-43e7-bed1-7b5dc32f6cd9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-902748542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6461284f1d491c9cd726d8550a445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea900923-90", "ovs_interfaceid": "ea900923-9066-4aa4-81f3-9d06fc2329f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:24:43Z,direct_url=<?>,disk_format='qcow2',id=dc4c33dc-d2f6-41df-b72b-428a95aaba5e,min_disk=0,min_ram=0,name='tempest-scenario-img--1704743093',owner='7d6461284f1d491c9cd726d8550a445b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:24:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': 'dc4c33dc-d2f6-41df-b72b-428a95aaba5e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:24:49 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:24:49 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PxmiXRqA" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cb0e7f-3ee6-42ba-b3fe-c704f51bfdf6]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PxmiXRqA'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:24:43Z,direct_url=<?>,disk_format='qcow2',id=dc4c33dc-d2f6-41df-b72b-428a95aaba5e,min_disk=0,min_ram=0,name='tempest-scenario-img--1704743093',owner='7d6461284f1d491c9cd726d8550a445b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:24:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:24:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1500960157',display_name='tempest-TestMinimumBasicScenario-server-1500960157',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1500960157',id=32,image_ref='dc4c33dc-d2f6-41df-b72b-428a95aaba5e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHae15UZ2iRsxNJBje5JQ3VvHItdqEHnAxxnIKoNyEyXMol8pb6MQCaGZedHQWxdQ/k94ka8aw7SUGmRxIIYg12Mi/fJqhVBTLHkBVjhgyRJ5b3DV/1J1fc87fEHebTyQ==',key_name='tempest-TestMinimumBasicScenario-1618869034',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d6461284f1d491c9cd726d8550a445b',ramdisk_id='',reservation_id='r-novw2rts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dc4c33dc-d2f6-41df-b72b-428a95aaba5e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-703150932',owner_user_name='tempest-TestMinimumBasicScenario-703150932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:24:47Z,user_data=None,user_id='6ffd9b3d18374103918d71165106f131',uuid=16abee43-684b-415f-9c77-476ffb7283e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea900923-9066-4aa4-81f3-9d06fc2329f3", "address": "fa:16:3e:80:d9:0f", "network": {"id": "4c337404-9329-43e7-bed1-7b5dc32f6cd9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-902748542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6461284f1d491c9cd726d8550a445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea900923-90", "ovs_interfaceid": "ea900923-9066-4aa4-81f3-9d06fc2329f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Converting VIF {"id": "ea900923-9066-4aa4-81f3-9d06fc2329f3", "address": "fa:16:3e:80:d9:0f", "network": {"id": "4c337404-9329-43e7-bed1-7b5dc32f6cd9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-902748542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6461284f1d491c9cd726d8550a445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea900923-90", "ovs_interfaceid": "ea900923-9066-4aa4-81f3-9d06fc2329f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:d9:0f,bridge_name='br-int',has_traffic_filtering=True,id=ea900923-9066-4aa4-81f3-9d06fc2329f3,network=Network(4c337404-9329-43e7-bed1-7b5dc32f6cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea900923-90') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.objects.instance [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lazy-loading 'pci_devices' on Instance uuid 16abee43-684b-415f-9c77-476ffb7283e8 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[30dd928a-1dc5-4aa6-851a-501cdfc5955d]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:24:49 user nova-compute[73078]:   <uuid>16abee43-684b-415f-9c77-476ffb7283e8</uuid>
Aug 14 18:24:49 user nova-compute[73078]:   <name>instance-00000020</name>
Aug 14 18:24:49 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:24:49 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:24:49 user nova-compute[73078]:   <metadata>
Aug 14 18:24:49 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:24:49 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:24:49 user nova-compute[73078]:       <nova:name>tempest-TestMinimumBasicScenario-server-1500960157</nova:name>
Aug 14 18:24:49 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:24:49</nova:creationTime>
Aug 14 18:24:49 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:24:49 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:24:49 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:24:49 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:24:49 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:24:49 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:24:49 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:24:49 user nova-compute[73078]:       <nova:owner>
Aug 14 18:24:49 user nova-compute[73078]:         <nova:user uuid="6ffd9b3d18374103918d71165106f131">tempest-TestMinimumBasicScenario-703150932-project-member</nova:user>
Aug 14 18:24:49 user nova-compute[73078]:         <nova:project uuid="7d6461284f1d491c9cd726d8550a445b">tempest-TestMinimumBasicScenario-703150932</nova:project>
Aug 14 18:24:49 user nova-compute[73078]:       </nova:owner>
Aug 14 18:24:49 user nova-compute[73078]:       <nova:root type="image" uuid="dc4c33dc-d2f6-41df-b72b-428a95aaba5e"/>
Aug 14 18:24:49 user nova-compute[73078]:       <nova:ports>
Aug 14 18:24:49 user nova-compute[73078]:         <nova:port uuid="ea900923-9066-4aa4-81f3-9d06fc2329f3">
Aug 14 18:24:49 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 18:24:49 user nova-compute[73078]:         </nova:port>
Aug 14 18:24:49 user nova-compute[73078]:       </nova:ports>
Aug 14 18:24:49 user nova-compute[73078]:     </nova:instance>
Aug 14 18:24:49 user nova-compute[73078]:   </metadata>
Aug 14 18:24:49 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:24:49 user nova-compute[73078]:     <system>
Aug 14 18:24:49 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:24:49 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:24:49 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:24:49 user nova-compute[73078]:       <entry name="serial">16abee43-684b-415f-9c77-476ffb7283e8</entry>
Aug 14 18:24:49 user nova-compute[73078]:       <entry name="uuid">16abee43-684b-415f-9c77-476ffb7283e8</entry>
Aug 14 18:24:49 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:24:49 user nova-compute[73078]:     </system>
Aug 14 18:24:49 user nova-compute[73078]:   </sysinfo>
Aug 14 18:24:49 user nova-compute[73078]:   <os>
Aug 14 18:24:49 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:24:49 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:24:49 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:24:49 user nova-compute[73078]:   </os>
Aug 14 18:24:49 user nova-compute[73078]:   <features>
Aug 14 18:24:49 user nova-compute[73078]:     <acpi/>
Aug 14 18:24:49 user nova-compute[73078]:     <apic/>
Aug 14 18:24:49 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:24:49 user nova-compute[73078]:   </features>
Aug 14 18:24:49 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:24:49 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:24:49 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:24:49 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:24:49 user nova-compute[73078]:   </clock>
Aug 14 18:24:49 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:24:49 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:24:49 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:24:49 user nova-compute[73078]:   </cpu>
Aug 14 18:24:49 user nova-compute[73078]:   <devices>
Aug 14 18:24:49 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:24:49 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:24:49 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/16abee43-684b-415f-9c77-476ffb7283e8/disk"/>
Aug 14 18:24:49 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:24:49 user nova-compute[73078]:     </disk>
Aug 14 18:24:49 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:24:49 user nova-compute[73078]:       <mac address="fa:16:3e:80:d9:0f"/>
Aug 14 18:24:49 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:24:49 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:24:49 user nova-compute[73078]:       <target dev="tapea900923-90"/>
Aug 14 18:24:49 user nova-compute[73078]:     </interface>
Aug 14 18:24:49 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:24:49 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/16abee43-684b-415f-9c77-476ffb7283e8/console.log" append="off"/>
Aug 14 18:24:49 user nova-compute[73078]:     </serial>
Aug 14 18:24:49 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:24:49 user nova-compute[73078]:     <video>
Aug 14 18:24:49 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:24:49 user nova-compute[73078]:     </video>
Aug 14 18:24:49 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:24:49 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:24:49 user nova-compute[73078]:     </rng>
Aug 14 18:24:49 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:24:49 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:24:49 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:24:49 user nova-compute[73078]:     </memballoon>
Aug 14 18:24:49 user nova-compute[73078]:   </devices>
Aug 14 18:24:49 user nova-compute[73078]: </domain>
Aug 14 18:24:49 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:24:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1500960157',display_name='tempest-TestMinimumBasicScenario-server-1500960157',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1500960157',id=32,image_ref='dc4c33dc-d2f6-41df-b72b-428a95aaba5e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHae15UZ2iRsxNJBje5JQ3VvHItdqEHnAxxnIKoNyEyXMol8pb6MQCaGZedHQWxdQ/k94ka8aw7SUGmRxIIYg12Mi/fJqhVBTLHkBVjhgyRJ5b3DV/1J1fc87fEHebTyQ==',key_name='tempest-TestMinimumBasicScenario-1618869034',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d6461284f1d491c9cd726d8550a445b',ramdisk_id='',reservation_id='r-novw2rts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dc4c33dc-d2f6-41df-b72b-428a95aaba5e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-703150932',owner_user_name='tempest-TestMinimumBasicScenario-703150932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:24:47Z,user_data=None,user_id='6ffd9b3d18374103918d71165106f131',uuid=16abee43-684b-415f-9c77-476ffb7283e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea900923-9066-4aa4-81f3-9d06fc2329f3", "address": "fa:16:3e:80:d9:0f", "network": {"id": "4c337404-9329-43e7-bed1-7b5dc32f6cd9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-902748542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6461284f1d491c9cd726d8550a445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea900923-90", "ovs_interfaceid": "ea900923-9066-4aa4-81f3-9d06fc2329f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Converting VIF {"id": "ea900923-9066-4aa4-81f3-9d06fc2329f3", "address": "fa:16:3e:80:d9:0f", "network": {"id": "4c337404-9329-43e7-bed1-7b5dc32f6cd9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-902748542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6461284f1d491c9cd726d8550a445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea900923-90", "ovs_interfaceid": "ea900923-9066-4aa4-81f3-9d06fc2329f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:d9:0f,bridge_name='br-int',has_traffic_filtering=True,id=ea900923-9066-4aa4-81f3-9d06fc2329f3,network=Network(4c337404-9329-43e7-bed1-7b5dc32f6cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea900923-90') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG os_vif [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:d9:0f,bridge_name='br-int',has_traffic_filtering=True,id=ea900923-9066-4aa4-81f3-9d06fc2329f3,network=Network(4c337404-9329-43e7-bed1-7b5dc32f6cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea900923-90') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64f2eff-6c42-4a1a-82be-45df96ab764b]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:24:49 user nova-compute[73078]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 (non-flash)
Aug 14 18:24:49 user nova-compute[73078]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:24:49 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:24:49 user nova-compute[73078]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 (non-flash)
Aug 14 18:24:49 user nova-compute[73078]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:24:49 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea900923-90, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapea900923-90, col_values=(('external_ids', {'iface-id': 'ea900923-9066-4aa4-81f3-9d06fc2329f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:d9:0f', 'vm-uuid': '16abee43-684b-415f-9c77-476ffb7283e8'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:49 user nova-compute[73078]: INFO os_vif [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:d9:0f,bridge_name='br-int',has_traffic_filtering=True,id=ea900923-9066-4aa4-81f3-9d06fc2329f3,network=Network(4c337404-9329-43e7-bed1-7b5dc32f6cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea900923-90')
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[17643ffb-d563-491f-8774-95ca7f0ed5d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb, portal: 172.16.0.220,3260]
Aug 14 18:24:49 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb, portal: 172.16.0.220,3260] successful.
Aug 14 18:24:49 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] No VIF found with MAC fa:16:3e:80:d9:0f, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca873795-b7a4-40d3-94db-2e542680d164]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa4f539-8a4a-4157-b9d0-9869cdea593c]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:24:49 user nova-compute[73078]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 (non-flash)
Aug 14 18:24:49 user nova-compute[73078]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:24:49 user nova-compute[73078]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:24:49 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:24:49 user nova-compute[73078]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 (non-flash)
Aug 14 18:24:49 user nova-compute[73078]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:24:49 user nova-compute[73078]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:24:49 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd11b8f8-5ae1-4d14-88ea-7377971cf22b]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxmiXRqA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.network.neutron [req-cafa0521-3f3f-4b8d-a0bc-015278fc2067 req-e109373f-4bf1-48f6-a226-d507373aeb1d service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Updated VIF entry in instance network info cache for port ea900923-9066-4aa4-81f3-9d06fc2329f3. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG nova.network.neutron [req-cafa0521-3f3f-4b8d-a0bc-015278fc2067 req-e109373f-4bf1-48f6-a226-d507373aeb1d service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Updating instance_info_cache with network_info: [{"id": "ea900923-9066-4aa4-81f3-9d06fc2329f3", "address": "fa:16:3e:80:d9:0f", "network": {"id": "4c337404-9329-43e7-bed1-7b5dc32f6cd9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-902748542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6461284f1d491c9cd726d8550a445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea900923-90", "ovs_interfaceid": "ea900923-9066-4aa4-81f3-9d06fc2329f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:24:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-cafa0521-3f3f-4b8d-a0bc-015278fc2067 req-e109373f-4bf1-48f6-a226-d507373aeb1d service nova] Releasing lock "refresh_cache-16abee43-684b-415f-9c77-476ffb7283e8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:24:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:24:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23364613930663831', 'path': '/dev/sde'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:24:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364613930663831', 'path': '/dev/sde'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:24:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:22:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1344711315',display_name='tempest-ServerActionsTestOtherA-server-1344711315',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1344711315',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuBLKmid5aFtC8N9oGYPXkgiYGtDjSt/w1+99DQRyNH3SIh+uGteRP9ufywJ7TgR1607B3dJ2h6LnLGhohKOdL1yNPsWQsmTBErDFfyfHJa2VycZ+ceyQwLi9NhHpa6xg==',key_name='tempest-keypair-1366091689',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:22:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='993dd55f40454640824687ffb6a3c581',ramdisk_id='',reservation_id='r-o28i8x37',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1876890021',owner_user_name='tempest-ServerActionsTestOtherA-1876890021-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:24:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cca1112ab354f9fb31658e18c0d03b1',uuid=8ebc48e0-0a24-4421-b180-f14eacc636ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de400e10-3372-4eb4-b121-48ed70e471d3", "address": "fa:16:3e:9d:54:60", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1624554992-network", "vif_mac": "fa:16:3e:9d:54:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde400e10-33", "ovs_interfaceid": "de400e10-3372-4eb4-b121-48ed70e471d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:24:50 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Converting VIF {"id": "de400e10-3372-4eb4-b121-48ed70e471d3", "address": "fa:16:3e:9d:54:60", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1624554992-network", "vif_mac": "fa:16:3e:9d:54:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde400e10-33", "ovs_interfaceid": "de400e10-3372-4eb4-b121-48ed70e471d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:24:50 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:54:60,bridge_name='br-int',has_traffic_filtering=True,id=de400e10-3372-4eb4-b121-48ed70e471d3,network=Network(bfef9745-5a40-44b6-a6d5-2ef1e77fc5db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde400e10-33') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:24:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:24:50 user nova-compute[73078]:   <uuid>8ebc48e0-0a24-4421-b180-f14eacc636ad</uuid>
Aug 14 18:24:50 user nova-compute[73078]:   <name>instance-0000001d</name>
Aug 14 18:24:50 user nova-compute[73078]:   <memory>2097152</memory>
Aug 14 18:24:50 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:24:50 user nova-compute[73078]:   <metadata>
Aug 14 18:24:50 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:24:50 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:24:50 user nova-compute[73078]:       <nova:name>tempest-ServerActionsTestOtherA-server-1344711315</nova:name>
Aug 14 18:24:50 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:24:49</nova:creationTime>
Aug 14 18:24:50 user nova-compute[73078]:       <nova:flavor name="m1.small">
Aug 14 18:24:50 user nova-compute[73078]:         <nova:memory>2048</nova:memory>
Aug 14 18:24:50 user nova-compute[73078]:         <nova:disk>20</nova:disk>
Aug 14 18:24:50 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:24:50 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:24:50 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:24:50 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:24:50 user nova-compute[73078]:       <nova:owner>
Aug 14 18:24:50 user nova-compute[73078]:         <nova:user uuid="0cca1112ab354f9fb31658e18c0d03b1">tempest-ServerActionsTestOtherA-1876890021-project-member</nova:user>
Aug 14 18:24:50 user nova-compute[73078]:         <nova:project uuid="993dd55f40454640824687ffb6a3c581">tempest-ServerActionsTestOtherA-1876890021</nova:project>
Aug 14 18:24:50 user nova-compute[73078]:       </nova:owner>
Aug 14 18:24:50 user nova-compute[73078]:       <nova:ports>
Aug 14 18:24:50 user nova-compute[73078]:         <nova:port uuid="de400e10-3372-4eb4-b121-48ed70e471d3">
Aug 14 18:24:50 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 14 18:24:50 user nova-compute[73078]:         </nova:port>
Aug 14 18:24:50 user nova-compute[73078]:       </nova:ports>
Aug 14 18:24:50 user nova-compute[73078]:     </nova:instance>
Aug 14 18:24:50 user nova-compute[73078]:   </metadata>
Aug 14 18:24:50 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:24:50 user nova-compute[73078]:     <system>
Aug 14 18:24:50 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:24:50 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:24:50 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:24:50 user nova-compute[73078]:       <entry name="serial">8ebc48e0-0a24-4421-b180-f14eacc636ad</entry>
Aug 14 18:24:50 user nova-compute[73078]:       <entry name="uuid">8ebc48e0-0a24-4421-b180-f14eacc636ad</entry>
Aug 14 18:24:50 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:24:50 user nova-compute[73078]:     </system>
Aug 14 18:24:50 user nova-compute[73078]:   </sysinfo>
Aug 14 18:24:50 user nova-compute[73078]:   <os>
Aug 14 18:24:50 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:24:50 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:24:50 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:24:50 user nova-compute[73078]:   </os>
Aug 14 18:24:50 user nova-compute[73078]:   <features>
Aug 14 18:24:50 user nova-compute[73078]:     <acpi/>
Aug 14 18:24:50 user nova-compute[73078]:     <apic/>
Aug 14 18:24:50 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:24:50 user nova-compute[73078]:   </features>
Aug 14 18:24:50 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:24:50 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:24:50 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:24:50 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:24:50 user nova-compute[73078]:   </clock>
Aug 14 18:24:50 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:24:50 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:24:50 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:24:50 user nova-compute[73078]:   </cpu>
Aug 14 18:24:50 user nova-compute[73078]:   <devices>
Aug 14 18:24:50 user nova-compute[73078]:     <disk type="block" device="disk">
Aug 14 18:24:50 user nova-compute[73078]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:24:50 user nova-compute[73078]:       <source dev="/dev/sde"/>
Aug 14 18:24:50 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:24:50 user nova-compute[73078]:       <serial>394c2c9e-1cec-4548-8c12-2699fdd049cb</serial>
Aug 14 18:24:50 user nova-compute[73078]:     </disk>
Aug 14 18:24:50 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:24:50 user nova-compute[73078]:       <mac address="fa:16:3e:9d:54:60"/>
Aug 14 18:24:50 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:24:50 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:24:50 user nova-compute[73078]:       <target dev="tapde400e10-33"/>
Aug 14 18:24:50 user nova-compute[73078]:     </interface>
Aug 14 18:24:50 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:24:50 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/8ebc48e0-0a24-4421-b180-f14eacc636ad/console.log" append="off"/>
Aug 14 18:24:50 user nova-compute[73078]:     </serial>
Aug 14 18:24:50 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:24:50 user nova-compute[73078]:     <video>
Aug 14 18:24:50 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:24:50 user nova-compute[73078]:     </video>
Aug 14 18:24:50 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:24:50 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:24:50 user nova-compute[73078]:     </rng>
Aug 14 18:24:50 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:24:50 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:24:50 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:24:50 user nova-compute[73078]:     </memballoon>
Aug 14 18:24:50 user nova-compute[73078]:   </devices>
Aug 14 18:24:50 user nova-compute[73078]: </domain>
Aug 14 18:24:50 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:24:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:22:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1344711315',display_name='tempest-ServerActionsTestOtherA-server-1344711315',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1344711315',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuBLKmid5aFtC8N9oGYPXkgiYGtDjSt/w1+99DQRyNH3SIh+uGteRP9ufywJ7TgR1607B3dJ2h6LnLGhohKOdL1yNPsWQsmTBErDFfyfHJa2VycZ+ceyQwLi9NhHpa6xg==',key_name='tempest-keypair-1366091689',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:22:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='993dd55f40454640824687ffb6a3c581',ramdisk_id='',reservation_id='r-o28i8x37',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1876890021',owner_user_name='tempest-ServerActionsTestOtherA-1876890021-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:24:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cca1112ab354f9fb31658e18c0d03b1',uuid=8ebc48e0-0a24-4421-b180-f14eacc636ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de400e10-3372-4eb4-b121-48ed70e471d3", "address": "fa:16:3e:9d:54:60", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1624554992-network", "vif_mac": "fa:16:3e:9d:54:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde400e10-33", "ovs_interfaceid": "de400e10-3372-4eb4-b121-48ed70e471d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:24:50 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Converting VIF {"id": "de400e10-3372-4eb4-b121-48ed70e471d3", "address": "fa:16:3e:9d:54:60", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1624554992-network", "vif_mac": "fa:16:3e:9d:54:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde400e10-33", "ovs_interfaceid": "de400e10-3372-4eb4-b121-48ed70e471d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:24:50 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:54:60,bridge_name='br-int',has_traffic_filtering=True,id=de400e10-3372-4eb4-b121-48ed70e471d3,network=Network(bfef9745-5a40-44b6-a6d5-2ef1e77fc5db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde400e10-33') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:24:50 user nova-compute[73078]: DEBUG os_vif [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:54:60,bridge_name='br-int',has_traffic_filtering=True,id=de400e10-3372-4eb4-b121-48ed70e471d3,network=Network(bfef9745-5a40-44b6-a6d5-2ef1e77fc5db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde400e10-33') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:24:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:24:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:24:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde400e10-33, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:24:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapde400e10-33, col_values=(('external_ids', {'iface-id': 'de400e10-3372-4eb4-b121-48ed70e471d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:54:60', 'vm-uuid': '8ebc48e0-0a24-4421-b180-f14eacc636ad'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:24:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:24:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:50 user nova-compute[73078]: INFO os_vif [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:54:60,bridge_name='br-int',has_traffic_filtering=True,id=de400e10-3372-4eb4-b121-48ed70e471d3,network=Network(bfef9745-5a40-44b6-a6d5-2ef1e77fc5db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde400e10-33')
Aug 14 18:24:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:24:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] No VIF found with MAC fa:16:3e:9d:54:60, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:24:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:51 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:24:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:51 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:24:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-3a80c3dd-258f-4604-aa90-4e187ea25c52 req-1059e614-674c-4216-95ee-9501020e584a service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Received event network-vif-plugged-ea900923-9066-4aa4-81f3-9d06fc2329f3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:24:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3a80c3dd-258f-4604-aa90-4e187ea25c52 req-1059e614-674c-4216-95ee-9501020e584a service nova] Acquiring lock "16abee43-684b-415f-9c77-476ffb7283e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3a80c3dd-258f-4604-aa90-4e187ea25c52 req-1059e614-674c-4216-95ee-9501020e584a service nova] Lock "16abee43-684b-415f-9c77-476ffb7283e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3a80c3dd-258f-4604-aa90-4e187ea25c52 req-1059e614-674c-4216-95ee-9501020e584a service nova] Lock "16abee43-684b-415f-9c77-476ffb7283e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-3a80c3dd-258f-4604-aa90-4e187ea25c52 req-1059e614-674c-4216-95ee-9501020e584a service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] No waiting events found dispatching network-vif-plugged-ea900923-9066-4aa4-81f3-9d06fc2329f3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:24:51 user nova-compute[73078]: WARNING nova.compute.manager [req-3a80c3dd-258f-4604-aa90-4e187ea25c52 req-1059e614-674c-4216-95ee-9501020e584a service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Received unexpected event network-vif-plugged-ea900923-9066-4aa4-81f3-9d06fc2329f3 for instance with vm_state building and task_state spawning.
Aug 14 18:24:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:51 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692037476.8565607, 8ebc48e0-0a24-4421-b180-f14eacc636ad => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:24:51 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] VM Stopped (Lifecycle Event)
Aug 14 18:24:51 user nova-compute[73078]: DEBUG nova.compute.manager [None req-2437e926-6d2d-4b5c-a3eb-68cdea362776 None None] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:24:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:52 user nova-compute[73078]: DEBUG nova.compute.manager [req-59046c42-3cfb-4129-b2f9-c61201025534 req-29a7d536-f29d-4f7d-b231-8a7acc573cee service nova] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Received event network-vif-plugged-de400e10-3372-4eb4-b121-48ed70e471d3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:24:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-59046c42-3cfb-4129-b2f9-c61201025534 req-29a7d536-f29d-4f7d-b231-8a7acc573cee service nova] Acquiring lock "8ebc48e0-0a24-4421-b180-f14eacc636ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-59046c42-3cfb-4129-b2f9-c61201025534 req-29a7d536-f29d-4f7d-b231-8a7acc573cee service nova] Lock "8ebc48e0-0a24-4421-b180-f14eacc636ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-59046c42-3cfb-4129-b2f9-c61201025534 req-29a7d536-f29d-4f7d-b231-8a7acc573cee service nova] Lock "8ebc48e0-0a24-4421-b180-f14eacc636ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:52 user nova-compute[73078]: DEBUG nova.compute.manager [req-59046c42-3cfb-4129-b2f9-c61201025534 req-29a7d536-f29d-4f7d-b231-8a7acc573cee service nova] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] No waiting events found dispatching network-vif-plugged-de400e10-3372-4eb4-b121-48ed70e471d3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:24:52 user nova-compute[73078]: WARNING nova.compute.manager [req-59046c42-3cfb-4129-b2f9-c61201025534 req-29a7d536-f29d-4f7d-b231-8a7acc573cee service nova] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Received unexpected event network-vif-plugged-de400e10-3372-4eb4-b121-48ed70e471d3 for instance with vm_state active and task_state resize_finish.
Aug 14 18:24:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:53 user nova-compute[73078]: DEBUG nova.compute.manager [req-5a3d5b23-8fcd-4eea-b10d-44bcdd02cbcc req-96cece76-5e0f-4f95-aa8b-33481c9dedd5 service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Received event network-vif-plugged-ea900923-9066-4aa4-81f3-9d06fc2329f3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:24:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5a3d5b23-8fcd-4eea-b10d-44bcdd02cbcc req-96cece76-5e0f-4f95-aa8b-33481c9dedd5 service nova] Acquiring lock "16abee43-684b-415f-9c77-476ffb7283e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5a3d5b23-8fcd-4eea-b10d-44bcdd02cbcc req-96cece76-5e0f-4f95-aa8b-33481c9dedd5 service nova] Lock "16abee43-684b-415f-9c77-476ffb7283e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5a3d5b23-8fcd-4eea-b10d-44bcdd02cbcc req-96cece76-5e0f-4f95-aa8b-33481c9dedd5 service nova] Lock "16abee43-684b-415f-9c77-476ffb7283e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:53 user nova-compute[73078]: DEBUG nova.compute.manager [req-5a3d5b23-8fcd-4eea-b10d-44bcdd02cbcc req-96cece76-5e0f-4f95-aa8b-33481c9dedd5 service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] No waiting events found dispatching network-vif-plugged-ea900923-9066-4aa4-81f3-9d06fc2329f3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:24:53 user nova-compute[73078]: WARNING nova.compute.manager [req-5a3d5b23-8fcd-4eea-b10d-44bcdd02cbcc req-96cece76-5e0f-4f95-aa8b-33481c9dedd5 service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Received unexpected event network-vif-plugged-ea900923-9066-4aa4-81f3-9d06fc2329f3 for instance with vm_state building and task_state spawning.
Aug 14 18:24:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:24:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf1ea7-e7d7-4499-b340-689d25667899/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf1ea7-e7d7-4499-b340-689d25667899/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf1ea7-e7d7-4499-b340-689d25667899/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcf1ea7-e7d7-4499-b340-689d25667899/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:54 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:24:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16abee43-684b-415f-9c77-476ffb7283e8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:54 user nova-compute[73078]: DEBUG nova.compute.manager [req-4112ae0f-01ae-49af-8c17-03657d53e009 req-ce33bb7f-8223-4c08-82c9-b3163c06074e service nova] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Received event network-vif-plugged-de400e10-3372-4eb4-b121-48ed70e471d3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:24:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4112ae0f-01ae-49af-8c17-03657d53e009 req-ce33bb7f-8223-4c08-82c9-b3163c06074e service nova] Acquiring lock "8ebc48e0-0a24-4421-b180-f14eacc636ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4112ae0f-01ae-49af-8c17-03657d53e009 req-ce33bb7f-8223-4c08-82c9-b3163c06074e service nova] Lock "8ebc48e0-0a24-4421-b180-f14eacc636ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4112ae0f-01ae-49af-8c17-03657d53e009 req-ce33bb7f-8223-4c08-82c9-b3163c06074e service nova] Lock "8ebc48e0-0a24-4421-b180-f14eacc636ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:54 user nova-compute[73078]: DEBUG nova.compute.manager [req-4112ae0f-01ae-49af-8c17-03657d53e009 req-ce33bb7f-8223-4c08-82c9-b3163c06074e service nova] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] No waiting events found dispatching network-vif-plugged-de400e10-3372-4eb4-b121-48ed70e471d3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:24:54 user nova-compute[73078]: WARNING nova.compute.manager [req-4112ae0f-01ae-49af-8c17-03657d53e009 req-ce33bb7f-8223-4c08-82c9-b3163c06074e service nova] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Received unexpected event network-vif-plugged-de400e10-3372-4eb4-b121-48ed70e471d3 for instance with vm_state active and task_state resize_finish.
Aug 14 18:24:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16abee43-684b-415f-9c77-476ffb7283e8/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16abee43-684b-415f-9c77-476ffb7283e8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:54 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037494.8815165, 8ebc48e0-0a24-4421-b180-f14eacc636ad => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:24:54 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] VM Resumed (Lifecycle Event)
Aug 14 18:24:54 user nova-compute[73078]: DEBUG nova.compute.manager [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:24:54 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Instance running successfully.
Aug 14 18:24:54 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Failed to set time: agent not configured {{(pid=73078) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 14 18:24:54 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8e00770b-88b1-4ff6-b847-62bbe8f36642 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] finish_migration finished successfully. {{(pid=73078) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 14 18:24:54 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:24:54 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:24:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16abee43-684b-415f-9c77-476ffb7283e8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:55 user nova-compute[73078]: DEBUG nova.compute.manager [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:24:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:24:55 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 18:24:55 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037494.8951755, 8ebc48e0-0a24-4421-b180-f14eacc636ad => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:24:55 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] VM Started (Lifecycle Event)
Aug 14 18:24:55 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Instance spawned successfully.
Aug 14 18:24:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:24:55 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:24:55 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:24:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:24:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:24:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:24:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:24:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:24:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:24:55 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 18:24:55 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037494.9772682, 16abee43-684b-415f-9c77-476ffb7283e8 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:24:55 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] VM Resumed (Lifecycle Event)
Aug 14 18:24:55 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:24:55 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:24:55 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:24:55 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037494.97844, 16abee43-684b-415f-9c77-476ffb7283e8 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:24:55 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] VM Started (Lifecycle Event)
Aug 14 18:24:55 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:24:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:55 user nova-compute[73078]: INFO nova.compute.manager [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Took 8.26 seconds to spawn the instance on the hypervisor.
Aug 14 18:24:55 user nova-compute[73078]: DEBUG nova.compute.manager [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:24:55 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:24:55 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:24:55 user nova-compute[73078]: INFO nova.compute.manager [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Took 9.12 seconds to build instance.
Aug 14 18:24:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4a74f73b-f683-4bf1-8cab-d4d533ee09e9 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "16abee43-684b-415f-9c77-476ffb7283e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.228s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:24:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:24:56 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:24:56 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:24:57 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:24:57 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:24:57 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=7501MB free_disk=25.158954620361328GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:24:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:24:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:24:57 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Applying migration context for instance 8ebc48e0-0a24-4421-b180-f14eacc636ad as it has an incoming, in-progress migration 8f3f7164-14dc-4325-8d9b-bc821bb58ccd. Migration status is finished {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 14 18:24:57 user nova-compute[73078]: INFO nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Updating resource usage from migration 8f3f7164-14dc-4325-8d9b-bc821bb58ccd
Aug 14 18:24:57 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance de80e188-9385-4613-8a6c-aa72b624ad55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:24:57 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 1f88cb97-4f22-439e-99f2-d7cb8d5aff36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:24:57 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 3c840309-9884-4c8a-a6ee-1acd44f32c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:24:57 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance a99aa211-c2a1-4240-90cc-2df068d4f669 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:24:57 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 61dfe42b-c943-4617-bf8e-745eaf1a1bb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:24:57 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance adcf1ea7-e7d7-4499-b340-689d25667899 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:24:57 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 92b0eed8-2a32-4141-ab62-d7914fc6c150 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:24:57 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 3088da30-65b7-4801-b425-93df4fca6ad8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:24:57 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Migration 8f3f7164-14dc-4325-8d9b-bc821bb58ccd is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 14 18:24:57 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 8ebc48e0-0a24-4421-b180-f14eacc636ad actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:24:57 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 16abee43-684b-415f-9c77-476ffb7283e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:24:57 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:24:57 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:24:57 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:24:58 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:24:58 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:24:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.795s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:24:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:24:59 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:24:59 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:24:59 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:24:59 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Rebuilding the list of instances to heal {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 18:24:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-de80e188-9385-4613-8a6c-aa72b624ad55" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:24:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-de80e188-9385-4613-8a6c-aa72b624ad55" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:24:59 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:24:59 user nova-compute[73078]: DEBUG nova.objects.instance [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lazy-loading 'info_cache' on Instance uuid de80e188-9385-4613-8a6c-aa72b624ad55 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:24:59 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Updating instance_info_cache with network_info: [{"id": "2afe973c-46fa-4336-996f-b5dcd374c96e", "address": "fa:16:3e:5d:60:2f", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe973c-46", "ovs_interfaceid": "2afe973c-46fa-4336-996f-b5dcd374c96e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:24:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-de80e188-9385-4613-8a6c-aa72b624ad55" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:24:59 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:24:59 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:24:59 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:24:59 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:24:59 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:24:59 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:24:59 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:24:59 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:25:00 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:00 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:25:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-3c3b6008-2ca8-43b4-a573-7190b552559d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Acquiring lock "adcf1ea7-e7d7-4499-b340-689d25667899" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:25:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-3c3b6008-2ca8-43b4-a573-7190b552559d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Lock "adcf1ea7-e7d7-4499-b340-689d25667899" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:25:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-3c3b6008-2ca8-43b4-a573-7190b552559d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Acquiring lock "adcf1ea7-e7d7-4499-b340-689d25667899-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:25:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-3c3b6008-2ca8-43b4-a573-7190b552559d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Lock "adcf1ea7-e7d7-4499-b340-689d25667899-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:25:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-3c3b6008-2ca8-43b4-a573-7190b552559d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Lock "adcf1ea7-e7d7-4499-b340-689d25667899-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:25:18 user nova-compute[73078]: INFO nova.compute.manager [None req-3c3b6008-2ca8-43b4-a573-7190b552559d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Terminating instance
Aug 14 18:25:18 user nova-compute[73078]: DEBUG nova.compute.manager [None req-3c3b6008-2ca8-43b4-a573-7190b552559d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:25:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:18 user nova-compute[73078]: DEBUG nova.compute.manager [req-6ddf80ee-a97c-4e4d-9762-f52f02ff91a7 req-05398da6-67d5-4503-96ed-b8176a75c99d service nova] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Received event network-vif-unplugged-99f07cab-5679-4800-a3ec-cb5e13875eca {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:25:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6ddf80ee-a97c-4e4d-9762-f52f02ff91a7 req-05398da6-67d5-4503-96ed-b8176a75c99d service nova] Acquiring lock "adcf1ea7-e7d7-4499-b340-689d25667899-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:25:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6ddf80ee-a97c-4e4d-9762-f52f02ff91a7 req-05398da6-67d5-4503-96ed-b8176a75c99d service nova] Lock "adcf1ea7-e7d7-4499-b340-689d25667899-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:25:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6ddf80ee-a97c-4e4d-9762-f52f02ff91a7 req-05398da6-67d5-4503-96ed-b8176a75c99d service nova] Lock "adcf1ea7-e7d7-4499-b340-689d25667899-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:25:18 user nova-compute[73078]: DEBUG nova.compute.manager [req-6ddf80ee-a97c-4e4d-9762-f52f02ff91a7 req-05398da6-67d5-4503-96ed-b8176a75c99d service nova] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] No waiting events found dispatching network-vif-unplugged-99f07cab-5679-4800-a3ec-cb5e13875eca {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:25:18 user nova-compute[73078]: DEBUG nova.compute.manager [req-6ddf80ee-a97c-4e4d-9762-f52f02ff91a7 req-05398da6-67d5-4503-96ed-b8176a75c99d service nova] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Received event network-vif-unplugged-99f07cab-5679-4800-a3ec-cb5e13875eca for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:25:18 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Instance destroyed successfully.
Aug 14 18:25:18 user nova-compute[73078]: DEBUG nova.objects.instance [None req-3c3b6008-2ca8-43b4-a573-7190b552559d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Lazy-loading 'resources' on Instance uuid adcf1ea7-e7d7-4499-b340-689d25667899 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:25:18 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-3c3b6008-2ca8-43b4-a573-7190b552559d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:22:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1986688767',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1986688767',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1986688',id=27,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAsV2gEH1L3ls8iqDNO9zBUAQZ8ER2s3OSa/yvGndYct1yDOSxIcFwmlMt/vtIwwW5tfe4bgixUm9eAkPlWZZEo1/1aWMpFm1sW/Ap1q76Ic2NI/FO+khGLyh07mZEz3vA==',key_name='tempest-keypair-1169564615',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:22:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f4a8df8cb194ca49e33819fdca6ad1a',ramdisk_id='',reservation_id='r-nqk6wj7b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1306773013',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:22:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4951addc5b8448328689b6e44c6d0551',uuid=adcf1ea7-e7d7-4499-b340-689d25667899,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99f07cab-5679-4800-a3ec-cb5e13875eca", "address": "fa:16:3e:66:92:5c", "network": {"id": "48dd4d92-4939-4d78-a62e-e1f8251e0ca9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-788877171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f4a8df8cb194ca49e33819fdca6ad1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f07cab-56", "ovs_interfaceid": "99f07cab-5679-4800-a3ec-cb5e13875eca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:25:18 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-3c3b6008-2ca8-43b4-a573-7190b552559d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Converting VIF {"id": "99f07cab-5679-4800-a3ec-cb5e13875eca", "address": "fa:16:3e:66:92:5c", "network": {"id": "48dd4d92-4939-4d78-a62e-e1f8251e0ca9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-788877171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f4a8df8cb194ca49e33819fdca6ad1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f07cab-56", "ovs_interfaceid": "99f07cab-5679-4800-a3ec-cb5e13875eca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:25:18 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-3c3b6008-2ca8-43b4-a573-7190b552559d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:92:5c,bridge_name='br-int',has_traffic_filtering=True,id=99f07cab-5679-4800-a3ec-cb5e13875eca,network=Network(48dd4d92-4939-4d78-a62e-e1f8251e0ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f07cab-56') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:25:18 user nova-compute[73078]: DEBUG os_vif [None req-3c3b6008-2ca8-43b4-a573-7190b552559d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:92:5c,bridge_name='br-int',has_traffic_filtering=True,id=99f07cab-5679-4800-a3ec-cb5e13875eca,network=Network(48dd4d92-4939-4d78-a62e-e1f8251e0ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f07cab-56') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:25:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99f07cab-56, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:25:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:25:19 user nova-compute[73078]: INFO os_vif [None req-3c3b6008-2ca8-43b4-a573-7190b552559d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:92:5c,bridge_name='br-int',has_traffic_filtering=True,id=99f07cab-5679-4800-a3ec-cb5e13875eca,network=Network(48dd4d92-4939-4d78-a62e-e1f8251e0ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f07cab-56')
Aug 14 18:25:19 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-3c3b6008-2ca8-43b4-a573-7190b552559d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Deleting instance files /opt/stack/data/nova/instances/adcf1ea7-e7d7-4499-b340-689d25667899_del
Aug 14 18:25:19 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-3c3b6008-2ca8-43b4-a573-7190b552559d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Deletion of /opt/stack/data/nova/instances/adcf1ea7-e7d7-4499-b340-689d25667899_del complete
Aug 14 18:25:19 user nova-compute[73078]: INFO nova.compute.manager [None req-3c3b6008-2ca8-43b4-a573-7190b552559d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 14 18:25:19 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-3c3b6008-2ca8-43b4-a573-7190b552559d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:25:19 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:25:19 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:25:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:20 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:25:20 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Took 1.08 seconds to deallocate network for instance.
Aug 14 18:25:20 user nova-compute[73078]: DEBUG nova.compute.manager [req-df4f366a-0868-44a1-94ef-c3a8298fdbc0 req-facbac9a-69d3-424e-9c16-e07bf6574b7e service nova] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Received event network-vif-deleted-99f07cab-5679-4800-a3ec-cb5e13875eca {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:25:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-3c3b6008-2ca8-43b4-a573-7190b552559d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:25:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-3c3b6008-2ca8-43b4-a573-7190b552559d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:25:20 user nova-compute[73078]: DEBUG nova.compute.manager [req-f60fc7b4-ae15-4bd9-aaf4-440f0b1ab2eb req-322b1044-cb93-406c-875a-1bc94668e538 service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Received event network-changed-5262c4ac-db58-4c3d-9546-7252ee76c730 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:25:20 user nova-compute[73078]: DEBUG nova.compute.manager [req-f60fc7b4-ae15-4bd9-aaf4-440f0b1ab2eb req-322b1044-cb93-406c-875a-1bc94668e538 service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Refreshing instance network info cache due to event network-changed-5262c4ac-db58-4c3d-9546-7252ee76c730. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:25:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-f60fc7b4-ae15-4bd9-aaf4-440f0b1ab2eb req-322b1044-cb93-406c-875a-1bc94668e538 service nova] Acquiring lock "refresh_cache-a99aa211-c2a1-4240-90cc-2df068d4f669" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:25:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-f60fc7b4-ae15-4bd9-aaf4-440f0b1ab2eb req-322b1044-cb93-406c-875a-1bc94668e538 service nova] Acquired lock "refresh_cache-a99aa211-c2a1-4240-90cc-2df068d4f669" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:25:20 user nova-compute[73078]: DEBUG nova.network.neutron [req-f60fc7b4-ae15-4bd9-aaf4-440f0b1ab2eb req-322b1044-cb93-406c-875a-1bc94668e538 service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Refreshing network info cache for port 5262c4ac-db58-4c3d-9546-7252ee76c730 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:25:20 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-3c3b6008-2ca8-43b4-a573-7190b552559d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:25:20 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-3c3b6008-2ca8-43b4-a573-7190b552559d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:25:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-3c3b6008-2ca8-43b4-a573-7190b552559d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.458s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:25:20 user nova-compute[73078]: DEBUG nova.compute.manager [req-864f68e3-4930-4e0e-921a-7ab545c75fb6 req-cc801756-73c2-42ec-91e5-7e58a5114d85 service nova] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Received event network-vif-plugged-99f07cab-5679-4800-a3ec-cb5e13875eca {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:25:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-864f68e3-4930-4e0e-921a-7ab545c75fb6 req-cc801756-73c2-42ec-91e5-7e58a5114d85 service nova] Acquiring lock "adcf1ea7-e7d7-4499-b340-689d25667899-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:25:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-864f68e3-4930-4e0e-921a-7ab545c75fb6 req-cc801756-73c2-42ec-91e5-7e58a5114d85 service nova] Lock "adcf1ea7-e7d7-4499-b340-689d25667899-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:25:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-864f68e3-4930-4e0e-921a-7ab545c75fb6 req-cc801756-73c2-42ec-91e5-7e58a5114d85 service nova] Lock "adcf1ea7-e7d7-4499-b340-689d25667899-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:25:20 user nova-compute[73078]: DEBUG nova.compute.manager [req-864f68e3-4930-4e0e-921a-7ab545c75fb6 req-cc801756-73c2-42ec-91e5-7e58a5114d85 service nova] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] No waiting events found dispatching network-vif-plugged-99f07cab-5679-4800-a3ec-cb5e13875eca {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:25:20 user nova-compute[73078]: WARNING nova.compute.manager [req-864f68e3-4930-4e0e-921a-7ab545c75fb6 req-cc801756-73c2-42ec-91e5-7e58a5114d85 service nova] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Received unexpected event network-vif-plugged-99f07cab-5679-4800-a3ec-cb5e13875eca for instance with vm_state deleted and task_state None.
Aug 14 18:25:20 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-3c3b6008-2ca8-43b4-a573-7190b552559d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Deleted allocations for instance adcf1ea7-e7d7-4499-b340-689d25667899
Aug 14 18:25:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-3c3b6008-2ca8-43b4-a573-7190b552559d tempest-TestServerVolumeAttachScenarioOldVersion-1306773013 tempest-TestServerVolumeAttachScenarioOldVersion-1306773013-project-member] Lock "adcf1ea7-e7d7-4499-b340-689d25667899" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.698s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-7a9de61c-067a-49b7-8cfa-fcb734bdb92b tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "a99aa211-c2a1-4240-90cc-2df068d4f669" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-7a9de61c-067a-49b7-8cfa-fcb734bdb92b tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "a99aa211-c2a1-4240-90cc-2df068d4f669" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:25:21 user nova-compute[73078]: INFO nova.compute.manager [None req-7a9de61c-067a-49b7-8cfa-fcb734bdb92b tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Detaching volume c4d0cf0d-3b33-4385-98cb-7948afab952a
Aug 14 18:25:21 user nova-compute[73078]: INFO nova.virt.block_device [None req-7a9de61c-067a-49b7-8cfa-fcb734bdb92b tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Attempting to driver detach volume c4d0cf0d-3b33-4385-98cb-7948afab952a from mountpoint /dev/vdb
Aug 14 18:25:21 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-7a9de61c-067a-49b7-8cfa-fcb734bdb92b tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Attempting to detach device vdb from instance a99aa211-c2a1-4240-90cc-2df068d4f669 from the persistent domain config. {{(pid=73078) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-7a9de61c-067a-49b7-8cfa-fcb734bdb92b tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:25:21 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:25:21 user nova-compute[73078]:   <source dev="/dev/sdd"/>
Aug 14 18:25:21 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:25:21 user nova-compute[73078]:   <serial>c4d0cf0d-3b33-4385-98cb-7948afab952a</serial>
Aug 14 18:25:21 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:25:21 user nova-compute[73078]: </disk>
Aug 14 18:25:21 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:25:21 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-7a9de61c-067a-49b7-8cfa-fcb734bdb92b tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Successfully detached device vdb from instance a99aa211-c2a1-4240-90cc-2df068d4f669 from the persistent domain config.
Aug 14 18:25:21 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-7a9de61c-067a-49b7-8cfa-fcb734bdb92b tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a99aa211-c2a1-4240-90cc-2df068d4f669 from the live domain config. {{(pid=73078) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-7a9de61c-067a-49b7-8cfa-fcb734bdb92b tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:25:21 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:25:21 user nova-compute[73078]:   <source dev="/dev/sdd"/>
Aug 14 18:25:21 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:25:21 user nova-compute[73078]:   <serial>c4d0cf0d-3b33-4385-98cb-7948afab952a</serial>
Aug 14 18:25:21 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:25:21 user nova-compute[73078]: </disk>
Aug 14 18:25:21 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Received event <DeviceRemovedEvent: 1692037521.6336358, a99aa211-c2a1-4240-90cc-2df068d4f669 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73078) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-7a9de61c-067a-49b7-8cfa-fcb734bdb92b tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a99aa211-c2a1-4240-90cc-2df068d4f669 {{(pid=73078) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 18:25:21 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-7a9de61c-067a-49b7-8cfa-fcb734bdb92b tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Successfully detached device vdb from instance a99aa211-c2a1-4240-90cc-2df068d4f669 from the live domain config.
Aug 14 18:25:21 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a9de61c-067a-49b7-8cfa-fcb734bdb92b tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9de61c-067a-49b7-8cfa-fcb734bdb92b tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wnZJjTPG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:25:21 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-7a9de61c-067a-49b7-8cfa-fcb734bdb92b tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:25:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-7a9de61c-067a-49b7-8cfa-fcb734bdb92b tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-7a9de61c-067a-49b7-8cfa-fcb734bdb92b tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9de61c-067a-49b7-8cfa-fcb734bdb92b tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4921625-f645-4a07-83a5-445cc9081064]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea64112d-5dbc-4227-8006-b6caccfbc408]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9de61c-067a-49b7-8cfa-fcb734bdb92b tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:25:21 user nova-compute[73078]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 (non-flash)
Aug 14 18:25:21 user nova-compute[73078]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:25:21 user nova-compute[73078]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:25:21 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9de61c-067a-49b7-8cfa-fcb734bdb92b tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a (non-flash)
Aug 14 18:25:21 user nova-compute[73078]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 (non-flash)
Aug 14 18:25:21 user nova-compute[73078]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:25:21 user nova-compute[73078]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:25:21 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9de61c-067a-49b7-8cfa-fcb734bdb92b tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe99010d120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a'): ({'sdd'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-7a9de61c-067a-49b7-8cfa-fcb734bdb92b tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Removing single pathed devices sdd {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[370f5e46-2c0e-4f88-8c82-3a0a774b0fd3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf74ef5-171d-442a-9abb-1aec5c11bcd3]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-7a9de61c-067a-49b7-8cfa-fcb734bdb92b tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Flushing IO for device /dev/sdd {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c42353-35e1-4586-a26d-5777aa2c2344]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-7a9de61c-067a-49b7-8cfa-fcb734bdb92b tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.078s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aac993f-58bd-4362-aebd-1bdc926ca7ce]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-7a9de61c-067a-49b7-8cfa-fcb734bdb92b tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-7a9de61c-067a-49b7-8cfa-fcb734bdb92b tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] SCSI volumes sdd have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9de61c-067a-49b7-8cfa-fcb734bdb92b tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf46541-3062-4425-a4dd-c7375b35dfbc]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9de61c-067a-49b7-8cfa-fcb734bdb92b tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:25:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6302a88e-2e4c-485b-8ce8-947b2d02dd90]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:25:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9de61c-067a-49b7-8cfa-fcb734bdb92b tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a, portal: 172.16.0.220,3260]
Aug 14 18:25:22 user nova-compute[73078]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a, portal: 172.16.0.220,3260] successful.
Aug 14 18:25:22 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:25:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:22 user nova-compute[73078]: DEBUG nova.network.neutron [req-f60fc7b4-ae15-4bd9-aaf4-440f0b1ab2eb req-322b1044-cb93-406c-875a-1bc94668e538 service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Updated VIF entry in instance network info cache for port 5262c4ac-db58-4c3d-9546-7252ee76c730. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:25:22 user nova-compute[73078]: DEBUG nova.network.neutron [req-f60fc7b4-ae15-4bd9-aaf4-440f0b1ab2eb req-322b1044-cb93-406c-875a-1bc94668e538 service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Updating instance_info_cache with network_info: [{"id": "5262c4ac-db58-4c3d-9546-7252ee76c730", "address": "fa:16:3e:e4:7f:9e", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5262c4ac-db", "ovs_interfaceid": "5262c4ac-db58-4c3d-9546-7252ee76c730", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:25:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4d0cf0d-3b33-4385-98cb-7948afab952a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae99b44-aa31-4218-8ee6-556140b75bc5]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:25:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9de61c-067a-49b7-8cfa-fcb734bdb92b tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:25:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-7a9de61c-067a-49b7-8cfa-fcb734bdb92b tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.439s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:25:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9de61c-067a-49b7-8cfa-fcb734bdb92b tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] <== disconnect_volume: return (440ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:25:22 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a9de61c-067a-49b7-8cfa-fcb734bdb92b tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:25:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-f60fc7b4-ae15-4bd9-aaf4-440f0b1ab2eb req-322b1044-cb93-406c-875a-1bc94668e538 service nova] Releasing lock "refresh_cache-a99aa211-c2a1-4240-90cc-2df068d4f669" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:25:22 user nova-compute[73078]: DEBUG nova.compute.manager [req-f23819b5-bb59-4e06-a464-acbc509bf2ab req-4f2fbec5-56c7-4804-8d37-7597c0575ff6 service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Received event network-changed-5262c4ac-db58-4c3d-9546-7252ee76c730 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:25:22 user nova-compute[73078]: DEBUG nova.compute.manager [req-f23819b5-bb59-4e06-a464-acbc509bf2ab req-4f2fbec5-56c7-4804-8d37-7597c0575ff6 service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Refreshing instance network info cache due to event network-changed-5262c4ac-db58-4c3d-9546-7252ee76c730. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:25:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-f23819b5-bb59-4e06-a464-acbc509bf2ab req-4f2fbec5-56c7-4804-8d37-7597c0575ff6 service nova] Acquiring lock "refresh_cache-a99aa211-c2a1-4240-90cc-2df068d4f669" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:25:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-f23819b5-bb59-4e06-a464-acbc509bf2ab req-4f2fbec5-56c7-4804-8d37-7597c0575ff6 service nova] Acquired lock "refresh_cache-a99aa211-c2a1-4240-90cc-2df068d4f669" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:25:22 user nova-compute[73078]: DEBUG nova.network.neutron [req-f23819b5-bb59-4e06-a464-acbc509bf2ab req-4f2fbec5-56c7-4804-8d37-7597c0575ff6 service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Refreshing network info cache for port 5262c4ac-db58-4c3d-9546-7252ee76c730 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:25:22 user nova-compute[73078]: DEBUG nova.objects.instance [None req-7a9de61c-067a-49b7-8cfa-fcb734bdb92b tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lazy-loading 'flavor' on Instance uuid a99aa211-c2a1-4240-90cc-2df068d4f669 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:25:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-7a9de61c-067a-49b7-8cfa-fcb734bdb92b tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "a99aa211-c2a1-4240-90cc-2df068d4f669" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.862s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:25:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:23 user nova-compute[73078]: DEBUG nova.network.neutron [req-f23819b5-bb59-4e06-a464-acbc509bf2ab req-4f2fbec5-56c7-4804-8d37-7597c0575ff6 service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Updated VIF entry in instance network info cache for port 5262c4ac-db58-4c3d-9546-7252ee76c730. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:25:23 user nova-compute[73078]: DEBUG nova.network.neutron [req-f23819b5-bb59-4e06-a464-acbc509bf2ab req-4f2fbec5-56c7-4804-8d37-7597c0575ff6 service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Updating instance_info_cache with network_info: [{"id": "5262c4ac-db58-4c3d-9546-7252ee76c730", "address": "fa:16:3e:e4:7f:9e", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5262c4ac-db", "ovs_interfaceid": "5262c4ac-db58-4c3d-9546-7252ee76c730", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:25:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-f23819b5-bb59-4e06-a464-acbc509bf2ab req-4f2fbec5-56c7-4804-8d37-7597c0575ff6 service nova] Releasing lock "refresh_cache-a99aa211-c2a1-4240-90cc-2df068d4f669" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:25:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:25 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Acquiring lock "ef083dd3-67d6-48a8-846a-7fe6c6b32d5c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:25:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "ef083dd3-67d6-48a8-846a-7fe6c6b32d5c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:25:26 user nova-compute[73078]: DEBUG nova.compute.manager [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:25:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:25:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:25:26 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:25:26 user nova-compute[73078]: INFO nova.compute.claims [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Claim successful on node user
Aug 14 18:25:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:27 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:25:27 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:25:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.634s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:25:27 user nova-compute[73078]: DEBUG nova.compute.manager [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:25:27 user nova-compute[73078]: DEBUG nova.compute.manager [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:25:27 user nova-compute[73078]: DEBUG nova.network.neutron [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:25:27 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:25:27 user nova-compute[73078]: DEBUG nova.compute.manager [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:25:27 user nova-compute[73078]: DEBUG nova.policy [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '08f7cf7e532f46c8942157b99f9ccd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce3bd6c6a784ee3a395c368d667c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:25:27 user nova-compute[73078]: DEBUG nova.compute.manager [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:25:27 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:25:27 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Creating image(s)
Aug 14 18:25:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Acquiring lock "/opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:25:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "/opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:25:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "/opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:25:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.211s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:25:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:25:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.172s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk 1073741824" returned: 0 in 0.052s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:25:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.191s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:28 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:25:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:28 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Cannot resize image /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:25:28 user nova-compute[73078]: DEBUG nova.objects.instance [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lazy-loading 'migration_context' on Instance uuid ef083dd3-67d6-48a8-846a-7fe6c6b32d5c {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:25:28 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:25:28 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Ensure instance console log exists: /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:25:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:25:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:25:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:25:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:29 user nova-compute[73078]: DEBUG nova.network.neutron [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Successfully created port: 396a7d1c-7aec-4324-8722-adc2dc77db86 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:25:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:30 user nova-compute[73078]: DEBUG nova.network.neutron [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Successfully updated port: 396a7d1c-7aec-4324-8722-adc2dc77db86 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:25:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Acquiring lock "refresh_cache-ef083dd3-67d6-48a8-846a-7fe6c6b32d5c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:25:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Acquired lock "refresh_cache-ef083dd3-67d6-48a8-846a-7fe6c6b32d5c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:25:30 user nova-compute[73078]: DEBUG nova.network.neutron [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:25:30 user nova-compute[73078]: DEBUG nova.compute.manager [req-04ba894c-a16d-4a42-b71e-b4e8cc697b47 req-933a9665-adab-46b9-b7a1-ef7ded226321 service nova] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Received event network-changed-396a7d1c-7aec-4324-8722-adc2dc77db86 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:25:30 user nova-compute[73078]: DEBUG nova.compute.manager [req-04ba894c-a16d-4a42-b71e-b4e8cc697b47 req-933a9665-adab-46b9-b7a1-ef7ded226321 service nova] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Refreshing instance network info cache due to event network-changed-396a7d1c-7aec-4324-8722-adc2dc77db86. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:25:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-04ba894c-a16d-4a42-b71e-b4e8cc697b47 req-933a9665-adab-46b9-b7a1-ef7ded226321 service nova] Acquiring lock "refresh_cache-ef083dd3-67d6-48a8-846a-7fe6c6b32d5c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:25:30 user nova-compute[73078]: DEBUG nova.network.neutron [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:25:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG nova.network.neutron [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Updating instance_info_cache with network_info: [{"id": "396a7d1c-7aec-4324-8722-adc2dc77db86", "address": "fa:16:3e:17:fe:f7", "network": {"id": "21c76d99-2d0a-42b9-b7a0-b068f0cb938f", "bridge": "br-int", "label": "tempest-TestStampPattern-1682035048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce3bd6c6a784ee3a395c368d667c1b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap396a7d1c-7a", "ovs_interfaceid": "396a7d1c-7aec-4324-8722-adc2dc77db86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Releasing lock "refresh_cache-ef083dd3-67d6-48a8-846a-7fe6c6b32d5c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG nova.compute.manager [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Instance network_info: |[{"id": "396a7d1c-7aec-4324-8722-adc2dc77db86", "address": "fa:16:3e:17:fe:f7", "network": {"id": "21c76d99-2d0a-42b9-b7a0-b068f0cb938f", "bridge": "br-int", "label": "tempest-TestStampPattern-1682035048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce3bd6c6a784ee3a395c368d667c1b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap396a7d1c-7a", "ovs_interfaceid": "396a7d1c-7aec-4324-8722-adc2dc77db86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-04ba894c-a16d-4a42-b71e-b4e8cc697b47 req-933a9665-adab-46b9-b7a1-ef7ded226321 service nova] Acquired lock "refresh_cache-ef083dd3-67d6-48a8-846a-7fe6c6b32d5c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG nova.network.neutron [req-04ba894c-a16d-4a42-b71e-b4e8cc697b47 req-933a9665-adab-46b9-b7a1-ef7ded226321 service nova] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Refreshing network info cache for port 396a7d1c-7aec-4324-8722-adc2dc77db86 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Start _get_guest_xml network_info=[{"id": "396a7d1c-7aec-4324-8722-adc2dc77db86", "address": "fa:16:3e:17:fe:f7", "network": {"id": "21c76d99-2d0a-42b9-b7a0-b068f0cb938f", "bridge": "br-int", "label": "tempest-TestStampPattern-1682035048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce3bd6c6a784ee3a395c368d667c1b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap396a7d1c-7a", "ovs_interfaceid": "396a7d1c-7aec-4324-8722-adc2dc77db86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:25:31 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:25:31 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:25:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:25:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-243322462',display_name='tempest-TestStampPattern-server-243322462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-243322462',id=33,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCcJMv1AV17ylcLliWNA6MPLR+aDJkzXeqhllF0bf2imCcrbw2X6UlhzsHI25lDDbRh7U/jFMtBw5eymdUYDpVK4u5ZUqAplS3uUj5rbwGNZVg+pHSh9eSszqkvnE3m/A==',key_name='tempest-TestStampPattern-762241101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ce3bd6c6a784ee3a395c368d667c1b3',ramdisk_id='',reservation_id='r-xvq7nd6n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-11663352',owner_user_name='tempest-TestStampPattern-11663352-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:25:27Z,user_data=None,user_id='08f7cf7e532f46c8942157b99f9ccd77',uuid=ef083dd3-67d6-48a8-846a-7fe6c6b32d5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "396a7d1c-7aec-4324-8722-adc2dc77db86", "address": "fa:16:3e:17:fe:f7", "network": {"id": "21c76d99-2d0a-42b9-b7a0-b068f0cb938f", "bridge": "br-int", "label": "tempest-TestStampPattern-1682035048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce3bd6c6a784ee3a395c368d667c1b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap396a7d1c-7a", "ovs_interfaceid": "396a7d1c-7aec-4324-8722-adc2dc77db86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Converting VIF {"id": "396a7d1c-7aec-4324-8722-adc2dc77db86", "address": "fa:16:3e:17:fe:f7", "network": {"id": "21c76d99-2d0a-42b9-b7a0-b068f0cb938f", "bridge": "br-int", "label": "tempest-TestStampPattern-1682035048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce3bd6c6a784ee3a395c368d667c1b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap396a7d1c-7a", "ovs_interfaceid": "396a7d1c-7aec-4324-8722-adc2dc77db86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:fe:f7,bridge_name='br-int',has_traffic_filtering=True,id=396a7d1c-7aec-4324-8722-adc2dc77db86,network=Network(21c76d99-2d0a-42b9-b7a0-b068f0cb938f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap396a7d1c-7a') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG nova.objects.instance [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lazy-loading 'pci_devices' on Instance uuid ef083dd3-67d6-48a8-846a-7fe6c6b32d5c {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:25:31 user nova-compute[73078]:   <uuid>ef083dd3-67d6-48a8-846a-7fe6c6b32d5c</uuid>
Aug 14 18:25:31 user nova-compute[73078]:   <name>instance-00000021</name>
Aug 14 18:25:31 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:25:31 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:25:31 user nova-compute[73078]:   <metadata>
Aug 14 18:25:31 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:25:31 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:25:31 user nova-compute[73078]:       <nova:name>tempest-TestStampPattern-server-243322462</nova:name>
Aug 14 18:25:31 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:25:31</nova:creationTime>
Aug 14 18:25:31 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:25:31 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:25:31 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:25:31 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:25:31 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:25:31 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:25:31 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:25:31 user nova-compute[73078]:       <nova:owner>
Aug 14 18:25:31 user nova-compute[73078]:         <nova:user uuid="08f7cf7e532f46c8942157b99f9ccd77">tempest-TestStampPattern-11663352-project-member</nova:user>
Aug 14 18:25:31 user nova-compute[73078]:         <nova:project uuid="0ce3bd6c6a784ee3a395c368d667c1b3">tempest-TestStampPattern-11663352</nova:project>
Aug 14 18:25:31 user nova-compute[73078]:       </nova:owner>
Aug 14 18:25:31 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:25:31 user nova-compute[73078]:       <nova:ports>
Aug 14 18:25:31 user nova-compute[73078]:         <nova:port uuid="396a7d1c-7aec-4324-8722-adc2dc77db86">
Aug 14 18:25:31 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 18:25:31 user nova-compute[73078]:         </nova:port>
Aug 14 18:25:31 user nova-compute[73078]:       </nova:ports>
Aug 14 18:25:31 user nova-compute[73078]:     </nova:instance>
Aug 14 18:25:31 user nova-compute[73078]:   </metadata>
Aug 14 18:25:31 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:25:31 user nova-compute[73078]:     <system>
Aug 14 18:25:31 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:25:31 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:25:31 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:25:31 user nova-compute[73078]:       <entry name="serial">ef083dd3-67d6-48a8-846a-7fe6c6b32d5c</entry>
Aug 14 18:25:31 user nova-compute[73078]:       <entry name="uuid">ef083dd3-67d6-48a8-846a-7fe6c6b32d5c</entry>
Aug 14 18:25:31 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:25:31 user nova-compute[73078]:     </system>
Aug 14 18:25:31 user nova-compute[73078]:   </sysinfo>
Aug 14 18:25:31 user nova-compute[73078]:   <os>
Aug 14 18:25:31 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:25:31 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:25:31 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:25:31 user nova-compute[73078]:   </os>
Aug 14 18:25:31 user nova-compute[73078]:   <features>
Aug 14 18:25:31 user nova-compute[73078]:     <acpi/>
Aug 14 18:25:31 user nova-compute[73078]:     <apic/>
Aug 14 18:25:31 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:25:31 user nova-compute[73078]:   </features>
Aug 14 18:25:31 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:25:31 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:25:31 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:25:31 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:25:31 user nova-compute[73078]:   </clock>
Aug 14 18:25:31 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:25:31 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:25:31 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:25:31 user nova-compute[73078]:   </cpu>
Aug 14 18:25:31 user nova-compute[73078]:   <devices>
Aug 14 18:25:31 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:25:31 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:25:31 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk"/>
Aug 14 18:25:31 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:25:31 user nova-compute[73078]:     </disk>
Aug 14 18:25:31 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:25:31 user nova-compute[73078]:       <mac address="fa:16:3e:17:fe:f7"/>
Aug 14 18:25:31 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:25:31 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:25:31 user nova-compute[73078]:       <target dev="tap396a7d1c-7a"/>
Aug 14 18:25:31 user nova-compute[73078]:     </interface>
Aug 14 18:25:31 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:25:31 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/console.log" append="off"/>
Aug 14 18:25:31 user nova-compute[73078]:     </serial>
Aug 14 18:25:31 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:25:31 user nova-compute[73078]:     <video>
Aug 14 18:25:31 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:25:31 user nova-compute[73078]:     </video>
Aug 14 18:25:31 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:25:31 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:25:31 user nova-compute[73078]:     </rng>
Aug 14 18:25:31 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:25:31 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:25:31 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:25:31 user nova-compute[73078]:     </memballoon>
Aug 14 18:25:31 user nova-compute[73078]:   </devices>
Aug 14 18:25:31 user nova-compute[73078]: </domain>
Aug 14 18:25:31 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:25:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-243322462',display_name='tempest-TestStampPattern-server-243322462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-243322462',id=33,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCcJMv1AV17ylcLliWNA6MPLR+aDJkzXeqhllF0bf2imCcrbw2X6UlhzsHI25lDDbRh7U/jFMtBw5eymdUYDpVK4u5ZUqAplS3uUj5rbwGNZVg+pHSh9eSszqkvnE3m/A==',key_name='tempest-TestStampPattern-762241101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ce3bd6c6a784ee3a395c368d667c1b3',ramdisk_id='',reservation_id='r-xvq7nd6n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-11663352',owner_user_name='tempest-TestStampPattern-11663352-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:25:27Z,user_data=None,user_id='08f7cf7e532f46c8942157b99f9ccd77',uuid=ef083dd3-67d6-48a8-846a-7fe6c6b32d5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "396a7d1c-7aec-4324-8722-adc2dc77db86", "address": "fa:16:3e:17:fe:f7", "network": {"id": "21c76d99-2d0a-42b9-b7a0-b068f0cb938f", "bridge": "br-int", "label": "tempest-TestStampPattern-1682035048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce3bd6c6a784ee3a395c368d667c1b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap396a7d1c-7a", "ovs_interfaceid": "396a7d1c-7aec-4324-8722-adc2dc77db86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Converting VIF {"id": "396a7d1c-7aec-4324-8722-adc2dc77db86", "address": "fa:16:3e:17:fe:f7", "network": {"id": "21c76d99-2d0a-42b9-b7a0-b068f0cb938f", "bridge": "br-int", "label": "tempest-TestStampPattern-1682035048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce3bd6c6a784ee3a395c368d667c1b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap396a7d1c-7a", "ovs_interfaceid": "396a7d1c-7aec-4324-8722-adc2dc77db86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:fe:f7,bridge_name='br-int',has_traffic_filtering=True,id=396a7d1c-7aec-4324-8722-adc2dc77db86,network=Network(21c76d99-2d0a-42b9-b7a0-b068f0cb938f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap396a7d1c-7a') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG os_vif [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:fe:f7,bridge_name='br-int',has_traffic_filtering=True,id=396a7d1c-7aec-4324-8722-adc2dc77db86,network=Network(21c76d99-2d0a-42b9-b7a0-b068f0cb938f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap396a7d1c-7a') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap396a7d1c-7a, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap396a7d1c-7a, col_values=(('external_ids', {'iface-id': '396a7d1c-7aec-4324-8722-adc2dc77db86', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:fe:f7', 'vm-uuid': 'ef083dd3-67d6-48a8-846a-7fe6c6b32d5c'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:31 user nova-compute[73078]: INFO os_vif [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:fe:f7,bridge_name='br-int',has_traffic_filtering=True,id=396a7d1c-7aec-4324-8722-adc2dc77db86,network=Network(21c76d99-2d0a-42b9-b7a0-b068f0cb938f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap396a7d1c-7a')
Aug 14 18:25:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] No VIF found with MAC fa:16:3e:17:fe:f7, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG nova.network.neutron [req-04ba894c-a16d-4a42-b71e-b4e8cc697b47 req-933a9665-adab-46b9-b7a1-ef7ded226321 service nova] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Updated VIF entry in instance network info cache for port 396a7d1c-7aec-4324-8722-adc2dc77db86. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG nova.network.neutron [req-04ba894c-a16d-4a42-b71e-b4e8cc697b47 req-933a9665-adab-46b9-b7a1-ef7ded226321 service nova] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Updating instance_info_cache with network_info: [{"id": "396a7d1c-7aec-4324-8722-adc2dc77db86", "address": "fa:16:3e:17:fe:f7", "network": {"id": "21c76d99-2d0a-42b9-b7a0-b068f0cb938f", "bridge": "br-int", "label": "tempest-TestStampPattern-1682035048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce3bd6c6a784ee3a395c368d667c1b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap396a7d1c-7a", "ovs_interfaceid": "396a7d1c-7aec-4324-8722-adc2dc77db86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:25:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-04ba894c-a16d-4a42-b71e-b4e8cc697b47 req-933a9665-adab-46b9-b7a1-ef7ded226321 service nova] Releasing lock "refresh_cache-ef083dd3-67d6-48a8-846a-7fe6c6b32d5c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:25:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:33 user nova-compute[73078]: DEBUG nova.compute.manager [req-62db6cef-1312-40d4-bc4a-92d64f751bab req-b38a992a-8ddf-4d1b-a82c-f141384a0068 service nova] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Received event network-vif-plugged-396a7d1c-7aec-4324-8722-adc2dc77db86 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:25:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-62db6cef-1312-40d4-bc4a-92d64f751bab req-b38a992a-8ddf-4d1b-a82c-f141384a0068 service nova] Acquiring lock "ef083dd3-67d6-48a8-846a-7fe6c6b32d5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:25:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-62db6cef-1312-40d4-bc4a-92d64f751bab req-b38a992a-8ddf-4d1b-a82c-f141384a0068 service nova] Lock "ef083dd3-67d6-48a8-846a-7fe6c6b32d5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:25:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-62db6cef-1312-40d4-bc4a-92d64f751bab req-b38a992a-8ddf-4d1b-a82c-f141384a0068 service nova] Lock "ef083dd3-67d6-48a8-846a-7fe6c6b32d5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:25:33 user nova-compute[73078]: DEBUG nova.compute.manager [req-62db6cef-1312-40d4-bc4a-92d64f751bab req-b38a992a-8ddf-4d1b-a82c-f141384a0068 service nova] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] No waiting events found dispatching network-vif-plugged-396a7d1c-7aec-4324-8722-adc2dc77db86 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:25:33 user nova-compute[73078]: WARNING nova.compute.manager [req-62db6cef-1312-40d4-bc4a-92d64f751bab req-b38a992a-8ddf-4d1b-a82c-f141384a0068 service nova] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Received unexpected event network-vif-plugged-396a7d1c-7aec-4324-8722-adc2dc77db86 for instance with vm_state building and task_state spawning.
Aug 14 18:25:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:33 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692037518.9622114, adcf1ea7-e7d7-4499-b340-689d25667899 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:25:33 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] VM Stopped (Lifecycle Event)
Aug 14 18:25:33 user nova-compute[73078]: DEBUG nova.compute.manager [None req-56e94016-fdac-4d53-808d-19a85e31b1a6 None None] [instance: adcf1ea7-e7d7-4499-b340-689d25667899] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:25:34 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:25:34 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:25:34 user nova-compute[73078]: DEBUG nova.compute.manager [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:25:34 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:25:34 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:25:34 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:25:34 user nova-compute[73078]: INFO nova.compute.claims [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Claim successful on node user
Aug 14 18:25:34 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:25:34 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:25:34 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.502s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:25:34 user nova-compute[73078]: DEBUG nova.compute.manager [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:25:34 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037534.8894486, ef083dd3-67d6-48a8-846a-7fe6c6b32d5c => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:25:34 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] VM Resumed (Lifecycle Event)
Aug 14 18:25:34 user nova-compute[73078]: DEBUG nova.compute.manager [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:25:34 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:25:34 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Instance spawned successfully.
Aug 14 18:25:34 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:25:34 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:25:34 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:25:34 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:25:34 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:25:34 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:25:34 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:25:34 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:25:34 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:25:34 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:25:34 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037534.8929365, ef083dd3-67d6-48a8-846a-7fe6c6b32d5c => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:25:34 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] VM Started (Lifecycle Event)
Aug 14 18:25:34 user nova-compute[73078]: DEBUG nova.compute.manager [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:25:34 user nova-compute[73078]: DEBUG nova.network.neutron [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:25:34 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:25:34 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:25:34 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:25:35 user nova-compute[73078]: DEBUG nova.compute.manager [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:25:35 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:25:35 user nova-compute[73078]: INFO nova.compute.manager [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Took 7.51 seconds to spawn the instance on the hypervisor.
Aug 14 18:25:35 user nova-compute[73078]: DEBUG nova.compute.manager [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:25:35 user nova-compute[73078]: DEBUG nova.compute.manager [req-4e70ceff-1499-437e-99b0-260e36297390 req-9fb5296b-883a-4589-a09c-d244357c7d61 service nova] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Received event network-vif-plugged-396a7d1c-7aec-4324-8722-adc2dc77db86 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:25:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4e70ceff-1499-437e-99b0-260e36297390 req-9fb5296b-883a-4589-a09c-d244357c7d61 service nova] Acquiring lock "ef083dd3-67d6-48a8-846a-7fe6c6b32d5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:25:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4e70ceff-1499-437e-99b0-260e36297390 req-9fb5296b-883a-4589-a09c-d244357c7d61 service nova] Lock "ef083dd3-67d6-48a8-846a-7fe6c6b32d5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:25:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4e70ceff-1499-437e-99b0-260e36297390 req-9fb5296b-883a-4589-a09c-d244357c7d61 service nova] Lock "ef083dd3-67d6-48a8-846a-7fe6c6b32d5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:25:35 user nova-compute[73078]: DEBUG nova.compute.manager [req-4e70ceff-1499-437e-99b0-260e36297390 req-9fb5296b-883a-4589-a09c-d244357c7d61 service nova] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] No waiting events found dispatching network-vif-plugged-396a7d1c-7aec-4324-8722-adc2dc77db86 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:25:35 user nova-compute[73078]: WARNING nova.compute.manager [req-4e70ceff-1499-437e-99b0-260e36297390 req-9fb5296b-883a-4589-a09c-d244357c7d61 service nova] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Received unexpected event network-vif-plugged-396a7d1c-7aec-4324-8722-adc2dc77db86 for instance with vm_state building and task_state spawning.
Aug 14 18:25:35 user nova-compute[73078]: DEBUG nova.policy [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a3c5d292e9594e4aadad9ac72b9455ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1391a0a2167745348384e5890e6c22db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:25:35 user nova-compute[73078]: INFO nova.compute.manager [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Took 8.56 seconds to build instance.
Aug 14 18:25:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-313031d3-ce80-4a8d-9f02-4fbd916a27f9 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "ef083dd3-67d6-48a8-846a-7fe6c6b32d5c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.689s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:25:35 user nova-compute[73078]: DEBUG nova.compute.manager [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:25:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:25:35 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Creating image(s)
Aug 14 18:25:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "/opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:25:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "/opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:25:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "/opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:25:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.186s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:25:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:25:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.191s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21/disk 1073741824" returned: 0 in 0.050s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:25:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:35 user nova-compute[73078]: DEBUG nova.network.neutron [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Successfully created port: 3a7aa5b0-e16a-41c5-90e6-2065778d0dfd {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:25:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.226s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:35 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:25:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:36 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:36 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Cannot resize image /opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:25:36 user nova-compute[73078]: DEBUG nova.objects.instance [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lazy-loading 'migration_context' on Instance uuid 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:25:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:25:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Ensure instance console log exists: /opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:25:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:25:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:25:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:25:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:36 user nova-compute[73078]: DEBUG nova.network.neutron [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Successfully updated port: 3a7aa5b0-e16a-41c5-90e6-2065778d0dfd {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:25:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "refresh_cache-9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:25:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquired lock "refresh_cache-9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:25:36 user nova-compute[73078]: DEBUG nova.network.neutron [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:25:36 user nova-compute[73078]: DEBUG nova.compute.manager [req-ba06d710-7d4f-44a1-b72a-85cf9d27eb38 req-849153f8-5246-4afe-9ac4-0e0042e90d63 service nova] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Received event network-changed-3a7aa5b0-e16a-41c5-90e6-2065778d0dfd {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:25:36 user nova-compute[73078]: DEBUG nova.compute.manager [req-ba06d710-7d4f-44a1-b72a-85cf9d27eb38 req-849153f8-5246-4afe-9ac4-0e0042e90d63 service nova] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Refreshing instance network info cache due to event network-changed-3a7aa5b0-e16a-41c5-90e6-2065778d0dfd. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:25:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ba06d710-7d4f-44a1-b72a-85cf9d27eb38 req-849153f8-5246-4afe-9ac4-0e0042e90d63 service nova] Acquiring lock "refresh_cache-9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:25:36 user nova-compute[73078]: DEBUG nova.network.neutron [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG nova.network.neutron [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Updating instance_info_cache with network_info: [{"id": "3a7aa5b0-e16a-41c5-90e6-2065778d0dfd", "address": "fa:16:3e:e3:20:8e", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7aa5b0-e1", "ovs_interfaceid": "3a7aa5b0-e16a-41c5-90e6-2065778d0dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Releasing lock "refresh_cache-9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG nova.compute.manager [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Instance network_info: |[{"id": "3a7aa5b0-e16a-41c5-90e6-2065778d0dfd", "address": "fa:16:3e:e3:20:8e", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7aa5b0-e1", "ovs_interfaceid": "3a7aa5b0-e16a-41c5-90e6-2065778d0dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ba06d710-7d4f-44a1-b72a-85cf9d27eb38 req-849153f8-5246-4afe-9ac4-0e0042e90d63 service nova] Acquired lock "refresh_cache-9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG nova.network.neutron [req-ba06d710-7d4f-44a1-b72a-85cf9d27eb38 req-849153f8-5246-4afe-9ac4-0e0042e90d63 service nova] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Refreshing network info cache for port 3a7aa5b0-e16a-41c5-90e6-2065778d0dfd {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Start _get_guest_xml network_info=[{"id": "3a7aa5b0-e16a-41c5-90e6-2065778d0dfd", "address": "fa:16:3e:e3:20:8e", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7aa5b0-e1", "ovs_interfaceid": "3a7aa5b0-e16a-41c5-90e6-2065778d0dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:25:37 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:25:37 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:25:37 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:25:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-199092222',display_name='tempest-AttachVolumeNegativeTest-server-199092222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-199092222',id=34,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYiVauuk7EHbBA4bwswOlC6bhf4ZmAG3SG96mGYOBdLWu/bCu8ZPkXoRCGLpW7RwV0XXfsmLvJD6JNUowmOJtcjB0DepDnl+RL7c2A9zcsd5CkwWetrMPor0dGVOj+zYw==',key_name='tempest-keypair-961068103',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1391a0a2167745348384e5890e6c22db',ramdisk_id='',reservation_id='r-tk1satb6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1671295372',owner_user_name='tempest-AttachVolumeNegativeTest-1671295372-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:25:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3c5d292e9594e4aadad9ac72b9455ed',uuid=9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a7aa5b0-e16a-41c5-90e6-2065778d0dfd", "address": "fa:16:3e:e3:20:8e", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7aa5b0-e1", "ovs_interfaceid": "3a7aa5b0-e16a-41c5-90e6-2065778d0dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Converting VIF {"id": "3a7aa5b0-e16a-41c5-90e6-2065778d0dfd", "address": "fa:16:3e:e3:20:8e", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7aa5b0-e1", "ovs_interfaceid": "3a7aa5b0-e16a-41c5-90e6-2065778d0dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:20:8e,bridge_name='br-int',has_traffic_filtering=True,id=3a7aa5b0-e16a-41c5-90e6-2065778d0dfd,network=Network(88e922e4-ec89-460a-954d-aff20a41293c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a7aa5b0-e1') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG nova.objects.instance [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lazy-loading 'pci_devices' on Instance uuid 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:25:37 user nova-compute[73078]:   <uuid>9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21</uuid>
Aug 14 18:25:37 user nova-compute[73078]:   <name>instance-00000022</name>
Aug 14 18:25:37 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:25:37 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:25:37 user nova-compute[73078]:   <metadata>
Aug 14 18:25:37 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:25:37 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:25:37 user nova-compute[73078]:       <nova:name>tempest-AttachVolumeNegativeTest-server-199092222</nova:name>
Aug 14 18:25:37 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:25:37</nova:creationTime>
Aug 14 18:25:37 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:25:37 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:25:37 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:25:37 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:25:37 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:25:37 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:25:37 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:25:37 user nova-compute[73078]:       <nova:owner>
Aug 14 18:25:37 user nova-compute[73078]:         <nova:user uuid="a3c5d292e9594e4aadad9ac72b9455ed">tempest-AttachVolumeNegativeTest-1671295372-project-member</nova:user>
Aug 14 18:25:37 user nova-compute[73078]:         <nova:project uuid="1391a0a2167745348384e5890e6c22db">tempest-AttachVolumeNegativeTest-1671295372</nova:project>
Aug 14 18:25:37 user nova-compute[73078]:       </nova:owner>
Aug 14 18:25:37 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:25:37 user nova-compute[73078]:       <nova:ports>
Aug 14 18:25:37 user nova-compute[73078]:         <nova:port uuid="3a7aa5b0-e16a-41c5-90e6-2065778d0dfd">
Aug 14 18:25:37 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 14 18:25:37 user nova-compute[73078]:         </nova:port>
Aug 14 18:25:37 user nova-compute[73078]:       </nova:ports>
Aug 14 18:25:37 user nova-compute[73078]:     </nova:instance>
Aug 14 18:25:37 user nova-compute[73078]:   </metadata>
Aug 14 18:25:37 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:25:37 user nova-compute[73078]:     <system>
Aug 14 18:25:37 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:25:37 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:25:37 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:25:37 user nova-compute[73078]:       <entry name="serial">9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21</entry>
Aug 14 18:25:37 user nova-compute[73078]:       <entry name="uuid">9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21</entry>
Aug 14 18:25:37 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:25:37 user nova-compute[73078]:     </system>
Aug 14 18:25:37 user nova-compute[73078]:   </sysinfo>
Aug 14 18:25:37 user nova-compute[73078]:   <os>
Aug 14 18:25:37 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:25:37 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:25:37 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:25:37 user nova-compute[73078]:   </os>
Aug 14 18:25:37 user nova-compute[73078]:   <features>
Aug 14 18:25:37 user nova-compute[73078]:     <acpi/>
Aug 14 18:25:37 user nova-compute[73078]:     <apic/>
Aug 14 18:25:37 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:25:37 user nova-compute[73078]:   </features>
Aug 14 18:25:37 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:25:37 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:25:37 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:25:37 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:25:37 user nova-compute[73078]:   </clock>
Aug 14 18:25:37 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:25:37 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:25:37 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:25:37 user nova-compute[73078]:   </cpu>
Aug 14 18:25:37 user nova-compute[73078]:   <devices>
Aug 14 18:25:37 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:25:37 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:25:37 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21/disk"/>
Aug 14 18:25:37 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:25:37 user nova-compute[73078]:     </disk>
Aug 14 18:25:37 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:25:37 user nova-compute[73078]:       <mac address="fa:16:3e:e3:20:8e"/>
Aug 14 18:25:37 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:25:37 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:25:37 user nova-compute[73078]:       <target dev="tap3a7aa5b0-e1"/>
Aug 14 18:25:37 user nova-compute[73078]:     </interface>
Aug 14 18:25:37 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:25:37 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21/console.log" append="off"/>
Aug 14 18:25:37 user nova-compute[73078]:     </serial>
Aug 14 18:25:37 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:25:37 user nova-compute[73078]:     <video>
Aug 14 18:25:37 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:25:37 user nova-compute[73078]:     </video>
Aug 14 18:25:37 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:25:37 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:25:37 user nova-compute[73078]:     </rng>
Aug 14 18:25:37 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:25:37 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:25:37 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:25:37 user nova-compute[73078]:     </memballoon>
Aug 14 18:25:37 user nova-compute[73078]:   </devices>
Aug 14 18:25:37 user nova-compute[73078]: </domain>
Aug 14 18:25:37 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:25:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-199092222',display_name='tempest-AttachVolumeNegativeTest-server-199092222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-199092222',id=34,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYiVauuk7EHbBA4bwswOlC6bhf4ZmAG3SG96mGYOBdLWu/bCu8ZPkXoRCGLpW7RwV0XXfsmLvJD6JNUowmOJtcjB0DepDnl+RL7c2A9zcsd5CkwWetrMPor0dGVOj+zYw==',key_name='tempest-keypair-961068103',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1391a0a2167745348384e5890e6c22db',ramdisk_id='',reservation_id='r-tk1satb6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1671295372',owner_user_name='tempest-AttachVolumeNegativeTest-1671295372-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:25:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3c5d292e9594e4aadad9ac72b9455ed',uuid=9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a7aa5b0-e16a-41c5-90e6-2065778d0dfd", "address": "fa:16:3e:e3:20:8e", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7aa5b0-e1", "ovs_interfaceid": "3a7aa5b0-e16a-41c5-90e6-2065778d0dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Converting VIF {"id": "3a7aa5b0-e16a-41c5-90e6-2065778d0dfd", "address": "fa:16:3e:e3:20:8e", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7aa5b0-e1", "ovs_interfaceid": "3a7aa5b0-e16a-41c5-90e6-2065778d0dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:20:8e,bridge_name='br-int',has_traffic_filtering=True,id=3a7aa5b0-e16a-41c5-90e6-2065778d0dfd,network=Network(88e922e4-ec89-460a-954d-aff20a41293c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a7aa5b0-e1') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG os_vif [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:20:8e,bridge_name='br-int',has_traffic_filtering=True,id=3a7aa5b0-e16a-41c5-90e6-2065778d0dfd,network=Network(88e922e4-ec89-460a-954d-aff20a41293c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a7aa5b0-e1') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a7aa5b0-e1, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3a7aa5b0-e1, col_values=(('external_ids', {'iface-id': '3a7aa5b0-e16a-41c5-90e6-2065778d0dfd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:20:8e', 'vm-uuid': '9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:37 user nova-compute[73078]: INFO os_vif [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:20:8e,bridge_name='br-int',has_traffic_filtering=True,id=3a7aa5b0-e16a-41c5-90e6-2065778d0dfd,network=Network(88e922e4-ec89-460a-954d-aff20a41293c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a7aa5b0-e1')
Aug 14 18:25:37 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:25:37 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] No VIF found with MAC fa:16:3e:e3:20:8e, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:25:38 user nova-compute[73078]: DEBUG nova.network.neutron [req-ba06d710-7d4f-44a1-b72a-85cf9d27eb38 req-849153f8-5246-4afe-9ac4-0e0042e90d63 service nova] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Updated VIF entry in instance network info cache for port 3a7aa5b0-e16a-41c5-90e6-2065778d0dfd. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:25:38 user nova-compute[73078]: DEBUG nova.network.neutron [req-ba06d710-7d4f-44a1-b72a-85cf9d27eb38 req-849153f8-5246-4afe-9ac4-0e0042e90d63 service nova] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Updating instance_info_cache with network_info: [{"id": "3a7aa5b0-e16a-41c5-90e6-2065778d0dfd", "address": "fa:16:3e:e3:20:8e", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7aa5b0-e1", "ovs_interfaceid": "3a7aa5b0-e16a-41c5-90e6-2065778d0dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:25:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ba06d710-7d4f-44a1-b72a-85cf9d27eb38 req-849153f8-5246-4afe-9ac4-0e0042e90d63 service nova] Releasing lock "refresh_cache-9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:25:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "92b0eed8-2a32-4141-ab62-d7914fc6c150" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:25:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "92b0eed8-2a32-4141-ab62-d7914fc6c150" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:25:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "92b0eed8-2a32-4141-ab62-d7914fc6c150-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:25:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "92b0eed8-2a32-4141-ab62-d7914fc6c150-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:25:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "92b0eed8-2a32-4141-ab62-d7914fc6c150-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:25:38 user nova-compute[73078]: INFO nova.compute.manager [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Terminating instance
Aug 14 18:25:38 user nova-compute[73078]: DEBUG nova.compute.manager [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:25:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG nova.compute.manager [req-95dd20c4-0a74-401d-9b9c-12cacf74a6bb req-6cb2c428-1de4-4ba7-8f42-cb1f0ce658f8 service nova] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Received event network-vif-plugged-3a7aa5b0-e16a-41c5-90e6-2065778d0dfd {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-95dd20c4-0a74-401d-9b9c-12cacf74a6bb req-6cb2c428-1de4-4ba7-8f42-cb1f0ce658f8 service nova] Acquiring lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-95dd20c4-0a74-401d-9b9c-12cacf74a6bb req-6cb2c428-1de4-4ba7-8f42-cb1f0ce658f8 service nova] Lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-95dd20c4-0a74-401d-9b9c-12cacf74a6bb req-6cb2c428-1de4-4ba7-8f42-cb1f0ce658f8 service nova] Lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG nova.compute.manager [req-95dd20c4-0a74-401d-9b9c-12cacf74a6bb req-6cb2c428-1de4-4ba7-8f42-cb1f0ce658f8 service nova] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] No waiting events found dispatching network-vif-plugged-3a7aa5b0-e16a-41c5-90e6-2065778d0dfd {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:25:39 user nova-compute[73078]: WARNING nova.compute.manager [req-95dd20c4-0a74-401d-9b9c-12cacf74a6bb req-6cb2c428-1de4-4ba7-8f42-cb1f0ce658f8 service nova] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Received unexpected event network-vif-plugged-3a7aa5b0-e16a-41c5-90e6-2065778d0dfd for instance with vm_state building and task_state spawning.
Aug 14 18:25:39 user nova-compute[73078]: DEBUG nova.compute.manager [req-b08d9033-2309-43d5-a643-0db475812832 req-c6b48cbe-993f-41e4-89a9-8235537c08be service nova] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Received event network-vif-unplugged-765affb6-4f4c-4efb-a870-fb693de04c6c {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b08d9033-2309-43d5-a643-0db475812832 req-c6b48cbe-993f-41e4-89a9-8235537c08be service nova] Acquiring lock "92b0eed8-2a32-4141-ab62-d7914fc6c150-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b08d9033-2309-43d5-a643-0db475812832 req-c6b48cbe-993f-41e4-89a9-8235537c08be service nova] Lock "92b0eed8-2a32-4141-ab62-d7914fc6c150-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b08d9033-2309-43d5-a643-0db475812832 req-c6b48cbe-993f-41e4-89a9-8235537c08be service nova] Lock "92b0eed8-2a32-4141-ab62-d7914fc6c150-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG nova.compute.manager [req-b08d9033-2309-43d5-a643-0db475812832 req-c6b48cbe-993f-41e4-89a9-8235537c08be service nova] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] No waiting events found dispatching network-vif-unplugged-765affb6-4f4c-4efb-a870-fb693de04c6c {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG nova.compute.manager [req-b08d9033-2309-43d5-a643-0db475812832 req-c6b48cbe-993f-41e4-89a9-8235537c08be service nova] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Received event network-vif-unplugged-765affb6-4f4c-4efb-a870-fb693de04c6c for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:39 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Instance destroyed successfully.
Aug 14 18:25:39 user nova-compute[73078]: DEBUG nova.objects.instance [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lazy-loading 'resources' on Instance uuid 92b0eed8-2a32-4141-ab62-d7914fc6c150 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:23:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1710990244',display_name='tempest-TestVolumeBootPattern-server-1710990244',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1710990244',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:24:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7142101014c4defa7261a34fb9f28e4',ramdisk_id='',reservation_id='r-oi2d0knd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1889877750',owner_user_name='tempest-TestVolumeBootPattern-1889877750-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:24:12Z,user_data=None,user_id='fe79455616584e0fb80e6007edf0b706',uuid=92b0eed8-2a32-4141-ab62-d7914fc6c150,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "765affb6-4f4c-4efb-a870-fb693de04c6c", "address": "fa:16:3e:dd:d5:68", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765affb6-4f", "ovs_interfaceid": "765affb6-4f4c-4efb-a870-fb693de04c6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Converting VIF {"id": "765affb6-4f4c-4efb-a870-fb693de04c6c", "address": "fa:16:3e:dd:d5:68", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap765affb6-4f", "ovs_interfaceid": "765affb6-4f4c-4efb-a870-fb693de04c6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:d5:68,bridge_name='br-int',has_traffic_filtering=True,id=765affb6-4f4c-4efb-a870-fb693de04c6c,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap765affb6-4f') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG os_vif [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:d5:68,bridge_name='br-int',has_traffic_filtering=True,id=765affb6-4f4c-4efb-a870-fb693de04c6c,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap765affb6-4f') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap765affb6-4f, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:39 user nova-compute[73078]: INFO os_vif [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:d5:68,bridge_name='br-int',has_traffic_filtering=True,id=765affb6-4f4c-4efb-a870-fb693de04c6c,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap765affb6-4f')
Aug 14 18:25:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'soalpEIn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:25:39 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:25:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a7598d-b57b-4ba6-bcb5-9afc9e1297fd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dba2c71-d399-464d-9730-d8a9d32eb95f]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 (non-flash)
Aug 14 18:25:39 user nova-compute[73078]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:25:39 user nova-compute[73078]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:25:39 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 (non-flash)
Aug 14 18:25:39 user nova-compute[73078]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:25:39 user nova-compute[73078]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:25:39 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9782f5a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8'): ({'sdc'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Removing single pathed devices sdc {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1921b1-8bfd-488f-9dae-29172a336b8c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[690110f6-0c7f-44b7-9d2a-f9d33acda7c1]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Flushing IO for device /dev/sdc {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1f9ce8-021b-4a03-9538-f96d06ea9bc3]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8634c1b9-53e8-4a4f-bc6d-f1a80e504490]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] SCSI volumes sdc have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23137383062363163', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_223a1350', '/dev/disk/by-id/scsi-1SCST_BIO223a1350-1780b61c04d91a47') {{(pid=84732) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2508ebc-cf27-4784-bd68-6bb5981090bc]: (4, None) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b965692-1b7f-4355-b70d-66be5e7b6b05]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:25:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e8874f-c752-4552-9180-9fe0a12870d3]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:25:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8, portal: 172.16.0.220,3260]
Aug 14 18:25:40 user nova-compute[73078]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8, portal: 172.16.0.220,3260] successful.
Aug 14 18:25:40 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:25:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f339d02c-1c41-48c3-b358-f3f8d99530e8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15da9bf-1df8-4801-befc-bcfa7c99cffd]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:25:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:25:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:25:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] <== disconnect_volume: return (348ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:25:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:25:40 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Deleting instance files /opt/stack/data/nova/instances/92b0eed8-2a32-4141-ab62-d7914fc6c150_del
Aug 14 18:25:40 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Deletion of /opt/stack/data/nova/instances/92b0eed8-2a32-4141-ab62-d7914fc6c150_del complete
Aug 14 18:25:40 user nova-compute[73078]: INFO nova.compute.manager [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Took 1.32 seconds to destroy the instance on the hypervisor.
Aug 14 18:25:40 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:25:40 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:25:40 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:25:40 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:25:40 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Took 0.59 seconds to deallocate network for instance.
Aug 14 18:25:40 user nova-compute[73078]: DEBUG nova.compute.manager [req-33547fc9-0db6-4b65-bf87-ad3adbfb160a req-9dd9fc01-8c45-41aa-949f-662f8d84cad1 service nova] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Received event network-vif-deleted-765affb6-4f4c-4efb-a870-fb693de04c6c {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:25:40 user nova-compute[73078]: INFO nova.compute.manager [req-33547fc9-0db6-4b65-bf87-ad3adbfb160a req-9dd9fc01-8c45-41aa-949f-662f8d84cad1 service nova] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Neutron deleted interface 765affb6-4f4c-4efb-a870-fb693de04c6c; detaching it from the instance and deleting it from the info cache
Aug 14 18:25:40 user nova-compute[73078]: DEBUG nova.network.neutron [req-33547fc9-0db6-4b65-bf87-ad3adbfb160a req-9dd9fc01-8c45-41aa-949f-662f8d84cad1 service nova] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:25:40 user nova-compute[73078]: DEBUG nova.compute.manager [req-33547fc9-0db6-4b65-bf87-ad3adbfb160a req-9dd9fc01-8c45-41aa-949f-662f8d84cad1 service nova] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Detach interface failed, port_id=765affb6-4f4c-4efb-a870-fb693de04c6c, reason: Instance 92b0eed8-2a32-4141-ab62-d7914fc6c150 could not be found. {{(pid=73078) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 18:25:41 user nova-compute[73078]: DEBUG nova.compute.manager [req-1593e6ac-dba0-4ed7-b717-587922bdf56f req-461c26aa-9ed1-4246-bb0a-cdf416e87039 service nova] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Received event network-vif-plugged-3a7aa5b0-e16a-41c5-90e6-2065778d0dfd {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:25:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1593e6ac-dba0-4ed7-b717-587922bdf56f req-461c26aa-9ed1-4246-bb0a-cdf416e87039 service nova] Acquiring lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:25:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1593e6ac-dba0-4ed7-b717-587922bdf56f req-461c26aa-9ed1-4246-bb0a-cdf416e87039 service nova] Lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:25:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1593e6ac-dba0-4ed7-b717-587922bdf56f req-461c26aa-9ed1-4246-bb0a-cdf416e87039 service nova] Lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:25:41 user nova-compute[73078]: DEBUG nova.compute.manager [req-1593e6ac-dba0-4ed7-b717-587922bdf56f req-461c26aa-9ed1-4246-bb0a-cdf416e87039 service nova] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] No waiting events found dispatching network-vif-plugged-3a7aa5b0-e16a-41c5-90e6-2065778d0dfd {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:25:41 user nova-compute[73078]: WARNING nova.compute.manager [req-1593e6ac-dba0-4ed7-b717-587922bdf56f req-461c26aa-9ed1-4246-bb0a-cdf416e87039 service nova] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Received unexpected event network-vif-plugged-3a7aa5b0-e16a-41c5-90e6-2065778d0dfd for instance with vm_state building and task_state spawning.
Aug 14 18:25:41 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037541.1475277, 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:25:41 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] VM Resumed (Lifecycle Event)
Aug 14 18:25:41 user nova-compute[73078]: DEBUG nova.compute.manager [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:25:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:25:41 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Instance spawned successfully.
Aug 14 18:25:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:25:41 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:25:41 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:25:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:25:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:25:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:25:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:25:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:25:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:25:41 user nova-compute[73078]: DEBUG nova.compute.manager [req-c47c7727-3e26-4eb2-b3bd-156fa363a807 req-d1698d10-9604-4e68-b081-4fd77074439f service nova] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Received event network-vif-plugged-765affb6-4f4c-4efb-a870-fb693de04c6c {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:25:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-c47c7727-3e26-4eb2-b3bd-156fa363a807 req-d1698d10-9604-4e68-b081-4fd77074439f service nova] Acquiring lock "92b0eed8-2a32-4141-ab62-d7914fc6c150-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:25:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-c47c7727-3e26-4eb2-b3bd-156fa363a807 req-d1698d10-9604-4e68-b081-4fd77074439f service nova] Lock "92b0eed8-2a32-4141-ab62-d7914fc6c150-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:25:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-c47c7727-3e26-4eb2-b3bd-156fa363a807 req-d1698d10-9604-4e68-b081-4fd77074439f service nova] Lock "92b0eed8-2a32-4141-ab62-d7914fc6c150-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:25:41 user nova-compute[73078]: DEBUG nova.compute.manager [req-c47c7727-3e26-4eb2-b3bd-156fa363a807 req-d1698d10-9604-4e68-b081-4fd77074439f service nova] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] No waiting events found dispatching network-vif-plugged-765affb6-4f4c-4efb-a870-fb693de04c6c {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:25:41 user nova-compute[73078]: WARNING nova.compute.manager [req-c47c7727-3e26-4eb2-b3bd-156fa363a807 req-d1698d10-9604-4e68-b081-4fd77074439f service nova] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Received unexpected event network-vif-plugged-765affb6-4f4c-4efb-a870-fb693de04c6c for instance with vm_state active and task_state deleting.
Aug 14 18:25:41 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:25:41 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037541.149355, 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:25:41 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] VM Started (Lifecycle Event)
Aug 14 18:25:41 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:25:41 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:25:41 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:25:41 user nova-compute[73078]: INFO nova.compute.manager [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Took 6.12 seconds to spawn the instance on the hypervisor.
Aug 14 18:25:41 user nova-compute[73078]: DEBUG nova.compute.manager [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:25:41 user nova-compute[73078]: INFO nova.compute.manager [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Took 7.04 seconds to build instance.
Aug 14 18:25:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-15c1b380-b923-4f9d-ae58-349b545da34a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.129s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:25:41 user nova-compute[73078]: INFO nova.compute.manager [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Took 0.83 seconds to detach 1 volumes for instance.
Aug 14 18:25:41 user nova-compute[73078]: DEBUG nova.compute.manager [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Deleting volume: f339d02c-1c41-48c3-b358-f3f8d99530e8 {{(pid=73078) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 18:25:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:25:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:25:42 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:25:42 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:25:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.470s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:25:42 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Deleted allocations for instance 92b0eed8-2a32-4141-ab62-d7914fc6c150
Aug 14 18:25:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-1e19bafa-a2b9-443f-98de-12236fbc139c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "92b0eed8-2a32-4141-ab62-d7914fc6c150" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.546s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:25:43 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:25:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:25:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:25:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:25:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:52 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:25:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:25:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:25:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:25:52 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:25:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:25:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16abee43-684b-415f-9c77-476ffb7283e8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16abee43-684b-415f-9c77-476ffb7283e8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16abee43-684b-415f-9c77-476ffb7283e8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16abee43-684b-415f-9c77-476ffb7283e8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:54 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692037539.5970643, 92b0eed8-2a32-4141-ab62-d7914fc6c150 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:25:54 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] VM Stopped (Lifecycle Event)
Aug 14 18:25:54 user nova-compute[73078]: DEBUG nova.compute.manager [None req-7af6ca49-e3e0-42a5-a323-8c5173cba447 None None] [instance: 92b0eed8-2a32-4141-ab62-d7914fc6c150] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:25:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:25:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:25:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:25:56 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:25:56 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:25:56 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=7219MB free_disk=25.108051300048828GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:25:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:25:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:25:56 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Applying migration context for instance 8ebc48e0-0a24-4421-b180-f14eacc636ad as it has an incoming, in-progress migration 8f3f7164-14dc-4325-8d9b-bc821bb58ccd. Migration status is finished {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 14 18:25:56 user nova-compute[73078]: INFO nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Updating resource usage from migration 8f3f7164-14dc-4325-8d9b-bc821bb58ccd
Aug 14 18:25:56 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance de80e188-9385-4613-8a6c-aa72b624ad55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:25:56 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 1f88cb97-4f22-439e-99f2-d7cb8d5aff36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:25:56 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 3c840309-9884-4c8a-a6ee-1acd44f32c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:25:56 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance a99aa211-c2a1-4240-90cc-2df068d4f669 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:25:56 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 61dfe42b-c943-4617-bf8e-745eaf1a1bb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:25:56 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 3088da30-65b7-4801-b425-93df4fca6ad8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:25:56 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Migration 8f3f7164-14dc-4325-8d9b-bc821bb58ccd is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 14 18:25:56 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 8ebc48e0-0a24-4421-b180-f14eacc636ad actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:25:56 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 16abee43-684b-415f-9c77-476ffb7283e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:25:56 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance ef083dd3-67d6-48a8-846a-7fe6c6b32d5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:25:56 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:25:56 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:25:56 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:25:56 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:25:56 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:25:56 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:25:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.477s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:25:57 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:25:57 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:25:57 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:25:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-1f88cb97-4f22-439e-99f2-d7cb8d5aff36" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:25:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-1f88cb97-4f22-439e-99f2-d7cb8d5aff36" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:25:57 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:25:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:25:58 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Updating instance_info_cache with network_info: [{"id": "8df77a26-faab-47ca-a39b-3df6930cd1d5", "address": "fa:16:3e:2d:25:52", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df77a26-fa", "ovs_interfaceid": "8df77a26-faab-47ca-a39b-3df6930cd1d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:25:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-1f88cb97-4f22-439e-99f2-d7cb8d5aff36" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:25:58 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:25:58 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:25:58 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:25:58 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:25:58 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:25:58 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:25:58 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:25:59 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:25:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:07 user nova-compute[73078]: INFO nova.compute.manager [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Rescuing
Aug 14 18:26:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "refresh_cache-3088da30-65b7-4801-b425-93df4fca6ad8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:26:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquired lock "refresh_cache-3088da30-65b7-4801-b425-93df4fca6ad8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:26:07 user nova-compute[73078]: DEBUG nova.network.neutron [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:26:08 user nova-compute[73078]: DEBUG nova.network.neutron [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Updating instance_info_cache with network_info: [{"id": "52e93284-9b32-4191-8f06-ab9c4497579c", "address": "fa:16:3e:ec:04:07", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e93284-9b", "ovs_interfaceid": "52e93284-9b32-4191-8f06-ab9c4497579c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:26:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Releasing lock "refresh_cache-3088da30-65b7-4801-b425-93df4fca6ad8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:26:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:08 user nova-compute[73078]: DEBUG nova.compute.manager [req-dde04857-a08c-42d2-9dd8-44bd45ef5036 req-04df685d-4c96-4771-acdb-171be30d647f service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Received event network-vif-unplugged-52e93284-9b32-4191-8f06-ab9c4497579c {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:26:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-dde04857-a08c-42d2-9dd8-44bd45ef5036 req-04df685d-4c96-4771-acdb-171be30d647f service nova] Acquiring lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:26:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-dde04857-a08c-42d2-9dd8-44bd45ef5036 req-04df685d-4c96-4771-acdb-171be30d647f service nova] Lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:26:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-dde04857-a08c-42d2-9dd8-44bd45ef5036 req-04df685d-4c96-4771-acdb-171be30d647f service nova] Lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:26:08 user nova-compute[73078]: DEBUG nova.compute.manager [req-dde04857-a08c-42d2-9dd8-44bd45ef5036 req-04df685d-4c96-4771-acdb-171be30d647f service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] No waiting events found dispatching network-vif-unplugged-52e93284-9b32-4191-8f06-ab9c4497579c {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:26:08 user nova-compute[73078]: WARNING nova.compute.manager [req-dde04857-a08c-42d2-9dd8-44bd45ef5036 req-04df685d-4c96-4771-acdb-171be30d647f service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Received unexpected event network-vif-unplugged-52e93284-9b32-4191-8f06-ab9c4497579c for instance with vm_state active and task_state rescuing.
Aug 14 18:26:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:09 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Instance destroyed successfully.
Aug 14 18:26:09 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Attempting a stable device rescue
Aug 14 18:26:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73078) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 18:26:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Instance directory exists: not creating {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 18:26:09 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Creating image(s)
Aug 14 18:26:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "/opt/stack/data/nova/instances/3088da30-65b7-4801-b425-93df4fca6ad8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:26:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "/opt/stack/data/nova/instances/3088da30-65b7-4801-b425-93df4fca6ad8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:26:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "/opt/stack/data/nova/instances/3088da30-65b7-4801-b425-93df4fca6ad8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:26:09 user nova-compute[73078]: DEBUG nova.objects.instance [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3088da30-65b7-4801-b425-93df4fca6ad8 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:26:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "16282be22f542c7126797c3e95ff4ffc4ca522b2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:26:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "16282be22f542c7126797c3e95ff4ffc4ca522b2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:26:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16282be22f542c7126797c3e95ff4ffc4ca522b2.part --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16282be22f542c7126797c3e95ff4ffc4ca522b2.part --force-share --output=json" returned: 0 in 0.189s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:10 user nova-compute[73078]: DEBUG nova.virt.images [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] 23accc1d-75da-43e9-b76c-1df48c0f70a2 was qcow2, converting to raw {{(pid=73078) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 18:26:10 user nova-compute[73078]: DEBUG nova.privsep.utils [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73078) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 18:26:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/16282be22f542c7126797c3e95ff4ffc4ca522b2.part /opt/stack/data/nova/instances/_base/16282be22f542c7126797c3e95ff4ffc4ca522b2.converted {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/16282be22f542c7126797c3e95ff4ffc4ca522b2.part /opt/stack/data/nova/instances/_base/16282be22f542c7126797c3e95ff4ffc4ca522b2.converted" returned: 0 in 0.170s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16282be22f542c7126797c3e95ff4ffc4ca522b2.converted --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:10 user nova-compute[73078]: DEBUG nova.compute.manager [req-b903ba68-4f0b-48c9-a138-8605af4d5944 req-0086b0f3-a658-41d3-9030-ae203c7649c4 service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Received event network-vif-plugged-52e93284-9b32-4191-8f06-ab9c4497579c {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:26:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b903ba68-4f0b-48c9-a138-8605af4d5944 req-0086b0f3-a658-41d3-9030-ae203c7649c4 service nova] Acquiring lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:26:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b903ba68-4f0b-48c9-a138-8605af4d5944 req-0086b0f3-a658-41d3-9030-ae203c7649c4 service nova] Lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:26:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b903ba68-4f0b-48c9-a138-8605af4d5944 req-0086b0f3-a658-41d3-9030-ae203c7649c4 service nova] Lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:26:10 user nova-compute[73078]: DEBUG nova.compute.manager [req-b903ba68-4f0b-48c9-a138-8605af4d5944 req-0086b0f3-a658-41d3-9030-ae203c7649c4 service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] No waiting events found dispatching network-vif-plugged-52e93284-9b32-4191-8f06-ab9c4497579c {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:26:10 user nova-compute[73078]: WARNING nova.compute.manager [req-b903ba68-4f0b-48c9-a138-8605af4d5944 req-0086b0f3-a658-41d3-9030-ae203c7649c4 service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Received unexpected event network-vif-plugged-52e93284-9b32-4191-8f06-ab9c4497579c for instance with vm_state active and task_state rescuing.
Aug 14 18:26:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16282be22f542c7126797c3e95ff4ffc4ca522b2.converted --force-share --output=json" returned: 0 in 0.192s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "16282be22f542c7126797c3e95ff4ffc4ca522b2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.600s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:26:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "16282be22f542c7126797c3e95ff4ffc4ca522b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:26:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "16282be22f542c7126797c3e95ff4ffc4ca522b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:26:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16282be22f542c7126797c3e95ff4ffc4ca522b2 --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16282be22f542c7126797c3e95ff4ffc4ca522b2 --force-share --output=json" returned: 0 in 0.179s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16282be22f542c7126797c3e95ff4ffc4ca522b2,backing_fmt=raw /opt/stack/data/nova/instances/3088da30-65b7-4801-b425-93df4fca6ad8/disk.rescue {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16282be22f542c7126797c3e95ff4ffc4ca522b2,backing_fmt=raw /opt/stack/data/nova/instances/3088da30-65b7-4801-b425-93df4fca6ad8/disk.rescue" returned: 0 in 0.049s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "16282be22f542c7126797c3e95ff4ffc4ca522b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG nova.objects.instance [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lazy-loading 'migration_context' on Instance uuid 3088da30-65b7-4801-b425-93df4fca6ad8 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Start _get_guest_xml network_info=[{"id": "52e93284-9b32-4191-8f06-ab9c4497579c", "address": "fa:16:3e:ec:04:07", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "vif_mac": "fa:16:3e:ec:04:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e93284-9b", "ovs_interfaceid": "52e93284-9b32-4191-8f06-ab9c4497579c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '23accc1d-75da-43e9-b76c-1df48c0f70a2', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '4a21871e-a2a2-4aab-b66d-b87dcb8711c3', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rVZtSKwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '3088da30-65b7-4801-b425-93df4fca6ad8', 'attached_at': '', 'detached_at': '', 'volume_id': '5c2186e7-99c9-4655-b4a6-ca20280ec7eb', 'serial': '5c2186e7-99c9-4655-b4a6-ca20280ec7eb'}, 'volume_type': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG nova.objects.instance [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lazy-loading 'resources' on Instance uuid 3088da30-65b7-4801-b425-93df4fca6ad8 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG nova.objects.instance [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lazy-loading 'numa_topology' on Instance uuid 3088da30-65b7-4801-b425-93df4fca6ad8 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:26:11 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:26:11 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:26:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG nova.objects.instance [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3088da30-65b7-4801-b425-93df4fca6ad8 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rVZtSKwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:26:11 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:26:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:26:11 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:26:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:26:11 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:26:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2defd87f-c608-41b7-92df-67a031439c76]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = rVZtSKwf\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 14 18:26:11 user nova-compute[73078]: node.name = iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb
Aug 14 18:26:11 user nova-compute[73078]: node.tpgt = -1
Aug 14 18:26:11 user nova-compute[73078]: node.startup = automatic
Aug 14 18:26:11 user nova-compute[73078]: node.leading_login = No
Aug 14 18:26:11 user nova-compute[73078]: iface.iscsi_ifacename = default
Aug 14 18:26:11 user nova-compute[73078]: iface.net_ifacename = <empty>
Aug 14 18:26:11 user nova-compute[73078]: iface.ipaddress = <empty>
Aug 14 18:26:11 user nova-compute[73078]: iface.prefix_len = 0
Aug 14 18:26:11 user nova-compute[73078]: iface.hwaddress = <empty>
Aug 14 18:26:11 user nova-compute[73078]: iface.transport_name = tcp
Aug 14 18:26:11 user nova-compute[73078]: iface.initiatorname = <empty>
Aug 14 18:26:11 user nova-compute[73078]: iface.state = <empty>
Aug 14 18:26:11 user nova-compute[73078]: iface.vlan_id = 0
Aug 14 18:26:11 user nova-compute[73078]: iface.vlan_priority = 0
Aug 14 18:26:11 user nova-compute[73078]: iface.vlan_state = <empty>
Aug 14 18:26:11 user nova-compute[73078]: iface.iface_num = 0
Aug 14 18:26:11 user nova-compute[73078]: iface.mtu = 0
Aug 14 18:26:11 user nova-compute[73078]: iface.port = 0
Aug 14 18:26:11 user nova-compute[73078]: iface.bootproto = <empty>
Aug 14 18:26:11 user nova-compute[73078]: iface.subnet_mask = <empty>
Aug 14 18:26:11 user nova-compute[73078]: iface.gateway = <empty>
Aug 14 18:26:11 user nova-compute[73078]: iface.dhcp_alt_client_id_state = <empty>
Aug 14 18:26:11 user nova-compute[73078]: iface.dhcp_alt_client_id = <empty>
Aug 14 18:26:11 user nova-compute[73078]: iface.dhcp_dns = <empty>
Aug 14 18:26:11 user nova-compute[73078]: iface.dhcp_learn_iqn = <empty>
Aug 14 18:26:11 user nova-compute[73078]: iface.dhcp_req_vendor_id_state = <empty>
Aug 14 18:26:11 user nova-compute[73078]: iface.dhcp_vendor_id_state = <empty>
Aug 14 18:26:11 user nova-compute[73078]: iface.dhcp_vendor_id = <empty>
Aug 14 18:26:11 user nova-compute[73078]: iface.dhcp_slp_da = <empty>
Aug 14 18:26:11 user nova-compute[73078]: iface.fragmentation = <empty>
Aug 14 18:26:11 user nova-compute[73078]: iface.gratuitous_arp = <empty>
Aug 14 18:26:11 user nova-compute[73078]: iface.incoming_forwarding = <empty>
Aug 14 18:26:11 user nova-compute[73078]: iface.tos_state = <empty>
Aug 14 18:26:11 user nova-compute[73078]: iface.tos = 0
Aug 14 18:26:11 user nova-compute[73078]: iface.ttl = 0
Aug 14 18:26:11 user nova-compute[73078]: iface.delayed_ack = <empty>
Aug 14 18:26:11 user nova-compute[73078]: iface.tcp_nagle = <empty>
Aug 14 18:26:11 user nova-compute[73078]: iface.tcp_wsf_state = <empty>
Aug 14 18:26:11 user nova-compute[73078]: iface.tcp_wsf = 0
Aug 14 18:26:11 user nova-compute[73078]: iface.tcp_timer_scale = 0
Aug 14 18:26:11 user nova-compute[73078]: iface.tcp_timestamp = <empty>
Aug 14 18:26:11 user nova-compute[73078]: iface.redirect = <empty>
Aug 14 18:26:11 user nova-compute[73078]: iface.def_task_mgmt_timeout = 0
Aug 14 18:26:11 user nova-compute[73078]: iface.header_digest = <empty>
Aug 14 18:26:11 user nova-compute[73078]: iface.data_digest = <empty>
Aug 14 18:26:11 user nova-compute[73078]: iface.immediate_data = <empty>
Aug 14 18:26:11 user nova-compute[73078]: iface.initial_r2t = <empty>
Aug 14 18:26:11 user nova-compute[73078]: iface.data_seq_inorder = <empty>
Aug 14 18:26:11 user nova-compute[73078]: iface.data_pdu_inorder = <empty>
Aug 14 18:26:11 user nova-compute[73078]: iface.erl = 0
Aug 14 18:26:11 user nova-compute[73078]: iface.max_receive_data_len = 0
Aug 14 18:26:11 user nova-compute[73078]: iface.first_burst_len = 0
Aug 14 18:26:11 user nova-compute[73078]: iface.max_outstanding_r2t = 0
Aug 14 18:26:11 user nova-compute[73078]: iface.max_burst_len = 0
Aug 14 18:26:11 user nova-compute[73078]: iface.chap_auth = <empty>
Aug 14 18:26:11 user nova-compute[73078]: iface.bidi_chap = <empty>
Aug 14 18:26:11 user nova-compute[73078]: iface.strict_login_compliance = <empty>
Aug 14 18:26:11 user nova-compute[73078]: iface.discovery_auth = <empty>
Aug 14 18:26:11 user nova-compute[73078]: iface.discovery_logout = <empty>
Aug 14 18:26:11 user nova-compute[73078]: node.discovery_address = <empty>
Aug 14 18:26:11 user nova-compute[73078]: node.discovery_port = 0
Aug 14 18:26:11 user nova-compute[73078]: node.discovery_type = static
Aug 14 18:26:11 user nova-compute[73078]: node.session.initial_cmdsn = 0
Aug 14 18:26:11 user nova-compute[73078]: node.session.initial_login_retry_max = 8
Aug 14 18:26:11 user nova-compute[73078]: node.session.xmit_thread_priority = -20
Aug 14 18:26:11 user nova-compute[73078]: node.session.cmds_max = 128
Aug 14 18:26:11 user nova-compute[73078]: node.session.queue_depth = 32
Aug 14 18:26:11 user nova-compute[73078]: node.session.nr_sessions = 1
Aug 14 18:26:11 user nova-compute[73078]: node.session.auth.authmethod = CHAP
Aug 14 18:26:11 user nova-compute[73078]: node.session.auth.username = rVZtSKwf
Aug 14 18:26:11 user nova-compute[73078]: node.session.auth.password = ***
Aug 14 18:26:11 user nova-compute[73078]: node.session.auth.username_in = <empty>
Aug 14 18:26:11 user nova-compute[73078]: node.session.auth.password_in = <empty>
Aug 14 18:26:11 user nova-compute[73078]: node.session.auth.chap_algs = MD5
Aug 14 18:26:11 user nova-compute[73078]: node.session.timeo.replacement_timeout = 120
Aug 14 18:26:11 user nova-compute[73078]: node.session.err_timeo.abort_timeout = 15
Aug 14 18:26:11 user nova-compute[73078]: node.session.err_timeo.lu_reset_timeout = 30
Aug 14 18:26:11 user nova-compute[73078]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 14 18:26:11 user nova-compute[73078]: node.session.err_timeo.host_reset_timeout = 60
Aug 14 18:26:11 user nova-compute[73078]: node.session.iscsi.FastAbort = Yes
Aug 14 18:26:11 user nova-compute[73078]: node.session.iscsi.InitialR2T = No
Aug 14 18:26:11 user nova-compute[73078]: node.session.iscsi.ImmediateData = Yes
Aug 14 18:26:11 user nova-compute[73078]: node.session.iscsi.FirstBurstLength = 262144
Aug 14 18:26:11 user nova-compute[73078]: node.session.iscsi.MaxBurstLength = 16776192
Aug 14 18:26:11 user nova-compute[73078]: node.session.iscsi.DefaultTime2Retain = 0
Aug 14 18:26:11 user nova-compute[73078]: node.session.iscsi.DefaultTime2Wait = 2
Aug 14 18:26:11 user nova-compute[73078]: node.session.iscsi.MaxConnections = 1
Aug 14 18:26:11 user nova-compute[73078]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 14 18:26:11 user nova-compute[73078]: node.session.iscsi.ERL = 0
Aug 14 18:26:11 user nova-compute[73078]: node.session.scan = manual
Aug 14 18:26:11 user nova-compute[73078]: node.session.reopen_max = 0
Aug 14 18:26:11 user nova-compute[73078]: node.conn[0].address = 172.16.0.220
Aug 14 18:26:11 user nova-compute[73078]: node.conn[0].port = 3260
Aug 14 18:26:11 user nova-compute[73078]: node.conn[0].startup = manual
Aug 14 18:26:11 user nova-compute[73078]: node.conn[0].tcp.window_size = 524288
Aug 14 18:26:11 user nova-compute[73078]: node.conn[0].tcp.type_of_service = 0
Aug 14 18:26:11 user nova-compute[73078]: node.conn[0].timeo.logout_timeout = 15
Aug 14 18:26:11 user nova-compute[73078]: node.conn[0].timeo.login_timeout = 15
Aug 14 18:26:11 user nova-compute[73078]: node.conn[0].timeo.auth_timeout = 45
Aug 14 18:26:11 user nova-compute[73078]: node.conn[0].timeo.noop_out_interval = 5
Aug 14 18:26:11 user nova-compute[73078]: node.conn[0].timeo.noop_out_timeout = 5
Aug 14 18:26:11 user nova-compute[73078]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 14 18:26:11 user nova-compute[73078]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 14 18:26:11 user nova-compute[73078]: node.conn[0].iscsi.HeaderDigest = None
Aug 14 18:26:11 user nova-compute[73078]: node.conn[0].iscsi.DataDigest = None
Aug 14 18:26:11 user nova-compute[73078]: node.conn[0].iscsi.IFMarker = No
Aug 14 18:26:11 user nova-compute[73078]: node.conn[0].iscsi.OFMarker = No
Aug 14 18:26:11 user nova-compute[73078]: # END RECORD
Aug 14 18:26:11 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f389193a-3b8c-455f-b6e9-78add7a0fabc]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4679409f-b37c-48d6-aefb-846ad0eec536]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rVZtSKwf {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rVZtSKwf" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad17e35-f162-4960-a73f-b4ba17671a58]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rVZtSKwf'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5a411b-a9d7-4fa8-8a5c-444dc86ab3d6]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b997a90-aba6-4eef-be7e-bde33e73ade9]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d6e03a4-7999-4959-a341-58cde94b63e2 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:26:11 user nova-compute[73078]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:26:11 user nova-compute[73078]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d6e03a4-7999-4959-a341-58cde94b63e2 (non-flash)
Aug 14 18:26:11 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:26:11 user nova-compute[73078]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:26:11 user nova-compute[73078]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d6e03a4-7999-4959-a341-58cde94b63e2 (non-flash)
Aug 14 18:26:11 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.151s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] HCTL ('33', '0', '0', 0) found on session 37 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a3c109-0d0b-44be-b967-65fb8a7a5ce7]: (4, ('0 0 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Searching for a device in session 37 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rVZtSKwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.175s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] <== connect_volume: return (177ms) {'type': 'block', 'scsi_wwn': '23863663435396465', 'path': '/dev/sdb'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863663435396465', 'path': '/dev/sdb'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:24:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1775384835',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1775384835',id=31,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:24:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16e938ed650845d0a64b49273c9f6287',ramdisk_id='',reservation_id='r-ac9ip7h8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1267883434',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:24:41Z,user_data=None,user_id='0bff079d90d942bb8ab3ba53fb007125',uuid=3088da30-65b7-4801-b425-93df4fca6ad8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52e93284-9b32-4191-8f06-ab9c4497579c", "address": "fa:16:3e:ec:04:07", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "vif_mac": "fa:16:3e:ec:04:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e93284-9b", "ovs_interfaceid": "52e93284-9b32-4191-8f06-ab9c4497579c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Converting VIF {"id": "52e93284-9b32-4191-8f06-ab9c4497579c", "address": "fa:16:3e:ec:04:07", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "vif_mac": "fa:16:3e:ec:04:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e93284-9b", "ovs_interfaceid": "52e93284-9b32-4191-8f06-ab9c4497579c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:04:07,bridge_name='br-int',has_traffic_filtering=True,id=52e93284-9b32-4191-8f06-ab9c4497579c,network=Network(98a29135-c5de-46a6-a2bf-46c90b4e255b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e93284-9b') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG nova.objects.instance [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lazy-loading 'pci_devices' on Instance uuid 3088da30-65b7-4801-b425-93df4fca6ad8 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:26:11 user nova-compute[73078]:   <uuid>3088da30-65b7-4801-b425-93df4fca6ad8</uuid>
Aug 14 18:26:11 user nova-compute[73078]:   <name>instance-0000001f</name>
Aug 14 18:26:11 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:26:11 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:26:11 user nova-compute[73078]:   <metadata>
Aug 14 18:26:11 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:26:11 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:26:11 user nova-compute[73078]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1775384835</nova:name>
Aug 14 18:26:11 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:26:11</nova:creationTime>
Aug 14 18:26:11 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:26:11 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:26:11 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:26:11 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:26:11 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:26:11 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:26:11 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:26:11 user nova-compute[73078]:       <nova:owner>
Aug 14 18:26:11 user nova-compute[73078]:         <nova:user uuid="0bff079d90d942bb8ab3ba53fb007125">tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member</nova:user>
Aug 14 18:26:11 user nova-compute[73078]:         <nova:project uuid="16e938ed650845d0a64b49273c9f6287">tempest-ServerBootFromVolumeStableRescueTest-1267883434</nova:project>
Aug 14 18:26:11 user nova-compute[73078]:       </nova:owner>
Aug 14 18:26:11 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:26:11 user nova-compute[73078]:       <nova:ports>
Aug 14 18:26:11 user nova-compute[73078]:         <nova:port uuid="52e93284-9b32-4191-8f06-ab9c4497579c">
Aug 14 18:26:11 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 18:26:11 user nova-compute[73078]:         </nova:port>
Aug 14 18:26:11 user nova-compute[73078]:       </nova:ports>
Aug 14 18:26:11 user nova-compute[73078]:     </nova:instance>
Aug 14 18:26:11 user nova-compute[73078]:   </metadata>
Aug 14 18:26:11 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:26:11 user nova-compute[73078]:     <system>
Aug 14 18:26:11 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:26:11 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:26:11 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:26:11 user nova-compute[73078]:       <entry name="serial">3088da30-65b7-4801-b425-93df4fca6ad8</entry>
Aug 14 18:26:11 user nova-compute[73078]:       <entry name="uuid">3088da30-65b7-4801-b425-93df4fca6ad8</entry>
Aug 14 18:26:11 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:26:11 user nova-compute[73078]:     </system>
Aug 14 18:26:11 user nova-compute[73078]:   </sysinfo>
Aug 14 18:26:11 user nova-compute[73078]:   <os>
Aug 14 18:26:11 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:26:11 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:26:11 user nova-compute[73078]:   </os>
Aug 14 18:26:11 user nova-compute[73078]:   <features>
Aug 14 18:26:11 user nova-compute[73078]:     <acpi/>
Aug 14 18:26:11 user nova-compute[73078]:     <apic/>
Aug 14 18:26:11 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:26:11 user nova-compute[73078]:   </features>
Aug 14 18:26:11 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:26:11 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:26:11 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:26:11 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:26:11 user nova-compute[73078]:   </clock>
Aug 14 18:26:11 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:26:11 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:26:11 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:26:11 user nova-compute[73078]:   </cpu>
Aug 14 18:26:11 user nova-compute[73078]:   <devices>
Aug 14 18:26:11 user nova-compute[73078]:     <disk type="block" device="disk">
Aug 14 18:26:11 user nova-compute[73078]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:26:11 user nova-compute[73078]:       <source dev="/dev/sdb"/>
Aug 14 18:26:11 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:26:11 user nova-compute[73078]:       <serial>5c2186e7-99c9-4655-b4a6-ca20280ec7eb</serial>
Aug 14 18:26:11 user nova-compute[73078]:     </disk>
Aug 14 18:26:11 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:26:11 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:26:11 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/3088da30-65b7-4801-b425-93df4fca6ad8/disk.rescue"/>
Aug 14 18:26:11 user nova-compute[73078]:       <target dev="vdb" bus="virtio"/>
Aug 14 18:26:11 user nova-compute[73078]:       <boot order="1"/>
Aug 14 18:26:11 user nova-compute[73078]:     </disk>
Aug 14 18:26:11 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:26:11 user nova-compute[73078]:       <mac address="fa:16:3e:ec:04:07"/>
Aug 14 18:26:11 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:26:11 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:26:11 user nova-compute[73078]:       <target dev="tap52e93284-9b"/>
Aug 14 18:26:11 user nova-compute[73078]:     </interface>
Aug 14 18:26:11 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:26:11 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/3088da30-65b7-4801-b425-93df4fca6ad8/console.log" append="off"/>
Aug 14 18:26:11 user nova-compute[73078]:     </serial>
Aug 14 18:26:11 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:26:11 user nova-compute[73078]:     <video>
Aug 14 18:26:11 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:26:11 user nova-compute[73078]:     </video>
Aug 14 18:26:11 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:26:11 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:26:11 user nova-compute[73078]:     </rng>
Aug 14 18:26:11 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:26:11 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:26:11 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:26:11 user nova-compute[73078]:     </memballoon>
Aug 14 18:26:11 user nova-compute[73078]:   </devices>
Aug 14 18:26:11 user nova-compute[73078]: </domain>
Aug 14 18:26:11 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:26:11 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Instance destroyed successfully.
Aug 14 18:26:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-1a99233f-34bb-4974-a2bf-875f485569cd tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "a99aa211-c2a1-4240-90cc-2df068d4f669" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-1a99233f-34bb-4974-a2bf-875f485569cd tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "a99aa211-c2a1-4240-90cc-2df068d4f669" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-1a99233f-34bb-4974-a2bf-875f485569cd tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-1a99233f-34bb-4974-a2bf-875f485569cd tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-1a99233f-34bb-4974-a2bf-875f485569cd tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:26:11 user nova-compute[73078]: INFO nova.compute.manager [None req-1a99233f-34bb-4974-a2bf-875f485569cd tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Terminating instance
Aug 14 18:26:11 user nova-compute[73078]: DEBUG nova.compute.manager [None req-1a99233f-34bb-4974-a2bf-875f485569cd tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] No VIF found with MAC fa:16:3e:ec:04:07, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG nova.compute.manager [req-849ea1ae-1e06-4aba-9495-50ffdfa8060e req-fd802d0a-ac98-4d02-945a-f565942ce421 service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Received event network-vif-unplugged-5262c4ac-db58-4c3d-9546-7252ee76c730 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-849ea1ae-1e06-4aba-9495-50ffdfa8060e req-fd802d0a-ac98-4d02-945a-f565942ce421 service nova] Acquiring lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-849ea1ae-1e06-4aba-9495-50ffdfa8060e req-fd802d0a-ac98-4d02-945a-f565942ce421 service nova] Lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-849ea1ae-1e06-4aba-9495-50ffdfa8060e req-fd802d0a-ac98-4d02-945a-f565942ce421 service nova] Lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG nova.compute.manager [req-849ea1ae-1e06-4aba-9495-50ffdfa8060e req-fd802d0a-ac98-4d02-945a-f565942ce421 service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] No waiting events found dispatching network-vif-unplugged-5262c4ac-db58-4c3d-9546-7252ee76c730 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG nova.compute.manager [req-849ea1ae-1e06-4aba-9495-50ffdfa8060e req-fd802d0a-ac98-4d02-945a-f565942ce421 service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Received event network-vif-unplugged-5262c4ac-db58-4c3d-9546-7252ee76c730 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:12 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Instance destroyed successfully.
Aug 14 18:26:12 user nova-compute[73078]: DEBUG nova.objects.instance [None req-1a99233f-34bb-4974-a2bf-875f485569cd tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lazy-loading 'resources' on Instance uuid a99aa211-c2a1-4240-90cc-2df068d4f669 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:26:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-1a99233f-34bb-4974-a2bf-875f485569cd tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:19:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-391026567',display_name='tempest-ServerRescueNegativeTestJSON-server-391026567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-391026567',id=25,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWtpI0Guw6dmfBFh+LNsyjK/cmY45/WcllmcWyUt0PCxUIaiQz+xX3JbwPmvtFUfJzH0RmBBZEoBqMCiWdkUa7DqGP74ubN/fbpvYzVQHcC/SGLQJev3eWyf6MGKwsstA==',key_name='tempest-keypair-1566952768',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:21:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ec53c6018ee44b09ee31ba712a789aa',ramdisk_id='',reservation_id='r-2hs1fgeo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-38557121',owner_user_name='tempest-ServerRescueNegativeTestJSON-38557121-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:23:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d25ecea70e9e481e8a1957a94d79edfc',uuid=a99aa211-c2a1-4240-90cc-2df068d4f669,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5262c4ac-db58-4c3d-9546-7252ee76c730", "address": "fa:16:3e:e4:7f:9e", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5262c4ac-db", "ovs_interfaceid": "5262c4ac-db58-4c3d-9546-7252ee76c730", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:26:12 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-1a99233f-34bb-4974-a2bf-875f485569cd tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Converting VIF {"id": "5262c4ac-db58-4c3d-9546-7252ee76c730", "address": "fa:16:3e:e4:7f:9e", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5262c4ac-db", "ovs_interfaceid": "5262c4ac-db58-4c3d-9546-7252ee76c730", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:26:12 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-1a99233f-34bb-4974-a2bf-875f485569cd tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:7f:9e,bridge_name='br-int',has_traffic_filtering=True,id=5262c4ac-db58-4c3d-9546-7252ee76c730,network=Network(33518dc6-7963-4995-b4c7-86d60b44a22f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5262c4ac-db') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:26:12 user nova-compute[73078]: DEBUG os_vif [None req-1a99233f-34bb-4974-a2bf-875f485569cd tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:7f:9e,bridge_name='br-int',has_traffic_filtering=True,id=5262c4ac-db58-4c3d-9546-7252ee76c730,network=Network(33518dc6-7963-4995-b4c7-86d60b44a22f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5262c4ac-db') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:26:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5262c4ac-db, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:26:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:26:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:12 user nova-compute[73078]: INFO os_vif [None req-1a99233f-34bb-4974-a2bf-875f485569cd tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:7f:9e,bridge_name='br-int',has_traffic_filtering=True,id=5262c4ac-db58-4c3d-9546-7252ee76c730,network=Network(33518dc6-7963-4995-b4c7-86d60b44a22f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5262c4ac-db')
Aug 14 18:26:12 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-1a99233f-34bb-4974-a2bf-875f485569cd tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Deleting instance files /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669_del
Aug 14 18:26:12 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-1a99233f-34bb-4974-a2bf-875f485569cd tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Deletion of /opt/stack/data/nova/instances/a99aa211-c2a1-4240-90cc-2df068d4f669_del complete
Aug 14 18:26:12 user nova-compute[73078]: INFO nova.compute.manager [None req-1a99233f-34bb-4974-a2bf-875f485569cd tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Took 1.47 seconds to destroy the instance on the hypervisor.
Aug 14 18:26:12 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-1a99233f-34bb-4974-a2bf-875f485569cd tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:26:12 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:26:12 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:26:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:13 user nova-compute[73078]: DEBUG nova.compute.manager [req-f4bf0f79-59d2-4cb9-a1fb-3701d520cdde req-0149b938-3146-47c8-be12-2b791e96f82a service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Received event network-vif-plugged-52e93284-9b32-4191-8f06-ab9c4497579c {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:26:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-f4bf0f79-59d2-4cb9-a1fb-3701d520cdde req-0149b938-3146-47c8-be12-2b791e96f82a service nova] Acquiring lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:26:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-f4bf0f79-59d2-4cb9-a1fb-3701d520cdde req-0149b938-3146-47c8-be12-2b791e96f82a service nova] Lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:26:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-f4bf0f79-59d2-4cb9-a1fb-3701d520cdde req-0149b938-3146-47c8-be12-2b791e96f82a service nova] Lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:26:13 user nova-compute[73078]: DEBUG nova.compute.manager [req-f4bf0f79-59d2-4cb9-a1fb-3701d520cdde req-0149b938-3146-47c8-be12-2b791e96f82a service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] No waiting events found dispatching network-vif-plugged-52e93284-9b32-4191-8f06-ab9c4497579c {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:26:13 user nova-compute[73078]: WARNING nova.compute.manager [req-f4bf0f79-59d2-4cb9-a1fb-3701d520cdde req-0149b938-3146-47c8-be12-2b791e96f82a service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Received unexpected event network-vif-plugged-52e93284-9b32-4191-8f06-ab9c4497579c for instance with vm_state active and task_state rescuing.
Aug 14 18:26:13 user nova-compute[73078]: DEBUG nova.compute.manager [req-075914c2-b58f-4fd3-b0e6-3f5ddb95cb47 req-7c2a0ff9-d134-43c5-a61c-2d19bc820950 service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Received event network-vif-plugged-5262c4ac-db58-4c3d-9546-7252ee76c730 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:26:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-075914c2-b58f-4fd3-b0e6-3f5ddb95cb47 req-7c2a0ff9-d134-43c5-a61c-2d19bc820950 service nova] Acquiring lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:26:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-075914c2-b58f-4fd3-b0e6-3f5ddb95cb47 req-7c2a0ff9-d134-43c5-a61c-2d19bc820950 service nova] Lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:26:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-075914c2-b58f-4fd3-b0e6-3f5ddb95cb47 req-7c2a0ff9-d134-43c5-a61c-2d19bc820950 service nova] Lock "a99aa211-c2a1-4240-90cc-2df068d4f669-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:26:13 user nova-compute[73078]: DEBUG nova.compute.manager [req-075914c2-b58f-4fd3-b0e6-3f5ddb95cb47 req-7c2a0ff9-d134-43c5-a61c-2d19bc820950 service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] No waiting events found dispatching network-vif-plugged-5262c4ac-db58-4c3d-9546-7252ee76c730 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:26:13 user nova-compute[73078]: WARNING nova.compute.manager [req-075914c2-b58f-4fd3-b0e6-3f5ddb95cb47 req-7c2a0ff9-d134-43c5-a61c-2d19bc820950 service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Received unexpected event network-vif-plugged-5262c4ac-db58-4c3d-9546-7252ee76c730 for instance with vm_state active and task_state deleting.
Aug 14 18:26:14 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:26:14 user nova-compute[73078]: DEBUG nova.compute.manager [req-a8f39657-6fde-4136-b8d7-1b3a6fab04ef req-827d009b-6575-4e6b-9a10-b086782c06ec service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Received event network-vif-deleted-5262c4ac-db58-4c3d-9546-7252ee76c730 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:26:14 user nova-compute[73078]: INFO nova.compute.manager [req-a8f39657-6fde-4136-b8d7-1b3a6fab04ef req-827d009b-6575-4e6b-9a10-b086782c06ec service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Neutron deleted interface 5262c4ac-db58-4c3d-9546-7252ee76c730; detaching it from the instance and deleting it from the info cache
Aug 14 18:26:14 user nova-compute[73078]: DEBUG nova.network.neutron [req-a8f39657-6fde-4136-b8d7-1b3a6fab04ef req-827d009b-6575-4e6b-9a10-b086782c06ec service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:26:14 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Took 1.28 seconds to deallocate network for instance.
Aug 14 18:26:14 user nova-compute[73078]: DEBUG nova.compute.manager [req-a8f39657-6fde-4136-b8d7-1b3a6fab04ef req-827d009b-6575-4e6b-9a10-b086782c06ec service nova] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Detach interface failed, port_id=5262c4ac-db58-4c3d-9546-7252ee76c730, reason: Instance a99aa211-c2a1-4240-90cc-2df068d4f669 could not be found. {{(pid=73078) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 18:26:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-1a99233f-34bb-4974-a2bf-875f485569cd tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:26:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-1a99233f-34bb-4974-a2bf-875f485569cd tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:26:15 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-1a99233f-34bb-4974-a2bf-875f485569cd tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:26:15 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-1a99233f-34bb-4974-a2bf-875f485569cd tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:26:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-1a99233f-34bb-4974-a2bf-875f485569cd tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.483s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:26:15 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-1a99233f-34bb-4974-a2bf-875f485569cd tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Deleted allocations for instance a99aa211-c2a1-4240-90cc-2df068d4f669
Aug 14 18:26:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-1a99233f-34bb-4974-a2bf-875f485569cd tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "a99aa211-c2a1-4240-90cc-2df068d4f669" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.709s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:26:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Removed pending event for 3088da30-65b7-4801-b425-93df4fca6ad8 due to event {{(pid=73078) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 18:26:15 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037575.7368627, 3088da30-65b7-4801-b425-93df4fca6ad8 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:26:15 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] VM Resumed (Lifecycle Event)
Aug 14 18:26:15 user nova-compute[73078]: DEBUG nova.compute.manager [None req-55847be3-7252-48e5-afdc-5ea52c84b528 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:26:15 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:26:15 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:26:15 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 18:26:15 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037575.7466033, 3088da30-65b7-4801-b425-93df4fca6ad8 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:26:15 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] VM Started (Lifecycle Event)
Aug 14 18:26:15 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:26:15 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:26:15 user nova-compute[73078]: DEBUG nova.compute.manager [req-ea1c320f-a92d-4c96-8848-48c8b6488b0a req-a06bad88-1d3b-4fb4-9d1b-2e8018bfa631 service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Received event network-vif-plugged-52e93284-9b32-4191-8f06-ab9c4497579c {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:26:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ea1c320f-a92d-4c96-8848-48c8b6488b0a req-a06bad88-1d3b-4fb4-9d1b-2e8018bfa631 service nova] Acquiring lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:26:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ea1c320f-a92d-4c96-8848-48c8b6488b0a req-a06bad88-1d3b-4fb4-9d1b-2e8018bfa631 service nova] Lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:26:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ea1c320f-a92d-4c96-8848-48c8b6488b0a req-a06bad88-1d3b-4fb4-9d1b-2e8018bfa631 service nova] Lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:26:15 user nova-compute[73078]: DEBUG nova.compute.manager [req-ea1c320f-a92d-4c96-8848-48c8b6488b0a req-a06bad88-1d3b-4fb4-9d1b-2e8018bfa631 service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] No waiting events found dispatching network-vif-plugged-52e93284-9b32-4191-8f06-ab9c4497579c {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:26:15 user nova-compute[73078]: WARNING nova.compute.manager [req-ea1c320f-a92d-4c96-8848-48c8b6488b0a req-a06bad88-1d3b-4fb4-9d1b-2e8018bfa631 service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Received unexpected event network-vif-plugged-52e93284-9b32-4191-8f06-ab9c4497579c for instance with vm_state active and task_state rescuing.
Aug 14 18:26:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-29e5274a-2b97-4692-a864-cd51d11bda15 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "8ebc48e0-0a24-4421-b180-f14eacc636ad" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:26:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-29e5274a-2b97-4692-a864-cd51d11bda15 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "8ebc48e0-0a24-4421-b180-f14eacc636ad" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:26:24 user nova-compute[73078]: DEBUG nova.compute.manager [None req-29e5274a-2b97-4692-a864-cd51d11bda15 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Going to confirm migration 2 {{(pid=73078) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 14 18:26:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-29e5274a-2b97-4692-a864-cd51d11bda15 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "refresh_cache-8ebc48e0-0a24-4421-b180-f14eacc636ad" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:26:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-29e5274a-2b97-4692-a864-cd51d11bda15 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquired lock "refresh_cache-8ebc48e0-0a24-4421-b180-f14eacc636ad" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:26:25 user nova-compute[73078]: DEBUG nova.network.neutron [None req-29e5274a-2b97-4692-a864-cd51d11bda15 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:26:25 user nova-compute[73078]: DEBUG nova.objects.instance [None req-29e5274a-2b97-4692-a864-cd51d11bda15 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lazy-loading 'info_cache' on Instance uuid 8ebc48e0-0a24-4421-b180-f14eacc636ad {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:26:25 user nova-compute[73078]: DEBUG nova.network.neutron [None req-29e5274a-2b97-4692-a864-cd51d11bda15 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Updating instance_info_cache with network_info: [{"id": "de400e10-3372-4eb4-b121-48ed70e471d3", "address": "fa:16:3e:9d:54:60", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde400e10-33", "ovs_interfaceid": "de400e10-3372-4eb4-b121-48ed70e471d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:26:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-29e5274a-2b97-4692-a864-cd51d11bda15 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Releasing lock "refresh_cache-8ebc48e0-0a24-4421-b180-f14eacc636ad" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:26:25 user nova-compute[73078]: DEBUG nova.objects.instance [None req-29e5274a-2b97-4692-a864-cd51d11bda15 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lazy-loading 'migration_context' on Instance uuid 8ebc48e0-0a24-4421-b180-f14eacc636ad {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:26:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-29e5274a-2b97-4692-a864-cd51d11bda15 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:26:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-29e5274a-2b97-4692-a864-cd51d11bda15 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:26:26 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-29e5274a-2b97-4692-a864-cd51d11bda15 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:26:26 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-29e5274a-2b97-4692-a864-cd51d11bda15 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:26:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-29e5274a-2b97-4692-a864-cd51d11bda15 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.368s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:26:26 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-29e5274a-2b97-4692-a864-cd51d11bda15 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Deleted allocation for migration 8f3f7164-14dc-4325-8d9b-bc821bb58ccd
Aug 14 18:26:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-29e5274a-2b97-4692-a864-cd51d11bda15 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "8ebc48e0-0a24-4421-b180-f14eacc636ad" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.685s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:26:27 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692037572.817471, a99aa211-c2a1-4240-90cc-2df068d4f669 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:26:27 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] VM Stopped (Lifecycle Event)
Aug 14 18:26:27 user nova-compute[73078]: DEBUG nova.compute.manager [None req-de69b07f-8d3c-43d5-a14b-7175f7716a64 None None] [instance: a99aa211-c2a1-4240-90cc-2df068d4f669] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:26:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:26:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:26:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:26:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:26:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "16abee43-684b-415f-9c77-476ffb7283e8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:26:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "16abee43-684b-415f-9c77-476ffb7283e8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:26:40 user nova-compute[73078]: DEBUG nova.objects.instance [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lazy-loading 'flavor' on Instance uuid 16abee43-684b-415f-9c77-476ffb7283e8 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:26:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "16abee43-684b-415f-9c77-476ffb7283e8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.097s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:26:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "16abee43-684b-415f-9c77-476ffb7283e8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:26:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "16abee43-684b-415f-9c77-476ffb7283e8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:26:40 user nova-compute[73078]: INFO nova.compute.manager [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Attaching volume 540ba89c-9cfa-4330-87cb-33348eb9968b to /dev/vdb
Aug 14 18:26:40 user nova-compute[73078]: DEBUG os_brick.utils [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:26:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17e58f7-c9de-40f2-bb01-83fa4715c6e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:26:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9f6410-3c7b-4b3b-a542-595f0cf67224]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:26:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c464a3-318b-48a3-9e64-c0a5b921c884]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:26:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0d6fe4-063e-4f1e-95d3-ca47b611b960]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:26:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:26:41 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:26:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:26:41 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:26:41 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d46408c-6ace-4caf-ad0c-565e74d4aec0]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:26:41 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:26:41 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:26:41 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:26:41 user nova-compute[73078]: DEBUG os_brick.utils [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:26:41 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Updating existing volume attachment record: 8b5f2086-8e01-4a04-aea6-3786b19fe07f {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:26:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:43 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LRjgnHBi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:26:50 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:26:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:26:50 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:26:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:26:50 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:26:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8799c64e-d212-4571-8333-d3ecf325e701]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:26:50 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2010ac-398b-4dc3-838e-b522c0ef5aea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b] added
Aug 14 18:26:50 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.054s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b51003-73e1-47d5-b0d4-541e9c150a98]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[390b9a35-b26b-4914-a863-3017e5f7bd07]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LRjgnHBi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LRjgnHBi" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af617ab-0289-4bba-9b08-53248a2c7ff0]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LRjgnHBi'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d040d791-2f6d-490e-a445-e70d4fa814f8]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b9102f-0fae-4ec1-bef3-c8b6f57b1eaa]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:26:50 user nova-compute[73078]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:26:50 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:26:50 user nova-compute[73078]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:26:50 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c596a1f1-cdfe-405e-8d9a-bc9cc316e5c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b, portal: 172.16.0.220,3260]
Aug 14 18:26:50 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b, portal: 172.16.0.220,3260] successful.
Aug 14 18:26:50 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a480f0c-dcea-4d10-8ca6-fe5316c5d9f7]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7612c6d8-8d92-461b-af15-5e6606841fcd]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:26:50 user nova-compute[73078]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:26:50 user nova-compute[73078]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b (non-flash)
Aug 14 18:26:50 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:26:50 user nova-compute[73078]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:26:50 user nova-compute[73078]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b (non-flash)
Aug 14 18:26:50 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[459c6c9d-f6d6-4b8e-b4f8-a5c863cb8c2f]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:26:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LRjgnHBi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:26:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:26:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '23664316539393664', 'path': '/dev/sdc'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:26:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664316539393664', 'path': '/dev/sdc'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:26:51 user nova-compute[73078]: DEBUG nova.objects.instance [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lazy-loading 'flavor' on Instance uuid 16abee43-684b-415f-9c77-476ffb7283e8 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:26:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 18:26:51 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:26:51 user nova-compute[73078]:   <source dev="/dev/sdc"/>
Aug 14 18:26:51 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:26:51 user nova-compute[73078]:   <serial>540ba89c-9cfa-4330-87cb-33348eb9968b</serial>
Aug 14 18:26:51 user nova-compute[73078]: </disk>
Aug 14 18:26:51 user nova-compute[73078]:  {{(pid=73078) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 18:26:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:26:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:26:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] No VIF found with MAC fa:16:3e:80:d9:0f, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:26:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-12fc8239-1c7c-453a-a8e1-6342120d3444 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "16abee43-684b-415f-9c77-476ffb7283e8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.790s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:26:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:53 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:26:53 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:26:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-3c840309-9884-4c8a-a6ee-1acd44f32c4c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:26:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-3c840309-9884-4c8a-a6ee-1acd44f32c4c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:26:53 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:26:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:53 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Updating instance_info_cache with network_info: [{"id": "03e9ece7-7612-4a4f-86ab-d85b0c97d723", "address": "fa:16:3e:70:6a:64", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e9ece7-76", "ovs_interfaceid": "03e9ece7-7612-4a4f-86ab-d85b0c97d723", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:26:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-3c840309-9884-4c8a-a6ee-1acd44f32c4c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:26:53 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:26:54 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:26:54 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:26:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:26:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:26:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:26:54 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:26:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "7ad61d3c-db7d-407f-b2ee-f2f9d9256ced" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:26:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "7ad61d3c-db7d-407f-b2ee-f2f9d9256ced" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:26:54 user nova-compute[73078]: DEBUG nova.compute.manager [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:26:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:26:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:26:54 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:26:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3088da30-65b7-4801-b425-93df4fca6ad8/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:54 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:26:54 user nova-compute[73078]: INFO nova.compute.claims [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Claim successful on node user
Aug 14 18:26:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3088da30-65b7-4801-b425-93df4fca6ad8/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3088da30-65b7-4801-b425-93df4fca6ad8/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3088da30-65b7-4801-b425-93df4fca6ad8/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.657s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG nova.compute.manager [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG nova.compute.manager [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG nova.network.neutron [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:26:55 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:26:55 user nova-compute[73078]: DEBUG nova.compute.manager [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16abee43-684b-415f-9c77-476ffb7283e8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:55 user nova-compute[73078]: INFO nova.virt.block_device [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Booting with volume d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d at /dev/vda
Aug 14 18:26:55 user nova-compute[73078]: DEBUG nova.policy [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe79455616584e0fb80e6007edf0b706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7142101014c4defa7261a34fb9f28e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG os_brick.utils [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea58d48-6301-4e87-af2f-8376f53b651b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b1e2a8-c0c8-4f46-830a-a1300c3014ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16abee43-684b-415f-9c77-476ffb7283e8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16abee43-684b-415f-9c77-476ffb7283e8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[769d549d-ce4e-4ca6-9254-c345c1f33d51]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b107d6c-fe44-4e1d-88c2-b78294d8a2fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:26:55 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:26:55 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eba371b-498c-47f3-9931-e32547d29315]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG os_brick.utils [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] <== get_connector_properties: return (189ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Updating existing volume attachment record: 87ad1cd2-1fe9-43e1-bc1f-cc373d29f551 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16abee43-684b-415f-9c77-476ffb7283e8/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:26:55 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:56 user nova-compute[73078]: DEBUG nova.compute.manager [req-5720ce43-cf9a-4d0a-8770-20c1ef4745b5 req-2fcc0d80-66ea-4427-b5ee-10c9a1b39b37 service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Received event network-changed-ea900923-9066-4aa4-81f3-9d06fc2329f3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:26:56 user nova-compute[73078]: DEBUG nova.compute.manager [req-5720ce43-cf9a-4d0a-8770-20c1ef4745b5 req-2fcc0d80-66ea-4427-b5ee-10c9a1b39b37 service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Refreshing instance network info cache due to event network-changed-ea900923-9066-4aa4-81f3-9d06fc2329f3. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:26:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5720ce43-cf9a-4d0a-8770-20c1ef4745b5 req-2fcc0d80-66ea-4427-b5ee-10c9a1b39b37 service nova] Acquiring lock "refresh_cache-16abee43-684b-415f-9c77-476ffb7283e8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:26:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5720ce43-cf9a-4d0a-8770-20c1ef4745b5 req-2fcc0d80-66ea-4427-b5ee-10c9a1b39b37 service nova] Acquired lock "refresh_cache-16abee43-684b-415f-9c77-476ffb7283e8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:26:56 user nova-compute[73078]: DEBUG nova.network.neutron [req-5720ce43-cf9a-4d0a-8770-20c1ef4745b5 req-2fcc0d80-66ea-4427-b5ee-10c9a1b39b37 service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Refreshing network info cache for port ea900923-9066-4aa4-81f3-9d06fc2329f3 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:26:56 user nova-compute[73078]: DEBUG nova.network.neutron [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Successfully created port: 02c80090-d3ca-47eb-882f-9f29edc28895 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:26:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:57 user nova-compute[73078]: DEBUG nova.network.neutron [req-5720ce43-cf9a-4d0a-8770-20c1ef4745b5 req-2fcc0d80-66ea-4427-b5ee-10c9a1b39b37 service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Updated VIF entry in instance network info cache for port ea900923-9066-4aa4-81f3-9d06fc2329f3. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:26:57 user nova-compute[73078]: DEBUG nova.network.neutron [req-5720ce43-cf9a-4d0a-8770-20c1ef4745b5 req-2fcc0d80-66ea-4427-b5ee-10c9a1b39b37 service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Updating instance_info_cache with network_info: [{"id": "ea900923-9066-4aa4-81f3-9d06fc2329f3", "address": "fa:16:3e:80:d9:0f", "network": {"id": "4c337404-9329-43e7-bed1-7b5dc32f6cd9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-902748542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6461284f1d491c9cd726d8550a445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea900923-90", "ovs_interfaceid": "ea900923-9066-4aa4-81f3-9d06fc2329f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:26:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5720ce43-cf9a-4d0a-8770-20c1ef4745b5 req-2fcc0d80-66ea-4427-b5ee-10c9a1b39b37 service nova] Releasing lock "refresh_cache-16abee43-684b-415f-9c77-476ffb7283e8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:26:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:57 user nova-compute[73078]: DEBUG nova.network.neutron [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Successfully updated port: 02c80090-d3ca-47eb-882f-9f29edc28895 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:26:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "refresh_cache-7ad61d3c-db7d-407f-b2ee-f2f9d9256ced" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:26:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquired lock "refresh_cache-7ad61d3c-db7d-407f-b2ee-f2f9d9256ced" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:26:57 user nova-compute[73078]: DEBUG nova.network.neutron [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:26:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:26:57 user nova-compute[73078]: DEBUG nova.network.neutron [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:26:57 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:26:58 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:26:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:26:58 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:26:58 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:26:58 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=7306MB free_disk=24.99878692626953GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:26:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:26:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:26:58 user nova-compute[73078]: DEBUG nova.network.neutron [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Updating instance_info_cache with network_info: [{"id": "02c80090-d3ca-47eb-882f-9f29edc28895", "address": "fa:16:3e:c3:46:2f", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c80090-d3", "ovs_interfaceid": "02c80090-d3ca-47eb-882f-9f29edc28895", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:26:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Releasing lock "refresh_cache-7ad61d3c-db7d-407f-b2ee-f2f9d9256ced" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:26:58 user nova-compute[73078]: DEBUG nova.compute.manager [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Instance network_info: |[{"id": "02c80090-d3ca-47eb-882f-9f29edc28895", "address": "fa:16:3e:c3:46:2f", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c80090-d3", "ovs_interfaceid": "02c80090-d3ca-47eb-882f-9f29edc28895", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:26:58 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance de80e188-9385-4613-8a6c-aa72b624ad55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:26:58 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 1f88cb97-4f22-439e-99f2-d7cb8d5aff36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:26:58 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 3c840309-9884-4c8a-a6ee-1acd44f32c4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:26:58 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 61dfe42b-c943-4617-bf8e-745eaf1a1bb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:26:58 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 3088da30-65b7-4801-b425-93df4fca6ad8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:26:58 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 8ebc48e0-0a24-4421-b180-f14eacc636ad actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:26:58 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 16abee43-684b-415f-9c77-476ffb7283e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:26:58 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance ef083dd3-67d6-48a8-846a-7fe6c6b32d5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:26:58 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:26:58 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:26:58 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:26:58 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:26:58 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Refreshing inventories for resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 18:26:58 user nova-compute[73078]: DEBUG nova.compute.manager [req-6cefb7c0-b52c-4108-99ae-2f81f1d4eb07 req-db07dfb2-1dee-4e84-8bec-f1839640af2b service nova] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Received event network-changed-02c80090-d3ca-47eb-882f-9f29edc28895 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:26:58 user nova-compute[73078]: DEBUG nova.compute.manager [req-6cefb7c0-b52c-4108-99ae-2f81f1d4eb07 req-db07dfb2-1dee-4e84-8bec-f1839640af2b service nova] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Refreshing instance network info cache due to event network-changed-02c80090-d3ca-47eb-882f-9f29edc28895. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:26:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6cefb7c0-b52c-4108-99ae-2f81f1d4eb07 req-db07dfb2-1dee-4e84-8bec-f1839640af2b service nova] Acquiring lock "refresh_cache-7ad61d3c-db7d-407f-b2ee-f2f9d9256ced" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:26:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6cefb7c0-b52c-4108-99ae-2f81f1d4eb07 req-db07dfb2-1dee-4e84-8bec-f1839640af2b service nova] Acquired lock "refresh_cache-7ad61d3c-db7d-407f-b2ee-f2f9d9256ced" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:26:58 user nova-compute[73078]: DEBUG nova.network.neutron [req-6cefb7c0-b52c-4108-99ae-2f81f1d4eb07 req-db07dfb2-1dee-4e84-8bec-f1839640af2b service nova] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Refreshing network info cache for port 02c80090-d3ca-47eb-882f-9f29edc28895 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:26:58 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Updating ProviderTree inventory for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 18:26:58 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Updating inventory in ProviderTree for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 18:26:58 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Refreshing aggregate associations for resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b, aggregates: None {{(pid=73078) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 18:26:58 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Refreshing trait associations for resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV {{(pid=73078) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 18:26:59 user nova-compute[73078]: DEBUG nova.compute.manager [req-e1868311-51c7-4d5d-9bc4-53da0398a728 req-a491fdc8-088e-4616-a500-50f544b04ff6 service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Received event network-changed-ea900923-9066-4aa4-81f3-9d06fc2329f3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:26:59 user nova-compute[73078]: DEBUG nova.compute.manager [req-e1868311-51c7-4d5d-9bc4-53da0398a728 req-a491fdc8-088e-4616-a500-50f544b04ff6 service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Refreshing instance network info cache due to event network-changed-ea900923-9066-4aa4-81f3-9d06fc2329f3. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:26:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e1868311-51c7-4d5d-9bc4-53da0398a728 req-a491fdc8-088e-4616-a500-50f544b04ff6 service nova] Acquiring lock "refresh_cache-16abee43-684b-415f-9c77-476ffb7283e8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:26:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e1868311-51c7-4d5d-9bc4-53da0398a728 req-a491fdc8-088e-4616-a500-50f544b04ff6 service nova] Acquired lock "refresh_cache-16abee43-684b-415f-9c77-476ffb7283e8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:26:59 user nova-compute[73078]: DEBUG nova.network.neutron [req-e1868311-51c7-4d5d-9bc4-53da0398a728 req-a491fdc8-088e-4616-a500-50f544b04ff6 service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Refreshing network info cache for port ea900923-9066-4aa4-81f3-9d06fc2329f3 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:26:59 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:26:59 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:26:59 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:26:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.759s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:26:59 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:26:59 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Cleaning up deleted instances {{(pid=73078) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 18:26:59 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] There are 0 instances to clean {{(pid=73078) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 18:26:59 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:26:59 user nova-compute[73078]: DEBUG nova.network.neutron [req-6cefb7c0-b52c-4108-99ae-2f81f1d4eb07 req-db07dfb2-1dee-4e84-8bec-f1839640af2b service nova] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Updated VIF entry in instance network info cache for port 02c80090-d3ca-47eb-882f-9f29edc28895. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:26:59 user nova-compute[73078]: DEBUG nova.network.neutron [req-6cefb7c0-b52c-4108-99ae-2f81f1d4eb07 req-db07dfb2-1dee-4e84-8bec-f1839640af2b service nova] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Updating instance_info_cache with network_info: [{"id": "02c80090-d3ca-47eb-882f-9f29edc28895", "address": "fa:16:3e:c3:46:2f", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c80090-d3", "ovs_interfaceid": "02c80090-d3ca-47eb-882f-9f29edc28895", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:26:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6cefb7c0-b52c-4108-99ae-2f81f1d4eb07 req-db07dfb2-1dee-4e84-8bec-f1839640af2b service nova] Releasing lock "refresh_cache-7ad61d3c-db7d-407f-b2ee-f2f9d9256ced" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:26:59 user nova-compute[73078]: DEBUG nova.network.neutron [req-e1868311-51c7-4d5d-9bc4-53da0398a728 req-a491fdc8-088e-4616-a500-50f544b04ff6 service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Updated VIF entry in instance network info cache for port ea900923-9066-4aa4-81f3-9d06fc2329f3. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:26:59 user nova-compute[73078]: DEBUG nova.network.neutron [req-e1868311-51c7-4d5d-9bc4-53da0398a728 req-a491fdc8-088e-4616-a500-50f544b04ff6 service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Updating instance_info_cache with network_info: [{"id": "ea900923-9066-4aa4-81f3-9d06fc2329f3", "address": "fa:16:3e:80:d9:0f", "network": {"id": "4c337404-9329-43e7-bed1-7b5dc32f6cd9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-902748542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6461284f1d491c9cd726d8550a445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea900923-90", "ovs_interfaceid": "ea900923-9066-4aa4-81f3-9d06fc2329f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:26:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e1868311-51c7-4d5d-9bc4-53da0398a728 req-a491fdc8-088e-4616-a500-50f544b04ff6 service nova] Releasing lock "refresh_cache-16abee43-684b-415f-9c77-476ffb7283e8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:26:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c0cf4ae1-4e79-462f-8f92-75ddfb4fa0a7 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "16abee43-684b-415f-9c77-476ffb7283e8" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:26:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c0cf4ae1-4e79-462f-8f92-75ddfb4fa0a7 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "16abee43-684b-415f-9c77-476ffb7283e8" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:26:59 user nova-compute[73078]: INFO nova.compute.manager [None req-c0cf4ae1-4e79-462f-8f92-75ddfb4fa0a7 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Rebooting instance
Aug 14 18:26:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c0cf4ae1-4e79-462f-8f92-75ddfb4fa0a7 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "refresh_cache-16abee43-684b-415f-9c77-476ffb7283e8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:26:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c0cf4ae1-4e79-462f-8f92-75ddfb4fa0a7 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquired lock "refresh_cache-16abee43-684b-415f-9c77-476ffb7283e8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:26:59 user nova-compute[73078]: DEBUG nova.network.neutron [None req-c0cf4ae1-4e79-462f-8f92-75ddfb4fa0a7 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:27:00 user nova-compute[73078]: DEBUG nova.network.neutron [None req-c0cf4ae1-4e79-462f-8f92-75ddfb4fa0a7 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Updating instance_info_cache with network_info: [{"id": "ea900923-9066-4aa4-81f3-9d06fc2329f3", "address": "fa:16:3e:80:d9:0f", "network": {"id": "4c337404-9329-43e7-bed1-7b5dc32f6cd9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-902748542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6461284f1d491c9cd726d8550a445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea900923-90", "ovs_interfaceid": "ea900923-9066-4aa4-81f3-9d06fc2329f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:27:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c0cf4ae1-4e79-462f-8f92-75ddfb4fa0a7 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Releasing lock "refresh_cache-16abee43-684b-415f-9c77-476ffb7283e8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:27:00 user nova-compute[73078]: DEBUG nova.compute.manager [None req-c0cf4ae1-4e79-462f-8f92-75ddfb4fa0a7 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:27:00 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:27:00 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:27:00 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:27:00 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:27:00 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:27:00 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:27:00 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:27:02 user nova-compute[73078]: WARNING nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] While synchronizing instance power states, found 10 instances in the database and 9 instances on the hypervisor.
Aug 14 18:27:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Triggering sync for uuid de80e188-9385-4613-8a6c-aa72b624ad55 {{(pid=73078) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Triggering sync for uuid 1f88cb97-4f22-439e-99f2-d7cb8d5aff36 {{(pid=73078) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Triggering sync for uuid 3c840309-9884-4c8a-a6ee-1acd44f32c4c {{(pid=73078) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Triggering sync for uuid 61dfe42b-c943-4617-bf8e-745eaf1a1bb8 {{(pid=73078) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Triggering sync for uuid 8ebc48e0-0a24-4421-b180-f14eacc636ad {{(pid=73078) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Triggering sync for uuid 3088da30-65b7-4801-b425-93df4fca6ad8 {{(pid=73078) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Triggering sync for uuid 16abee43-684b-415f-9c77-476ffb7283e8 {{(pid=73078) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Triggering sync for uuid ef083dd3-67d6-48a8-846a-7fe6c6b32d5c {{(pid=73078) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Triggering sync for uuid 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21 {{(pid=73078) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Triggering sync for uuid 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced {{(pid=73078) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "de80e188-9385-4613-8a6c-aa72b624ad55" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "de80e188-9385-4613-8a6c-aa72b624ad55" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "1f88cb97-4f22-439e-99f2-d7cb8d5aff36" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "1f88cb97-4f22-439e-99f2-d7cb8d5aff36" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "61dfe42b-c943-4617-bf8e-745eaf1a1bb8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "61dfe42b-c943-4617-bf8e-745eaf1a1bb8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "8ebc48e0-0a24-4421-b180-f14eacc636ad" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "8ebc48e0-0a24-4421-b180-f14eacc636ad" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "3088da30-65b7-4801-b425-93df4fca6ad8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "3088da30-65b7-4801-b425-93df4fca6ad8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "16abee43-684b-415f-9c77-476ffb7283e8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "ef083dd3-67d6-48a8-846a-7fe6c6b32d5c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "ef083dd3-67d6-48a8-846a-7fe6c6b32d5c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "7ad61d3c-db7d-407f-b2ee-f2f9d9256ced" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "1f88cb97-4f22-439e-99f2-d7cb8d5aff36" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "3088da30-65b7-4801-b425-93df4fca6ad8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "de80e188-9385-4613-8a6c-aa72b624ad55" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "8ebc48e0-0a24-4421-b180-f14eacc636ad" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "61dfe42b-c943-4617-bf8e-745eaf1a1bb8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "ef083dd3-67d6-48a8-846a-7fe6c6b32d5c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:03 user nova-compute[73078]: DEBUG nova.compute.manager [req-7f85c893-dde8-48cc-ab7a-c1a1a18a6557 req-ac96833e-9ef5-410a-b846-38e4f5d51bff service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Received event network-vif-unplugged-ea900923-9066-4aa4-81f3-9d06fc2329f3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:27:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-7f85c893-dde8-48cc-ab7a-c1a1a18a6557 req-ac96833e-9ef5-410a-b846-38e4f5d51bff service nova] Acquiring lock "16abee43-684b-415f-9c77-476ffb7283e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-7f85c893-dde8-48cc-ab7a-c1a1a18a6557 req-ac96833e-9ef5-410a-b846-38e4f5d51bff service nova] Lock "16abee43-684b-415f-9c77-476ffb7283e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-7f85c893-dde8-48cc-ab7a-c1a1a18a6557 req-ac96833e-9ef5-410a-b846-38e4f5d51bff service nova] Lock "16abee43-684b-415f-9c77-476ffb7283e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:03 user nova-compute[73078]: DEBUG nova.compute.manager [req-7f85c893-dde8-48cc-ab7a-c1a1a18a6557 req-ac96833e-9ef5-410a-b846-38e4f5d51bff service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] No waiting events found dispatching network-vif-unplugged-ea900923-9066-4aa4-81f3-9d06fc2329f3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:27:03 user nova-compute[73078]: WARNING nova.compute.manager [req-7f85c893-dde8-48cc-ab7a-c1a1a18a6557 req-ac96833e-9ef5-410a-b846-38e4f5d51bff service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Received unexpected event network-vif-unplugged-ea900923-9066-4aa4-81f3-9d06fc2329f3 for instance with vm_state active and task_state reboot_started.
Aug 14 18:27:03 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:27:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:03 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-c0cf4ae1-4e79-462f-8f92-75ddfb4fa0a7 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Instance shutdown successfully.
Aug 14 18:27:05 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:27:05 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73078) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 18:27:05 user nova-compute[73078]: DEBUG nova.compute.manager [req-4c9a3b93-1671-4bd7-a39c-66f75258b870 req-5876b3b5-fefb-4558-ba4e-ce4d052fc8eb service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Received event network-vif-plugged-ea900923-9066-4aa4-81f3-9d06fc2329f3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:27:05 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4c9a3b93-1671-4bd7-a39c-66f75258b870 req-5876b3b5-fefb-4558-ba4e-ce4d052fc8eb service nova] Acquiring lock "16abee43-684b-415f-9c77-476ffb7283e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:05 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4c9a3b93-1671-4bd7-a39c-66f75258b870 req-5876b3b5-fefb-4558-ba4e-ce4d052fc8eb service nova] Lock "16abee43-684b-415f-9c77-476ffb7283e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:05 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4c9a3b93-1671-4bd7-a39c-66f75258b870 req-5876b3b5-fefb-4558-ba4e-ce4d052fc8eb service nova] Lock "16abee43-684b-415f-9c77-476ffb7283e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:05 user nova-compute[73078]: DEBUG nova.compute.manager [req-4c9a3b93-1671-4bd7-a39c-66f75258b870 req-5876b3b5-fefb-4558-ba4e-ce4d052fc8eb service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] No waiting events found dispatching network-vif-plugged-ea900923-9066-4aa4-81f3-9d06fc2329f3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:27:05 user nova-compute[73078]: WARNING nova.compute.manager [req-4c9a3b93-1671-4bd7-a39c-66f75258b870 req-5876b3b5-fefb-4558-ba4e-ce4d052fc8eb service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Received unexpected event network-vif-plugged-ea900923-9066-4aa4-81f3-9d06fc2329f3 for instance with vm_state active and task_state reboot_started.
Aug 14 18:27:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG nova.compute.manager [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:27:06 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Creating image(s)
Aug 14 18:27:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Did not create local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Ensure instance console log exists: /opt/stack/data/nova/instances/7ad61d3c-db7d-407f-b2ee-f2f9d9256ced/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Start _get_guest_xml network_info=[{"id": "02c80090-d3ca-47eb-882f-9f29edc28895", "address": "fa:16:3e:c3:46:2f", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c80090-d3", "ovs_interfaceid": "02c80090-d3ca-47eb-882f-9f29edc28895", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '87ad1cd2-1fe9-43e1-bc1f-cc373d29f551', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kphFTRWa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7ad61d3c-db7d-407f-b2ee-f2f9d9256ced', 'attached_at': '', 'detached_at': '', 'volume_id': 'd7ea71c3-c447-4c35-8d92-bfcd84b3aa8d', 'serial': 'd7ea71c3-c447-4c35-8d92-bfcd84b3aa8d'}, 'volume_type': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:27:06 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:27:06 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:27:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kphFTRWa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:27:06 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:27:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:27:06 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:27:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:27:06 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:27:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[586b3953-aa8a-4cbd-8f9e-77b47f5fa3a6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:27:06 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1f1bb4-2569-4421-9c51-327dec22daf3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d] added
Aug 14 18:27:06 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d598d7-0dee-47b8-8255-1b5288eecf89]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d04fa9d-b787-48e8-932a-4605d63a3b5e]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kphFTRWa {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kphFTRWa" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b53302-1852-4139-b81c-0efc9b3b872d]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kphFTRWa'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ae3d09-9249-4735-a114-662d6115f481]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2608ff4-7524-460b-957b-a25d6fabb8f0]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:27:06 user nova-compute[73078]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:27:06 user nova-compute[73078]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b (non-flash)
Aug 14 18:27:06 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:27:06 user nova-compute[73078]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:27:06 user nova-compute[73078]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b (non-flash)
Aug 14 18:27:06 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd77b8f-fab3-4f8f-816e-9ca6cb8eec1d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d, portal: 172.16.0.220,3260]
Aug 14 18:27:06 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d, portal: 172.16.0.220,3260] successful.
Aug 14 18:27:06 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38954aa-1be1-4586-b886-0a88436e1556]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf9b01f-54a8-4fb7-9e11-f1c1382c646e]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:27:06 user nova-compute[73078]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:27:06 user nova-compute[73078]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b (non-flash)
Aug 14 18:27:06 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:27:06 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:27:06 user nova-compute[73078]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:27:06 user nova-compute[73078]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b (non-flash)
Aug 14 18:27:06 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:27:06 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d891b5-1694-41ce-9cb6-88e73448684c]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:27:06 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kphFTRWa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:27:07 user nova-compute[73078]: DEBUG nova.compute.manager [req-a1f399df-4453-40cb-a3a0-ea55424a8632 req-040e51f0-0328-4fab-895c-30ac132a7af0 service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Received event network-vif-plugged-ea900923-9066-4aa4-81f3-9d06fc2329f3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:27:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a1f399df-4453-40cb-a3a0-ea55424a8632 req-040e51f0-0328-4fab-895c-30ac132a7af0 service nova] Acquiring lock "16abee43-684b-415f-9c77-476ffb7283e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a1f399df-4453-40cb-a3a0-ea55424a8632 req-040e51f0-0328-4fab-895c-30ac132a7af0 service nova] Lock "16abee43-684b-415f-9c77-476ffb7283e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a1f399df-4453-40cb-a3a0-ea55424a8632 req-040e51f0-0328-4fab-895c-30ac132a7af0 service nova] Lock "16abee43-684b-415f-9c77-476ffb7283e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:07 user nova-compute[73078]: DEBUG nova.compute.manager [req-a1f399df-4453-40cb-a3a0-ea55424a8632 req-040e51f0-0328-4fab-895c-30ac132a7af0 service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] No waiting events found dispatching network-vif-plugged-ea900923-9066-4aa4-81f3-9d06fc2329f3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:27:07 user nova-compute[73078]: WARNING nova.compute.manager [req-a1f399df-4453-40cb-a3a0-ea55424a8632 req-040e51f0-0328-4fab-895c-30ac132a7af0 service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Received unexpected event network-vif-plugged-ea900923-9066-4aa4-81f3-9d06fc2329f3 for instance with vm_state active and task_state reboot_started.
Aug 14 18:27:07 user nova-compute[73078]: DEBUG nova.compute.manager [req-a1f399df-4453-40cb-a3a0-ea55424a8632 req-040e51f0-0328-4fab-895c-30ac132a7af0 service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Received event network-vif-plugged-ea900923-9066-4aa4-81f3-9d06fc2329f3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:27:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a1f399df-4453-40cb-a3a0-ea55424a8632 req-040e51f0-0328-4fab-895c-30ac132a7af0 service nova] Acquiring lock "16abee43-684b-415f-9c77-476ffb7283e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a1f399df-4453-40cb-a3a0-ea55424a8632 req-040e51f0-0328-4fab-895c-30ac132a7af0 service nova] Lock "16abee43-684b-415f-9c77-476ffb7283e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a1f399df-4453-40cb-a3a0-ea55424a8632 req-040e51f0-0328-4fab-895c-30ac132a7af0 service nova] Lock "16abee43-684b-415f-9c77-476ffb7283e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:07 user nova-compute[73078]: DEBUG nova.compute.manager [req-a1f399df-4453-40cb-a3a0-ea55424a8632 req-040e51f0-0328-4fab-895c-30ac132a7af0 service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] No waiting events found dispatching network-vif-plugged-ea900923-9066-4aa4-81f3-9d06fc2329f3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:27:07 user nova-compute[73078]: WARNING nova.compute.manager [req-a1f399df-4453-40cb-a3a0-ea55424a8632 req-040e51f0-0328-4fab-895c-30ac132a7af0 service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Received unexpected event network-vif-plugged-ea900923-9066-4aa4-81f3-9d06fc2329f3 for instance with vm_state active and task_state reboot_started.
Aug 14 18:27:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:27:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '26232326665343930', 'path': '/dev/sdd'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:27:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232326665343930', 'path': '/dev/sdd'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:27:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:26:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-665190295',display_name='tempest-TestVolumeBootPattern-volume-backed-server-665190295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-665190295',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdjALq6jgdUasVS8cCpbY3Tky1JoTa4XvqUmUb8zF9c44T3u/n0nGq4ODdg8P+dk5papPi8jrciuBQDC9CBEziFLv2B7o4s+XmJOKYxY5ZmdctUjb2QCex614dLMWhh3A==',key_name='tempest-keypair-127012515',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7142101014c4defa7261a34fb9f28e4',ramdisk_id='',reservation_id='r-yizm06hu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1889877750',owner_user_name='tempest-TestVolumeBootPattern-1889877750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:26:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe79455616584e0fb80e6007edf0b706',uuid=7ad61d3c-db7d-407f-b2ee-f2f9d9256ced,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02c80090-d3ca-47eb-882f-9f29edc28895", "address": "fa:16:3e:c3:46:2f", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c80090-d3", "ovs_interfaceid": "02c80090-d3ca-47eb-882f-9f29edc28895", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:27:07 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Converting VIF {"id": "02c80090-d3ca-47eb-882f-9f29edc28895", "address": "fa:16:3e:c3:46:2f", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c80090-d3", "ovs_interfaceid": "02c80090-d3ca-47eb-882f-9f29edc28895", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:27:07 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:46:2f,bridge_name='br-int',has_traffic_filtering=True,id=02c80090-d3ca-47eb-882f-9f29edc28895,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02c80090-d3') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:27:07 user nova-compute[73078]: DEBUG nova.objects.instance [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:27:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Removed pending event for 16abee43-684b-415f-9c77-476ffb7283e8 due to event {{(pid=73078) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 18:27:07 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037627.838445, 16abee43-684b-415f-9c77-476ffb7283e8 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:27:07 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] VM Resumed (Lifecycle Event)
Aug 14 18:27:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:27:07 user nova-compute[73078]:   <uuid>7ad61d3c-db7d-407f-b2ee-f2f9d9256ced</uuid>
Aug 14 18:27:07 user nova-compute[73078]:   <name>instance-00000023</name>
Aug 14 18:27:07 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:27:07 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:27:07 user nova-compute[73078]:   <metadata>
Aug 14 18:27:07 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:27:07 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:27:07 user nova-compute[73078]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-665190295</nova:name>
Aug 14 18:27:07 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:27:06</nova:creationTime>
Aug 14 18:27:07 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:27:07 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:27:07 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:27:07 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:27:07 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:27:07 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:27:07 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:27:07 user nova-compute[73078]:       <nova:owner>
Aug 14 18:27:07 user nova-compute[73078]:         <nova:user uuid="fe79455616584e0fb80e6007edf0b706">tempest-TestVolumeBootPattern-1889877750-project-member</nova:user>
Aug 14 18:27:07 user nova-compute[73078]:         <nova:project uuid="e7142101014c4defa7261a34fb9f28e4">tempest-TestVolumeBootPattern-1889877750</nova:project>
Aug 14 18:27:07 user nova-compute[73078]:       </nova:owner>
Aug 14 18:27:07 user nova-compute[73078]:       <nova:ports>
Aug 14 18:27:07 user nova-compute[73078]:         <nova:port uuid="02c80090-d3ca-47eb-882f-9f29edc28895">
Aug 14 18:27:07 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 18:27:07 user nova-compute[73078]:         </nova:port>
Aug 14 18:27:07 user nova-compute[73078]:       </nova:ports>
Aug 14 18:27:07 user nova-compute[73078]:     </nova:instance>
Aug 14 18:27:07 user nova-compute[73078]:   </metadata>
Aug 14 18:27:07 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:27:07 user nova-compute[73078]:     <system>
Aug 14 18:27:07 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:27:07 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:27:07 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:27:07 user nova-compute[73078]:       <entry name="serial">7ad61d3c-db7d-407f-b2ee-f2f9d9256ced</entry>
Aug 14 18:27:07 user nova-compute[73078]:       <entry name="uuid">7ad61d3c-db7d-407f-b2ee-f2f9d9256ced</entry>
Aug 14 18:27:07 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:27:07 user nova-compute[73078]:     </system>
Aug 14 18:27:07 user nova-compute[73078]:   </sysinfo>
Aug 14 18:27:07 user nova-compute[73078]:   <os>
Aug 14 18:27:07 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:27:07 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:27:07 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:27:07 user nova-compute[73078]:   </os>
Aug 14 18:27:07 user nova-compute[73078]:   <features>
Aug 14 18:27:07 user nova-compute[73078]:     <acpi/>
Aug 14 18:27:07 user nova-compute[73078]:     <apic/>
Aug 14 18:27:07 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:27:07 user nova-compute[73078]:   </features>
Aug 14 18:27:07 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:27:07 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:27:07 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:27:07 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:27:07 user nova-compute[73078]:   </clock>
Aug 14 18:27:07 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:27:07 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:27:07 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:27:07 user nova-compute[73078]:   </cpu>
Aug 14 18:27:07 user nova-compute[73078]:   <devices>
Aug 14 18:27:07 user nova-compute[73078]:     <disk type="block" device="disk">
Aug 14 18:27:07 user nova-compute[73078]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:27:07 user nova-compute[73078]:       <source dev="/dev/sdd"/>
Aug 14 18:27:07 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:27:07 user nova-compute[73078]:       <serial>d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d</serial>
Aug 14 18:27:07 user nova-compute[73078]:     </disk>
Aug 14 18:27:07 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:27:07 user nova-compute[73078]:       <mac address="fa:16:3e:c3:46:2f"/>
Aug 14 18:27:07 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:27:07 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:27:07 user nova-compute[73078]:       <target dev="tap02c80090-d3"/>
Aug 14 18:27:07 user nova-compute[73078]:     </interface>
Aug 14 18:27:07 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:27:07 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/7ad61d3c-db7d-407f-b2ee-f2f9d9256ced/console.log" append="off"/>
Aug 14 18:27:07 user nova-compute[73078]:     </serial>
Aug 14 18:27:07 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:27:07 user nova-compute[73078]:     <video>
Aug 14 18:27:07 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:27:07 user nova-compute[73078]:     </video>
Aug 14 18:27:07 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:27:07 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:27:07 user nova-compute[73078]:     </rng>
Aug 14 18:27:07 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:27:07 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:27:07 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:27:07 user nova-compute[73078]:     </memballoon>
Aug 14 18:27:07 user nova-compute[73078]:   </devices>
Aug 14 18:27:07 user nova-compute[73078]: </domain>
Aug 14 18:27:07 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:27:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:26:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-665190295',display_name='tempest-TestVolumeBootPattern-volume-backed-server-665190295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-665190295',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdjALq6jgdUasVS8cCpbY3Tky1JoTa4XvqUmUb8zF9c44T3u/n0nGq4ODdg8P+dk5papPi8jrciuBQDC9CBEziFLv2B7o4s+XmJOKYxY5ZmdctUjb2QCex614dLMWhh3A==',key_name='tempest-keypair-127012515',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7142101014c4defa7261a34fb9f28e4',ramdisk_id='',reservation_id='r-yizm06hu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1889877750',owner_user_name='tempest-TestVolumeBootPattern-1889877750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:26:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe79455616584e0fb80e6007edf0b706',uuid=7ad61d3c-db7d-407f-b2ee-f2f9d9256ced,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02c80090-d3ca-47eb-882f-9f29edc28895", "address": "fa:16:3e:c3:46:2f", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c80090-d3", "ovs_interfaceid": "02c80090-d3ca-47eb-882f-9f29edc28895", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:27:07 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Converting VIF {"id": "02c80090-d3ca-47eb-882f-9f29edc28895", "address": "fa:16:3e:c3:46:2f", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c80090-d3", "ovs_interfaceid": "02c80090-d3ca-47eb-882f-9f29edc28895", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:27:07 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:46:2f,bridge_name='br-int',has_traffic_filtering=True,id=02c80090-d3ca-47eb-882f-9f29edc28895,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02c80090-d3') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:27:07 user nova-compute[73078]: DEBUG os_vif [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:46:2f,bridge_name='br-int',has_traffic_filtering=True,id=02c80090-d3ca-47eb-882f-9f29edc28895,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02c80090-d3') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:27:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:27:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:27:07 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:27:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02c80090-d3, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:27:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap02c80090-d3, col_values=(('external_ids', {'iface-id': '02c80090-d3ca-47eb-882f-9f29edc28895', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:46:2f', 'vm-uuid': '7ad61d3c-db7d-407f-b2ee-f2f9d9256ced'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:27:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:07 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Instance running successfully.
Aug 14 18:27:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:27:07 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-c0cf4ae1-4e79-462f-8f92-75ddfb4fa0a7 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Instance soft rebooted successfully.
Aug 14 18:27:07 user nova-compute[73078]: DEBUG nova.compute.manager [None req-c0cf4ae1-4e79-462f-8f92-75ddfb4fa0a7 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:27:07 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:27:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:07 user nova-compute[73078]: INFO os_vif [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:46:2f,bridge_name='br-int',has_traffic_filtering=True,id=02c80090-d3ca-47eb-882f-9f29edc28895,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02c80090-d3')
Aug 14 18:27:07 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 14 18:27:07 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037627.8396025, 16abee43-684b-415f-9c77-476ffb7283e8 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:27:07 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] VM Started (Lifecycle Event)
Aug 14 18:27:07 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:27:07 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:27:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c0cf4ae1-4e79-462f-8f92-75ddfb4fa0a7 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "16abee43-684b-415f-9c77-476ffb7283e8" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.117s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "16abee43-684b-415f-9c77-476ffb7283e8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.606s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:07 user nova-compute[73078]: INFO nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 14 18:27:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "16abee43-684b-415f-9c77-476ffb7283e8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:27:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] No VIF found with MAC fa:16:3e:c3:46:2f, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:27:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:09 user nova-compute[73078]: DEBUG nova.compute.manager [req-eb20712b-0f66-4b96-af83-4c3303382e15 req-f690b4a9-86d7-4f48-b4bf-9abb35168de4 service nova] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Received event network-vif-plugged-02c80090-d3ca-47eb-882f-9f29edc28895 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:27:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-eb20712b-0f66-4b96-af83-4c3303382e15 req-f690b4a9-86d7-4f48-b4bf-9abb35168de4 service nova] Acquiring lock "7ad61d3c-db7d-407f-b2ee-f2f9d9256ced-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-eb20712b-0f66-4b96-af83-4c3303382e15 req-f690b4a9-86d7-4f48-b4bf-9abb35168de4 service nova] Lock "7ad61d3c-db7d-407f-b2ee-f2f9d9256ced-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-eb20712b-0f66-4b96-af83-4c3303382e15 req-f690b4a9-86d7-4f48-b4bf-9abb35168de4 service nova] Lock "7ad61d3c-db7d-407f-b2ee-f2f9d9256ced-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:09 user nova-compute[73078]: DEBUG nova.compute.manager [req-eb20712b-0f66-4b96-af83-4c3303382e15 req-f690b4a9-86d7-4f48-b4bf-9abb35168de4 service nova] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] No waiting events found dispatching network-vif-plugged-02c80090-d3ca-47eb-882f-9f29edc28895 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:27:09 user nova-compute[73078]: WARNING nova.compute.manager [req-eb20712b-0f66-4b96-af83-4c3303382e15 req-f690b4a9-86d7-4f48-b4bf-9abb35168de4 service nova] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Received unexpected event network-vif-plugged-02c80090-d3ca-47eb-882f-9f29edc28895 for instance with vm_state building and task_state spawning.
Aug 14 18:27:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:11 user nova-compute[73078]: DEBUG nova.compute.manager [req-ade68d2d-d036-4f24-93c8-a824807d7e20 req-f06af956-5b50-4229-af9a-3a0ef71fe15a service nova] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Received event network-vif-plugged-02c80090-d3ca-47eb-882f-9f29edc28895 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:27:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ade68d2d-d036-4f24-93c8-a824807d7e20 req-f06af956-5b50-4229-af9a-3a0ef71fe15a service nova] Acquiring lock "7ad61d3c-db7d-407f-b2ee-f2f9d9256ced-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ade68d2d-d036-4f24-93c8-a824807d7e20 req-f06af956-5b50-4229-af9a-3a0ef71fe15a service nova] Lock "7ad61d3c-db7d-407f-b2ee-f2f9d9256ced-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ade68d2d-d036-4f24-93c8-a824807d7e20 req-f06af956-5b50-4229-af9a-3a0ef71fe15a service nova] Lock "7ad61d3c-db7d-407f-b2ee-f2f9d9256ced-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:11 user nova-compute[73078]: DEBUG nova.compute.manager [req-ade68d2d-d036-4f24-93c8-a824807d7e20 req-f06af956-5b50-4229-af9a-3a0ef71fe15a service nova] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] No waiting events found dispatching network-vif-plugged-02c80090-d3ca-47eb-882f-9f29edc28895 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:27:11 user nova-compute[73078]: WARNING nova.compute.manager [req-ade68d2d-d036-4f24-93c8-a824807d7e20 req-f06af956-5b50-4229-af9a-3a0ef71fe15a service nova] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Received unexpected event network-vif-plugged-02c80090-d3ca-47eb-882f-9f29edc28895 for instance with vm_state building and task_state spawning.
Aug 14 18:27:11 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037631.7425816, 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:27:11 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] VM Resumed (Lifecycle Event)
Aug 14 18:27:11 user nova-compute[73078]: DEBUG nova.compute.manager [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:27:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:27:11 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Instance spawned successfully.
Aug 14 18:27:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:27:11 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:27:11 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:27:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:27:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:27:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:27:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:27:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:27:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:27:11 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:27:11 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037631.7463095, 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:27:11 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] VM Started (Lifecycle Event)
Aug 14 18:27:11 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:27:11 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:27:11 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:27:11 user nova-compute[73078]: INFO nova.compute.manager [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Took 5.54 seconds to spawn the instance on the hypervisor.
Aug 14 18:27:11 user nova-compute[73078]: DEBUG nova.compute.manager [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:27:11 user nova-compute[73078]: INFO nova.compute.manager [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Took 17.30 seconds to build instance.
Aug 14 18:27:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8386b988-92a4-4718-a5b9-03e00905bf07 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "7ad61d3c-db7d-407f-b2ee-f2f9d9256ced" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.449s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "7ad61d3c-db7d-407f-b2ee-f2f9d9256ced" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 9.623s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:11 user nova-compute[73078]: INFO nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Aug 14 18:27:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "7ad61d3c-db7d-407f-b2ee-f2f9d9256ced" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-5b0898e6-922a-4b9c-8aa6-ee2d867a7dab tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-5b0898e6-922a-4b9c-8aa6-ee2d867a7dab tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-5b0898e6-922a-4b9c-8aa6-ee2d867a7dab tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-5b0898e6-922a-4b9c-8aa6-ee2d867a7dab tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-5b0898e6-922a-4b9c-8aa6-ee2d867a7dab tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:16 user nova-compute[73078]: INFO nova.compute.manager [None req-5b0898e6-922a-4b9c-8aa6-ee2d867a7dab tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Terminating instance
Aug 14 18:27:16 user nova-compute[73078]: DEBUG nova.compute.manager [None req-5b0898e6-922a-4b9c-8aa6-ee2d867a7dab tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:27:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:16 user nova-compute[73078]: DEBUG nova.compute.manager [req-3b05df30-34b8-4e95-883c-47738e20f90c req-97ca69b0-8f6c-45f5-a2e8-3c47963ff97f service nova] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Received event network-vif-unplugged-03e9ece7-7612-4a4f-86ab-d85b0c97d723 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:27:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3b05df30-34b8-4e95-883c-47738e20f90c req-97ca69b0-8f6c-45f5-a2e8-3c47963ff97f service nova] Acquiring lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3b05df30-34b8-4e95-883c-47738e20f90c req-97ca69b0-8f6c-45f5-a2e8-3c47963ff97f service nova] Lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3b05df30-34b8-4e95-883c-47738e20f90c req-97ca69b0-8f6c-45f5-a2e8-3c47963ff97f service nova] Lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:16 user nova-compute[73078]: DEBUG nova.compute.manager [req-3b05df30-34b8-4e95-883c-47738e20f90c req-97ca69b0-8f6c-45f5-a2e8-3c47963ff97f service nova] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] No waiting events found dispatching network-vif-unplugged-03e9ece7-7612-4a4f-86ab-d85b0c97d723 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:27:16 user nova-compute[73078]: DEBUG nova.compute.manager [req-3b05df30-34b8-4e95-883c-47738e20f90c req-97ca69b0-8f6c-45f5-a2e8-3c47963ff97f service nova] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Received event network-vif-unplugged-03e9ece7-7612-4a4f-86ab-d85b0c97d723 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:27:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:17 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Instance destroyed successfully.
Aug 14 18:27:17 user nova-compute[73078]: DEBUG nova.objects.instance [None req-5b0898e6-922a-4b9c-8aa6-ee2d867a7dab tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lazy-loading 'resources' on Instance uuid 3c840309-9884-4c8a-a6ee-1acd44f32c4c {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:27:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-5b0898e6-922a-4b9c-8aa6-ee2d867a7dab tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:10:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1378236224',display_name='tempest-ServerRescueNegativeTestJSON-server-1378236224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1378236224',id=4,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:12:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ec53c6018ee44b09ee31ba712a789aa',ramdisk_id='',reservation_id='r-7hiu473d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-38557121',owner_user_name='tempest-ServerRescueNegativeTestJSON-38557121-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:12:50Z,user_data=None,user_id='d25ecea70e9e481e8a1957a94d79edfc',uuid=3c840309-9884-4c8a-a6ee-1acd44f32c4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "03e9ece7-7612-4a4f-86ab-d85b0c97d723", "address": "fa:16:3e:70:6a:64", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e9ece7-76", "ovs_interfaceid": "03e9ece7-7612-4a4f-86ab-d85b0c97d723", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:27:17 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-5b0898e6-922a-4b9c-8aa6-ee2d867a7dab tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Converting VIF {"id": "03e9ece7-7612-4a4f-86ab-d85b0c97d723", "address": "fa:16:3e:70:6a:64", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e9ece7-76", "ovs_interfaceid": "03e9ece7-7612-4a4f-86ab-d85b0c97d723", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:27:17 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-5b0898e6-922a-4b9c-8aa6-ee2d867a7dab tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:6a:64,bridge_name='br-int',has_traffic_filtering=True,id=03e9ece7-7612-4a4f-86ab-d85b0c97d723,network=Network(33518dc6-7963-4995-b4c7-86d60b44a22f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03e9ece7-76') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:27:17 user nova-compute[73078]: DEBUG os_vif [None req-5b0898e6-922a-4b9c-8aa6-ee2d867a7dab tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:6a:64,bridge_name='br-int',has_traffic_filtering=True,id=03e9ece7-7612-4a4f-86ab-d85b0c97d723,network=Network(33518dc6-7963-4995-b4c7-86d60b44a22f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03e9ece7-76') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:27:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03e9ece7-76, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:27:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:27:17 user nova-compute[73078]: INFO os_vif [None req-5b0898e6-922a-4b9c-8aa6-ee2d867a7dab tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:6a:64,bridge_name='br-int',has_traffic_filtering=True,id=03e9ece7-7612-4a4f-86ab-d85b0c97d723,network=Network(33518dc6-7963-4995-b4c7-86d60b44a22f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03e9ece7-76')
Aug 14 18:27:17 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-5b0898e6-922a-4b9c-8aa6-ee2d867a7dab tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Deleting instance files /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c_del
Aug 14 18:27:17 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-5b0898e6-922a-4b9c-8aa6-ee2d867a7dab tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Deletion of /opt/stack/data/nova/instances/3c840309-9884-4c8a-a6ee-1acd44f32c4c_del complete
Aug 14 18:27:17 user nova-compute[73078]: INFO nova.compute.manager [None req-5b0898e6-922a-4b9c-8aa6-ee2d867a7dab tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 14 18:27:17 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-5b0898e6-922a-4b9c-8aa6-ee2d867a7dab tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:27:17 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:27:17 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:27:18 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:27:18 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Took 0.90 seconds to deallocate network for instance.
Aug 14 18:27:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-5b0898e6-922a-4b9c-8aa6-ee2d867a7dab tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-5b0898e6-922a-4b9c-8aa6-ee2d867a7dab tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:18 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-5b0898e6-922a-4b9c-8aa6-ee2d867a7dab tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:27:18 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-5b0898e6-922a-4b9c-8aa6-ee2d867a7dab tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:27:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-5b0898e6-922a-4b9c-8aa6-ee2d867a7dab tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:18 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-5b0898e6-922a-4b9c-8aa6-ee2d867a7dab tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Deleted allocations for instance 3c840309-9884-4c8a-a6ee-1acd44f32c4c
Aug 14 18:27:18 user nova-compute[73078]: DEBUG nova.compute.manager [req-ce7b70ae-5f84-4743-ac2f-d6ea2a800229 req-ac90c0cc-ccca-44bf-a495-1632a2972b86 service nova] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Received event network-vif-plugged-03e9ece7-7612-4a4f-86ab-d85b0c97d723 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:27:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ce7b70ae-5f84-4743-ac2f-d6ea2a800229 req-ac90c0cc-ccca-44bf-a495-1632a2972b86 service nova] Acquiring lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ce7b70ae-5f84-4743-ac2f-d6ea2a800229 req-ac90c0cc-ccca-44bf-a495-1632a2972b86 service nova] Lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ce7b70ae-5f84-4743-ac2f-d6ea2a800229 req-ac90c0cc-ccca-44bf-a495-1632a2972b86 service nova] Lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:18 user nova-compute[73078]: DEBUG nova.compute.manager [req-ce7b70ae-5f84-4743-ac2f-d6ea2a800229 req-ac90c0cc-ccca-44bf-a495-1632a2972b86 service nova] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] No waiting events found dispatching network-vif-plugged-03e9ece7-7612-4a4f-86ab-d85b0c97d723 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:27:18 user nova-compute[73078]: WARNING nova.compute.manager [req-ce7b70ae-5f84-4743-ac2f-d6ea2a800229 req-ac90c0cc-ccca-44bf-a495-1632a2972b86 service nova] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Received unexpected event network-vif-plugged-03e9ece7-7612-4a4f-86ab-d85b0c97d723 for instance with vm_state deleted and task_state None.
Aug 14 18:27:18 user nova-compute[73078]: DEBUG nova.compute.manager [req-ce7b70ae-5f84-4743-ac2f-d6ea2a800229 req-ac90c0cc-ccca-44bf-a495-1632a2972b86 service nova] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Received event network-vif-deleted-03e9ece7-7612-4a4f-86ab-d85b0c97d723 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:27:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-5b0898e6-922a-4b9c-8aa6-ee2d867a7dab tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "3c840309-9884-4c8a-a6ee-1acd44f32c4c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.651s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:19 user nova-compute[73078]: DEBUG nova.compute.manager [req-1f2b85b7-61a5-4bd5-b94b-f05470a4bb05 req-2b0886bd-35fc-4275-95fc-eb7ad00a5b86 service nova] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Received event network-changed-396a7d1c-7aec-4324-8722-adc2dc77db86 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:27:19 user nova-compute[73078]: DEBUG nova.compute.manager [req-1f2b85b7-61a5-4bd5-b94b-f05470a4bb05 req-2b0886bd-35fc-4275-95fc-eb7ad00a5b86 service nova] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Refreshing instance network info cache due to event network-changed-396a7d1c-7aec-4324-8722-adc2dc77db86. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:27:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1f2b85b7-61a5-4bd5-b94b-f05470a4bb05 req-2b0886bd-35fc-4275-95fc-eb7ad00a5b86 service nova] Acquiring lock "refresh_cache-ef083dd3-67d6-48a8-846a-7fe6c6b32d5c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:27:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1f2b85b7-61a5-4bd5-b94b-f05470a4bb05 req-2b0886bd-35fc-4275-95fc-eb7ad00a5b86 service nova] Acquired lock "refresh_cache-ef083dd3-67d6-48a8-846a-7fe6c6b32d5c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:27:19 user nova-compute[73078]: DEBUG nova.network.neutron [req-1f2b85b7-61a5-4bd5-b94b-f05470a4bb05 req-2b0886bd-35fc-4275-95fc-eb7ad00a5b86 service nova] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Refreshing network info cache for port 396a7d1c-7aec-4324-8722-adc2dc77db86 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:27:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Acquiring lock "ef083dd3-67d6-48a8-846a-7fe6c6b32d5c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "ef083dd3-67d6-48a8-846a-7fe6c6b32d5c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:20 user nova-compute[73078]: DEBUG nova.objects.instance [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lazy-loading 'flavor' on Instance uuid ef083dd3-67d6-48a8-846a-7fe6c6b32d5c {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:27:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "ef083dd3-67d6-48a8-846a-7fe6c6b32d5c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Acquiring lock "ef083dd3-67d6-48a8-846a-7fe6c6b32d5c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "ef083dd3-67d6-48a8-846a-7fe6c6b32d5c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:20 user nova-compute[73078]: INFO nova.compute.manager [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Attaching volume 7813589e-fbc5-4ca7-9bc3-4cd70ed4c017 to /dev/vdb
Aug 14 18:27:20 user nova-compute[73078]: DEBUG os_brick.utils [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:27:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:20 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f3b9b6-92ba-48bb-9d52-1b3d03846f9f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:20 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a54cca7-a645-4b6b-9d7d-6bad61093e73]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:20 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1c6310-61be-4dc2-8a2a-24dac0583430]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:20 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ce8af9-f4e7-4ff1-a242-855ab539b2b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:27:20 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:27:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:27:20 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:27:20 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a0db54-4861-487c-b30d-d5d8cd635a90]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:20 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:27:20 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:27:20 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:27:20 user nova-compute[73078]: DEBUG os_brick.utils [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:27:20 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Updating existing volume attachment record: 147ba83f-df8a-4701-bbcc-df3f03af8173 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:27:21 user nova-compute[73078]: DEBUG nova.network.neutron [req-1f2b85b7-61a5-4bd5-b94b-f05470a4bb05 req-2b0886bd-35fc-4275-95fc-eb7ad00a5b86 service nova] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Updated VIF entry in instance network info cache for port 396a7d1c-7aec-4324-8722-adc2dc77db86. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:27:21 user nova-compute[73078]: DEBUG nova.network.neutron [req-1f2b85b7-61a5-4bd5-b94b-f05470a4bb05 req-2b0886bd-35fc-4275-95fc-eb7ad00a5b86 service nova] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Updating instance_info_cache with network_info: [{"id": "396a7d1c-7aec-4324-8722-adc2dc77db86", "address": "fa:16:3e:17:fe:f7", "network": {"id": "21c76d99-2d0a-42b9-b7a0-b068f0cb938f", "bridge": "br-int", "label": "tempest-TestStampPattern-1682035048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce3bd6c6a784ee3a395c368d667c1b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap396a7d1c-7a", "ovs_interfaceid": "396a7d1c-7aec-4324-8722-adc2dc77db86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:27:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1f2b85b7-61a5-4bd5-b94b-f05470a4bb05 req-2b0886bd-35fc-4275-95fc-eb7ad00a5b86 service nova] Releasing lock "refresh_cache-ef083dd3-67d6-48a8-846a-7fe6c6b32d5c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:27:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:25 user nova-compute[73078]: DEBUG nova.compute.manager [req-88527004-e4a4-44f4-8bd9-da1398206eba req-394273fe-6a7a-4deb-8805-9103ef61c2f3 service nova] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Received event network-changed-3a7aa5b0-e16a-41c5-90e6-2065778d0dfd {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:27:25 user nova-compute[73078]: DEBUG nova.compute.manager [req-88527004-e4a4-44f4-8bd9-da1398206eba req-394273fe-6a7a-4deb-8805-9103ef61c2f3 service nova] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Refreshing instance network info cache due to event network-changed-3a7aa5b0-e16a-41c5-90e6-2065778d0dfd. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:27:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-88527004-e4a4-44f4-8bd9-da1398206eba req-394273fe-6a7a-4deb-8805-9103ef61c2f3 service nova] Acquiring lock "refresh_cache-9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:27:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-88527004-e4a4-44f4-8bd9-da1398206eba req-394273fe-6a7a-4deb-8805-9103ef61c2f3 service nova] Acquired lock "refresh_cache-9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:27:25 user nova-compute[73078]: DEBUG nova.network.neutron [req-88527004-e4a4-44f4-8bd9-da1398206eba req-394273fe-6a7a-4deb-8805-9103ef61c2f3 service nova] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Refreshing network info cache for port 3a7aa5b0-e16a-41c5-90e6-2065778d0dfd {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:27:26 user nova-compute[73078]: DEBUG nova.network.neutron [req-88527004-e4a4-44f4-8bd9-da1398206eba req-394273fe-6a7a-4deb-8805-9103ef61c2f3 service nova] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Updated VIF entry in instance network info cache for port 3a7aa5b0-e16a-41c5-90e6-2065778d0dfd. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:27:26 user nova-compute[73078]: DEBUG nova.network.neutron [req-88527004-e4a4-44f4-8bd9-da1398206eba req-394273fe-6a7a-4deb-8805-9103ef61c2f3 service nova] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Updating instance_info_cache with network_info: [{"id": "3a7aa5b0-e16a-41c5-90e6-2065778d0dfd", "address": "fa:16:3e:e3:20:8e", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7aa5b0-e1", "ovs_interfaceid": "3a7aa5b0-e16a-41c5-90e6-2065778d0dfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:27:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-88527004-e4a4-44f4-8bd9-da1398206eba req-394273fe-6a7a-4deb-8805-9103ef61c2f3 service nova] Releasing lock "refresh_cache-9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:27:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:30 user nova-compute[73078]: DEBUG nova.objects.instance [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lazy-loading 'flavor' on Instance uuid 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:27:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:30 user nova-compute[73078]: INFO nova.compute.manager [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Attaching volume 67eb75f4-db80-4665-9245-f840bf9ad6af to /dev/vdb
Aug 14 18:27:30 user nova-compute[73078]: DEBUG os_brick.utils [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:27:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:30 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19f1489-2e7b-424d-9f51-97b0892d25f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:30 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdccd094-e8a7-4c4f-bfa0-0df402546062]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:30 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ec5a1d-784d-40ed-8a83-09426aa694f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:30 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4988c90a-dcb7-4f7a-97a8-c95372257784]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:27:30 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:27:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:27:30 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:27:30 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[633334bf-96b7-4510-bc95-b0e41d0adb9b]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:30 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:27:30 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:27:30 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:27:30 user nova-compute[73078]: DEBUG os_brick.utils [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:27:30 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Updating existing volume attachment record: 05beee9d-e5f4-49d7-ab63-337ef0c48f86 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LDxFBCkT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:27:31 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:27:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:27:31 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:27:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:27:31 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:27:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0a857b-1e89-46b2-af24-f40a7016cbd0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:27:31 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[90975ba7-03f7-4f5e-85c6-9d8859e1150e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017] added
Aug 14 18:27:31 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d621aa-e6cb-4b40-b2f2-0b265a51328b]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[effcc07d-3652-4046-bce2-3c361900176a]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LDxFBCkT {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LDxFBCkT" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[359ad63c-94bc-4bc3-9a01-737e2a09097a]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LDxFBCkT'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d2510e-b92e-42c2-abb9-b1b64aca9e22]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dbfbec-8320-4a88-93c8-cd40b7e5447e]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:27:31 user nova-compute[73078]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:27:31 user nova-compute[73078]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b (non-flash)
Aug 14 18:27:31 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:27:31 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:27:31 user nova-compute[73078]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:27:31 user nova-compute[73078]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b (non-flash)
Aug 14 18:27:31 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:27:31 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[352227b4-ab66-4bdf-a0c9-a3f93f52957a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017, portal: 172.16.0.220,3260]
Aug 14 18:27:31 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017, portal: 172.16.0.220,3260] successful.
Aug 14 18:27:31 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45d0687-9a17-40c4-8357-853d2161884f]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3bff22-6075-4918-8979-8ba097e2a9a7]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:27:31 user nova-compute[73078]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:27:31 user nova-compute[73078]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b (non-flash)
Aug 14 18:27:31 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:27:31 user nova-compute[73078]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017 (non-flash)
Aug 14 18:27:31 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:27:31 user nova-compute[73078]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:27:31 user nova-compute[73078]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b (non-flash)
Aug 14 18:27:31 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:27:31 user nova-compute[73078]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017 (non-flash)
Aug 14 18:27:31 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] HCTL ('37', '-', '-', 0) found on session 43 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cbee1d-43cd-4309-a7f6-af19a77c2c11]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Searching for a device in session 43 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:27:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LDxFBCkT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:27:32 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692037637.0740378, 3c840309-9884-4c8a-a6ee-1acd44f32c4c => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:27:32 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] VM Stopped (Lifecycle Event)
Aug 14 18:27:32 user nova-compute[73078]: DEBUG nova.compute.manager [None req-ae161de5-740a-4a97-8224-3120f14cf36e None None] [instance: 3c840309-9884-4c8a-a6ee-1acd44f32c4c] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:27:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:27:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '23132663431616138', 'path': '/dev/sdf'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:27:32 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132663431616138', 'path': '/dev/sdf'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:27:32 user nova-compute[73078]: DEBUG nova.objects.instance [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lazy-loading 'flavor' on Instance uuid ef083dd3-67d6-48a8-846a-7fe6c6b32d5c {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:27:32 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 18:27:32 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:27:32 user nova-compute[73078]:   <source dev="/dev/sdf"/>
Aug 14 18:27:32 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:27:32 user nova-compute[73078]:   <serial>7813589e-fbc5-4ca7-9bc3-4cd70ed4c017</serial>
Aug 14 18:27:32 user nova-compute[73078]: </disk>
Aug 14 18:27:32 user nova-compute[73078]:  {{(pid=73078) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 18:27:33 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:27:33 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:27:33 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] No VIF found with MAC fa:16:3e:17:fe:f7, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:27:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-fb779ae3-24e6-4336-87a0-1147747b7c89 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "ef083dd3-67d6-48a8-846a-7fe6c6b32d5c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.628s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-13b0fa73-1487-4099-b49a-1379bcd68723 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Acquiring lock "ef083dd3-67d6-48a8-846a-7fe6c6b32d5c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-13b0fa73-1487-4099-b49a-1379bcd68723 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "ef083dd3-67d6-48a8-846a-7fe6c6b32d5c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:35 user nova-compute[73078]: INFO nova.compute.manager [None req-13b0fa73-1487-4099-b49a-1379bcd68723 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Detaching volume 7813589e-fbc5-4ca7-9bc3-4cd70ed4c017
Aug 14 18:27:35 user nova-compute[73078]: INFO nova.virt.block_device [None req-13b0fa73-1487-4099-b49a-1379bcd68723 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Attempting to driver detach volume 7813589e-fbc5-4ca7-9bc3-4cd70ed4c017 from mountpoint /dev/vdb
Aug 14 18:27:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-13b0fa73-1487-4099-b49a-1379bcd68723 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Attempting to detach device vdb from instance ef083dd3-67d6-48a8-846a-7fe6c6b32d5c from the persistent domain config. {{(pid=73078) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 18:27:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-13b0fa73-1487-4099-b49a-1379bcd68723 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:27:35 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:27:35 user nova-compute[73078]:   <source dev="/dev/sdf"/>
Aug 14 18:27:35 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:27:35 user nova-compute[73078]:   <serial>7813589e-fbc5-4ca7-9bc3-4cd70ed4c017</serial>
Aug 14 18:27:35 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:27:35 user nova-compute[73078]: </disk>
Aug 14 18:27:35 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:27:35 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-13b0fa73-1487-4099-b49a-1379bcd68723 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Successfully detached device vdb from instance ef083dd3-67d6-48a8-846a-7fe6c6b32d5c from the persistent domain config.
Aug 14 18:27:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-13b0fa73-1487-4099-b49a-1379bcd68723 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ef083dd3-67d6-48a8-846a-7fe6c6b32d5c from the live domain config. {{(pid=73078) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 18:27:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-13b0fa73-1487-4099-b49a-1379bcd68723 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:27:35 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:27:35 user nova-compute[73078]:   <source dev="/dev/sdf"/>
Aug 14 18:27:35 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:27:35 user nova-compute[73078]:   <serial>7813589e-fbc5-4ca7-9bc3-4cd70ed4c017</serial>
Aug 14 18:27:35 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:27:35 user nova-compute[73078]: </disk>
Aug 14 18:27:35 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Received event <DeviceRemovedEvent: 1692037656.1141045, ef083dd3-67d6-48a8-846a-7fe6c6b32d5c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73078) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-13b0fa73-1487-4099-b49a-1379bcd68723 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ef083dd3-67d6-48a8-846a-7fe6c6b32d5c {{(pid=73078) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 18:27:36 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-13b0fa73-1487-4099-b49a-1379bcd68723 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Successfully detached device vdb from instance ef083dd3-67d6-48a8-846a-7fe6c6b32d5c from the live domain config.
Aug 14 18:27:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13b0fa73-1487-4099-b49a-1379bcd68723 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b0fa73-1487-4099-b49a-1379bcd68723 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LDxFBCkT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:27:36 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-13b0fa73-1487-4099-b49a-1379bcd68723 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:27:36 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-13b0fa73-1487-4099-b49a-1379bcd68723 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-13b0fa73-1487-4099-b49a-1379bcd68723 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b0fa73-1487-4099-b49a-1379bcd68723 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb57d21-d500-4eee-a98e-f3480e15ec2e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a0ab03-a50d-466d-a8a2-fe26958b9fe7]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b0fa73-1487-4099-b49a-1379bcd68723 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:27:36 user nova-compute[73078]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:27:36 user nova-compute[73078]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b (non-flash)
Aug 14 18:27:36 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:27:36 user nova-compute[73078]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017 (non-flash)
Aug 14 18:27:36 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b0fa73-1487-4099-b49a-1379bcd68723 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:27:36 user nova-compute[73078]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:27:36 user nova-compute[73078]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b (non-flash)
Aug 14 18:27:36 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:27:36 user nova-compute[73078]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017 (non-flash)
Aug 14 18:27:36 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b0fa73-1487-4099-b49a-1379bcd68723 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9547c3ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017'): ({'sdf'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-13b0fa73-1487-4099-b49a-1379bcd68723 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Removing single pathed devices sdf {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[804f065e-7f14-4149-8391-ef3da51c16f3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[78429ba3-5554-43b5-8ddd-b9587e0c97b4]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-13b0fa73-1487-4099-b49a-1379bcd68723 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Flushing IO for device /dev/sdf {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2de107-ba93-43c1-9e32-2dc8420e124d]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-13b0fa73-1487-4099-b49a-1379bcd68723 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.054s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8b37d8-ef78-4979-adb1-379231051cf6]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-13b0fa73-1487-4099-b49a-1379bcd68723 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-13b0fa73-1487-4099-b49a-1379bcd68723 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] SCSI volumes sdf have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b0fa73-1487-4099-b49a-1379bcd68723 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e51948-80c1-4023-a84f-d0e1303ccce7]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b0fa73-1487-4099-b49a-1379bcd68723 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a659fac-ace6-425b-bd72-be3efc1a9f6c]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b0fa73-1487-4099-b49a-1379bcd68723 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017, portal: 172.16.0.220,3260]
Aug 14 18:27:36 user nova-compute[73078]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017, portal: 172.16.0.220,3260] successful.
Aug 14 18:27:36 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7813589e-fbc5-4ca7-9bc3-4cd70ed4c017 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35aa2b2-7384-4de6-a6bc-1f1848285dd2]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b0fa73-1487-4099-b49a-1379bcd68723 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-13b0fa73-1487-4099-b49a-1379bcd68723 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b0fa73-1487-4099-b49a-1379bcd68723 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] <== disconnect_volume: return (306ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:27:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13b0fa73-1487-4099-b49a-1379bcd68723 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:27:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:37 user nova-compute[73078]: DEBUG nova.objects.instance [None req-13b0fa73-1487-4099-b49a-1379bcd68723 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lazy-loading 'flavor' on Instance uuid ef083dd3-67d6-48a8-846a-7fe6c6b32d5c {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:27:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-13b0fa73-1487-4099-b49a-1379bcd68723 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "ef083dd3-67d6-48a8-846a-7fe6c6b32d5c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.714s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dtKgBNaM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:27:40 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:27:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:27:40 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:27:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:27:40 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:27:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a09a82-ade6-437a-9ec6-579397e7e587]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:27:40 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31febf9-08f6-4c39-8cf9-655552c9e64e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af] added
Aug 14 18:27:40 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e1a0cb-3757-456d-987a-fc172b3690f4]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1aae6d-c02f-4df2-980e-1b16cdf7b6a4]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dtKgBNaM {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dtKgBNaM" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3f4dd8-4106-4e35-9944-950ad50d8403]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dtKgBNaM'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3ccb16-e37f-44e8-8797-59c664d83111]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e9eb9a-ccc8-4239-966d-efa19cc57bb0]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:27:40 user nova-compute[73078]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:27:40 user nova-compute[73078]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b (non-flash)
Aug 14 18:27:40 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:27:40 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:27:40 user nova-compute[73078]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:27:40 user nova-compute[73078]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b (non-flash)
Aug 14 18:27:40 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:27:40 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77a2c69-349b-452e-a207-737c62d76a75]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af, portal: 172.16.0.220,3260]
Aug 14 18:27:40 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af, portal: 172.16.0.220,3260] successful.
Aug 14 18:27:40 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[441407fc-e895-4362-9c74-93ec1be46279]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[db01cf05-a4f4-410c-83de-e4ee4ed1fee6]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:27:40 user nova-compute[73078]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:27:40 user nova-compute[73078]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b (non-flash)
Aug 14 18:27:40 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:27:40 user nova-compute[73078]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af (non-flash)
Aug 14 18:27:40 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:27:40 user nova-compute[73078]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:27:40 user nova-compute[73078]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b (non-flash)
Aug 14 18:27:40 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:27:40 user nova-compute[73078]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af (non-flash)
Aug 14 18:27:40 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] HCTL ('37', '-', '-', 0) found on session 44 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab40cecc-ca92-44b2-a61d-affce60e4803]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Searching for a device in session 44 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:27:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dtKgBNaM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:27:41 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:27:41 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23064326631343634', 'path': '/dev/sdf'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:27:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064326631343634', 'path': '/dev/sdf'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:27:41 user nova-compute[73078]: DEBUG nova.objects.instance [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lazy-loading 'flavor' on Instance uuid 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:27:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 18:27:41 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:27:41 user nova-compute[73078]:   <source dev="/dev/sdf"/>
Aug 14 18:27:41 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:27:41 user nova-compute[73078]:   <serial>67eb75f4-db80-4665-9245-f840bf9ad6af</serial>
Aug 14 18:27:41 user nova-compute[73078]: </disk>
Aug 14 18:27:41 user nova-compute[73078]:  {{(pid=73078) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 18:27:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:27:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:27:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] No VIF found with MAC fa:16:3e:e3:20:8e, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:27:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-eb452395-d45d-43f2-854a-00fdac0ec678 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.700s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:43 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Acquiring lock "2f960239-8deb-4d9f-9cab-eea0274aca38" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:43 user nova-compute[73078]: DEBUG nova.compute.manager [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:27:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:44 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:27:44 user nova-compute[73078]: INFO nova.compute.claims [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Claim successful on node user
Aug 14 18:27:44 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:27:44 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:27:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.395s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:44 user nova-compute[73078]: DEBUG nova.compute.manager [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:27:44 user nova-compute[73078]: DEBUG nova.compute.manager [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:27:44 user nova-compute[73078]: DEBUG nova.network.neutron [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:27:44 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:27:44 user nova-compute[73078]: DEBUG nova.compute.manager [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:27:44 user nova-compute[73078]: DEBUG nova.policy [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '30953ec1cba84ed39611a8801e38dc8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c449c8c411c34206af9251f78b912565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:27:44 user nova-compute[73078]: DEBUG nova.compute.manager [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:27:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:27:44 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Creating image(s)
Aug 14 18:27:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "/opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "/opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.182s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.175s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk 1073741824" returned: 0 in 0.051s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:45 user nova-compute[73078]: DEBUG nova.network.neutron [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Successfully created port: 665b631d-4caf-4f3f-8c30-3a8ab77e79c0 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:27:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.189s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:45 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:27:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "ef7587b9-995f-4b71-829d-223c6f520527" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "ef7587b9-995f-4b71-829d-223c6f520527" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:45 user nova-compute[73078]: DEBUG nova.compute.manager [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:27:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:45 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:27:45 user nova-compute[73078]: INFO nova.compute.claims [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Claim successful on node user
Aug 14 18:27:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:45 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Cannot resize image /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:27:45 user nova-compute[73078]: DEBUG nova.objects.instance [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lazy-loading 'migration_context' on Instance uuid 2f960239-8deb-4d9f-9cab-eea0274aca38 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:27:45 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:27:45 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Ensure instance console log exists: /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:27:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:45 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:27:45 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:27:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.452s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:45 user nova-compute[73078]: DEBUG nova.compute.manager [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.network.neutron [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Successfully updated port: 665b631d-4caf-4f3f-8c30-3a8ab77e79c0 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.compute.manager [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.network.neutron [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: ef7587b9-995f-4b71-829d-223c6f520527] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Acquiring lock "refresh_cache-2f960239-8deb-4d9f-9cab-eea0274aca38" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Acquired lock "refresh_cache-2f960239-8deb-4d9f-9cab-eea0274aca38" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.network.neutron [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:27:46 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.compute.manager [req-f65ba184-2b06-497e-8409-c3d3e4f6697e req-b1a65409-3a26-4c1b-a7dc-d85bf093c7f4 service nova] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Received event network-changed-665b631d-4caf-4f3f-8c30-3a8ab77e79c0 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.compute.manager [req-f65ba184-2b06-497e-8409-c3d3e4f6697e req-b1a65409-3a26-4c1b-a7dc-d85bf093c7f4 service nova] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Refreshing instance network info cache due to event network-changed-665b631d-4caf-4f3f-8c30-3a8ab77e79c0. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-f65ba184-2b06-497e-8409-c3d3e4f6697e req-b1a65409-3a26-4c1b-a7dc-d85bf093c7f4 service nova] Acquiring lock "refresh_cache-2f960239-8deb-4d9f-9cab-eea0274aca38" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.compute.manager [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.network.neutron [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.policy [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a3c5d292e9594e4aadad9ac72b9455ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1391a0a2167745348384e5890e6c22db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.compute.manager [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:27:46 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Creating image(s)
Aug 14 18:27:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "/opt/stack/data/nova/instances/ef7587b9-995f-4b71-829d-223c6f520527/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "/opt/stack/data/nova/instances/ef7587b9-995f-4b71-829d-223c6f520527/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "/opt/stack/data/nova/instances/ef7587b9-995f-4b71-829d-223c6f520527/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.182s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.network.neutron [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Updating instance_info_cache with network_info: [{"id": "665b631d-4caf-4f3f-8c30-3a8ab77e79c0", "address": "fa:16:3e:38:ed:9c", "network": {"id": "9231db47-733a-46df-876b-ee8ed8157a6e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1021535791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c449c8c411c34206af9251f78b912565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665b631d-4c", "ovs_interfaceid": "665b631d-4caf-4f3f-8c30-3a8ab77e79c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Releasing lock "refresh_cache-2f960239-8deb-4d9f-9cab-eea0274aca38" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.compute.manager [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Instance network_info: |[{"id": "665b631d-4caf-4f3f-8c30-3a8ab77e79c0", "address": "fa:16:3e:38:ed:9c", "network": {"id": "9231db47-733a-46df-876b-ee8ed8157a6e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1021535791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c449c8c411c34206af9251f78b912565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665b631d-4c", "ovs_interfaceid": "665b631d-4caf-4f3f-8c30-3a8ab77e79c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-f65ba184-2b06-497e-8409-c3d3e4f6697e req-b1a65409-3a26-4c1b-a7dc-d85bf093c7f4 service nova] Acquired lock "refresh_cache-2f960239-8deb-4d9f-9cab-eea0274aca38" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.network.neutron [req-f65ba184-2b06-497e-8409-c3d3e4f6697e req-b1a65409-3a26-4c1b-a7dc-d85bf093c7f4 service nova] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Refreshing network info cache for port 665b631d-4caf-4f3f-8c30-3a8ab77e79c0 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Start _get_guest_xml network_info=[{"id": "665b631d-4caf-4f3f-8c30-3a8ab77e79c0", "address": "fa:16:3e:38:ed:9c", "network": {"id": "9231db47-733a-46df-876b-ee8ed8157a6e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1021535791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c449c8c411c34206af9251f78b912565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665b631d-4c", "ovs_interfaceid": "665b631d-4caf-4f3f-8c30-3a8ab77e79c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:27:46 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:27:46 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:27:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-410665744',display_name='tempest-SnapshotDataIntegrityTests-server-410665744',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-410665744',id=36,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUrkv6bX46z7g+M1+PLp78HR90ICrwLqzcyof00hU4DyyTheIJV2AKYz8gfNSDvZ6lfz468xmJtlpUTwTB5Qokh1jjndsK0ZvTQkLWQvgQR+G8YTvfo7/o1I2NCiYEqhQ==',key_name='tempest-keypair-183526759',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c449c8c411c34206af9251f78b912565',ramdisk_id='',reservation_id='r-46m5q4vj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1220717353',owner_user_name='tempest-SnapshotDataIntegrityTests-1220717353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:27:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30953ec1cba84ed39611a8801e38dc8c',uuid=2f960239-8deb-4d9f-9cab-eea0274aca38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "665b631d-4caf-4f3f-8c30-3a8ab77e79c0", "address": "fa:16:3e:38:ed:9c", "network": {"id": "9231db47-733a-46df-876b-ee8ed8157a6e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1021535791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c449c8c411c34206af9251f78b912565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665b631d-4c", "ovs_interfaceid": "665b631d-4caf-4f3f-8c30-3a8ab77e79c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Converting VIF {"id": "665b631d-4caf-4f3f-8c30-3a8ab77e79c0", "address": "fa:16:3e:38:ed:9c", "network": {"id": "9231db47-733a-46df-876b-ee8ed8157a6e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1021535791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c449c8c411c34206af9251f78b912565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665b631d-4c", "ovs_interfaceid": "665b631d-4caf-4f3f-8c30-3a8ab77e79c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:ed:9c,bridge_name='br-int',has_traffic_filtering=True,id=665b631d-4caf-4f3f-8c30-3a8ab77e79c0,network=Network(9231db47-733a-46df-876b-ee8ed8157a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665b631d-4c') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.objects.instance [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f960239-8deb-4d9f-9cab-eea0274aca38 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:27:46 user nova-compute[73078]:   <uuid>2f960239-8deb-4d9f-9cab-eea0274aca38</uuid>
Aug 14 18:27:46 user nova-compute[73078]:   <name>instance-00000024</name>
Aug 14 18:27:46 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:27:46 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:27:46 user nova-compute[73078]:   <metadata>
Aug 14 18:27:46 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:27:46 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:27:46 user nova-compute[73078]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-410665744</nova:name>
Aug 14 18:27:46 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:27:46</nova:creationTime>
Aug 14 18:27:46 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:27:46 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:27:46 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:27:46 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:27:46 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:27:46 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:27:46 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:27:46 user nova-compute[73078]:       <nova:owner>
Aug 14 18:27:46 user nova-compute[73078]:         <nova:user uuid="30953ec1cba84ed39611a8801e38dc8c">tempest-SnapshotDataIntegrityTests-1220717353-project-member</nova:user>
Aug 14 18:27:46 user nova-compute[73078]:         <nova:project uuid="c449c8c411c34206af9251f78b912565">tempest-SnapshotDataIntegrityTests-1220717353</nova:project>
Aug 14 18:27:46 user nova-compute[73078]:       </nova:owner>
Aug 14 18:27:46 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:27:46 user nova-compute[73078]:       <nova:ports>
Aug 14 18:27:46 user nova-compute[73078]:         <nova:port uuid="665b631d-4caf-4f3f-8c30-3a8ab77e79c0">
Aug 14 18:27:46 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 18:27:46 user nova-compute[73078]:         </nova:port>
Aug 14 18:27:46 user nova-compute[73078]:       </nova:ports>
Aug 14 18:27:46 user nova-compute[73078]:     </nova:instance>
Aug 14 18:27:46 user nova-compute[73078]:   </metadata>
Aug 14 18:27:46 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:27:46 user nova-compute[73078]:     <system>
Aug 14 18:27:46 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:27:46 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:27:46 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:27:46 user nova-compute[73078]:       <entry name="serial">2f960239-8deb-4d9f-9cab-eea0274aca38</entry>
Aug 14 18:27:46 user nova-compute[73078]:       <entry name="uuid">2f960239-8deb-4d9f-9cab-eea0274aca38</entry>
Aug 14 18:27:46 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:27:46 user nova-compute[73078]:     </system>
Aug 14 18:27:46 user nova-compute[73078]:   </sysinfo>
Aug 14 18:27:46 user nova-compute[73078]:   <os>
Aug 14 18:27:46 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:27:46 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:27:46 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:27:46 user nova-compute[73078]:   </os>
Aug 14 18:27:46 user nova-compute[73078]:   <features>
Aug 14 18:27:46 user nova-compute[73078]:     <acpi/>
Aug 14 18:27:46 user nova-compute[73078]:     <apic/>
Aug 14 18:27:46 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:27:46 user nova-compute[73078]:   </features>
Aug 14 18:27:46 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:27:46 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:27:46 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:27:46 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:27:46 user nova-compute[73078]:   </clock>
Aug 14 18:27:46 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:27:46 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:27:46 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:27:46 user nova-compute[73078]:   </cpu>
Aug 14 18:27:46 user nova-compute[73078]:   <devices>
Aug 14 18:27:46 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:27:46 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:27:46 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk"/>
Aug 14 18:27:46 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:27:46 user nova-compute[73078]:     </disk>
Aug 14 18:27:46 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:27:46 user nova-compute[73078]:       <mac address="fa:16:3e:38:ed:9c"/>
Aug 14 18:27:46 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:27:46 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:27:46 user nova-compute[73078]:       <target dev="tap665b631d-4c"/>
Aug 14 18:27:46 user nova-compute[73078]:     </interface>
Aug 14 18:27:46 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:27:46 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/console.log" append="off"/>
Aug 14 18:27:46 user nova-compute[73078]:     </serial>
Aug 14 18:27:46 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:27:46 user nova-compute[73078]:     <video>
Aug 14 18:27:46 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:27:46 user nova-compute[73078]:     </video>
Aug 14 18:27:46 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:27:46 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:27:46 user nova-compute[73078]:     </rng>
Aug 14 18:27:46 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:27:46 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:27:46 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:27:46 user nova-compute[73078]:     </memballoon>
Aug 14 18:27:46 user nova-compute[73078]:   </devices>
Aug 14 18:27:46 user nova-compute[73078]: </domain>
Aug 14 18:27:46 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:27:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-410665744',display_name='tempest-SnapshotDataIntegrityTests-server-410665744',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-410665744',id=36,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUrkv6bX46z7g+M1+PLp78HR90ICrwLqzcyof00hU4DyyTheIJV2AKYz8gfNSDvZ6lfz468xmJtlpUTwTB5Qokh1jjndsK0ZvTQkLWQvgQR+G8YTvfo7/o1I2NCiYEqhQ==',key_name='tempest-keypair-183526759',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c449c8c411c34206af9251f78b912565',ramdisk_id='',reservation_id='r-46m5q4vj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1220717353',owner_user_name='tempest-SnapshotDataIntegrityTests-1220717353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:27:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30953ec1cba84ed39611a8801e38dc8c',uuid=2f960239-8deb-4d9f-9cab-eea0274aca38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "665b631d-4caf-4f3f-8c30-3a8ab77e79c0", "address": "fa:16:3e:38:ed:9c", "network": {"id": "9231db47-733a-46df-876b-ee8ed8157a6e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1021535791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c449c8c411c34206af9251f78b912565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665b631d-4c", "ovs_interfaceid": "665b631d-4caf-4f3f-8c30-3a8ab77e79c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Converting VIF {"id": "665b631d-4caf-4f3f-8c30-3a8ab77e79c0", "address": "fa:16:3e:38:ed:9c", "network": {"id": "9231db47-733a-46df-876b-ee8ed8157a6e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1021535791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c449c8c411c34206af9251f78b912565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665b631d-4c", "ovs_interfaceid": "665b631d-4caf-4f3f-8c30-3a8ab77e79c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:ed:9c,bridge_name='br-int',has_traffic_filtering=True,id=665b631d-4caf-4f3f-8c30-3a8ab77e79c0,network=Network(9231db47-733a-46df-876b-ee8ed8157a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665b631d-4c') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG os_vif [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:ed:9c,bridge_name='br-int',has_traffic_filtering=True,id=665b631d-4caf-4f3f-8c30-3a8ab77e79c0,network=Network(9231db47-733a-46df-876b-ee8ed8157a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665b631d-4c') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.181s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/ef7587b9-995f-4b71-829d-223c6f520527/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap665b631d-4c, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap665b631d-4c, col_values=(('external_ids', {'iface-id': '665b631d-4caf-4f3f-8c30-3a8ab77e79c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:ed:9c', 'vm-uuid': '2f960239-8deb-4d9f-9cab-eea0274aca38'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:46 user nova-compute[73078]: INFO os_vif [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:ed:9c,bridge_name='br-int',has_traffic_filtering=True,id=665b631d-4caf-4f3f-8c30-3a8ab77e79c0,network=Network(9231db47-733a-46df-876b-ee8ed8157a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665b631d-4c')
Aug 14 18:27:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/ef7587b9-995f-4b71-829d-223c6f520527/disk 1073741824" returned: 0 in 0.089s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] No VIF found with MAC fa:16:3e:38:ed:9c, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.network.neutron [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Successfully created port: ca00b279-ef6b-4198-8208-0a8fb9cda4be {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.184s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ef7587b9-995f-4b71-829d-223c6f520527/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7587b9-995f-4b71-829d-223c6f520527/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.network.neutron [req-f65ba184-2b06-497e-8409-c3d3e4f6697e req-b1a65409-3a26-4c1b-a7dc-d85bf093c7f4 service nova] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Updated VIF entry in instance network info cache for port 665b631d-4caf-4f3f-8c30-3a8ab77e79c0. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.network.neutron [req-f65ba184-2b06-497e-8409-c3d3e4f6697e req-b1a65409-3a26-4c1b-a7dc-d85bf093c7f4 service nova] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Updating instance_info_cache with network_info: [{"id": "665b631d-4caf-4f3f-8c30-3a8ab77e79c0", "address": "fa:16:3e:38:ed:9c", "network": {"id": "9231db47-733a-46df-876b-ee8ed8157a6e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1021535791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c449c8c411c34206af9251f78b912565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665b631d-4c", "ovs_interfaceid": "665b631d-4caf-4f3f-8c30-3a8ab77e79c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-f65ba184-2b06-497e-8409-c3d3e4f6697e req-b1a65409-3a26-4c1b-a7dc-d85bf093c7f4 service nova] Releasing lock "refresh_cache-2f960239-8deb-4d9f-9cab-eea0274aca38" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7587b9-995f-4b71-829d-223c6f520527/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Cannot resize image /opt/stack/data/nova/instances/ef7587b9-995f-4b71-829d-223c6f520527/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:27:46 user nova-compute[73078]: DEBUG nova.objects.instance [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lazy-loading 'migration_context' on Instance uuid ef7587b9-995f-4b71-829d-223c6f520527 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:27:47 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:27:47 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Ensure instance console log exists: /opt/stack/data/nova/instances/ef7587b9-995f-4b71-829d-223c6f520527/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:27:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:47 user nova-compute[73078]: DEBUG nova.network.neutron [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Successfully updated port: ca00b279-ef6b-4198-8208-0a8fb9cda4be {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:27:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "refresh_cache-ef7587b9-995f-4b71-829d-223c6f520527" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:27:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquired lock "refresh_cache-ef7587b9-995f-4b71-829d-223c6f520527" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:27:47 user nova-compute[73078]: DEBUG nova.network.neutron [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:27:47 user nova-compute[73078]: DEBUG nova.network.neutron [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:27:47 user nova-compute[73078]: DEBUG nova.network.neutron [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Updating instance_info_cache with network_info: [{"id": "ca00b279-ef6b-4198-8208-0a8fb9cda4be", "address": "fa:16:3e:d9:11:0e", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca00b279-ef", "ovs_interfaceid": "ca00b279-ef6b-4198-8208-0a8fb9cda4be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:27:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Releasing lock "refresh_cache-ef7587b9-995f-4b71-829d-223c6f520527" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG nova.compute.manager [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Instance network_info: |[{"id": "ca00b279-ef6b-4198-8208-0a8fb9cda4be", "address": "fa:16:3e:d9:11:0e", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca00b279-ef", "ovs_interfaceid": "ca00b279-ef6b-4198-8208-0a8fb9cda4be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Start _get_guest_xml network_info=[{"id": "ca00b279-ef6b-4198-8208-0a8fb9cda4be", "address": "fa:16:3e:d9:11:0e", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca00b279-ef", "ovs_interfaceid": "ca00b279-ef6b-4198-8208-0a8fb9cda4be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG nova.compute.manager [req-17c076a0-8a97-48be-b538-25466187280e req-0293a588-6a00-4b31-a068-8c34904348cd service nova] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Received event network-changed-ca00b279-ef6b-4198-8208-0a8fb9cda4be {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG nova.compute.manager [req-17c076a0-8a97-48be-b538-25466187280e req-0293a588-6a00-4b31-a068-8c34904348cd service nova] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Refreshing instance network info cache due to event network-changed-ca00b279-ef6b-4198-8208-0a8fb9cda4be. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-17c076a0-8a97-48be-b538-25466187280e req-0293a588-6a00-4b31-a068-8c34904348cd service nova] Acquiring lock "refresh_cache-ef7587b9-995f-4b71-829d-223c6f520527" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-17c076a0-8a97-48be-b538-25466187280e req-0293a588-6a00-4b31-a068-8c34904348cd service nova] Acquired lock "refresh_cache-ef7587b9-995f-4b71-829d-223c6f520527" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG nova.network.neutron [req-17c076a0-8a97-48be-b538-25466187280e req-0293a588-6a00-4b31-a068-8c34904348cd service nova] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Refreshing network info cache for port ca00b279-ef6b-4198-8208-0a8fb9cda4be {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:27:48 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:27:48 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:27:48 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:27:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1796655114',display_name='tempest-AttachVolumeNegativeTest-server-1796655114',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1796655114',id=37,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVkjDnvjE6VvF4tOc2pZbOtUBgw+ft9MSEGF3r6fGF11bOlEPiuBz5n1cuiXGRQYHzt45bgnQW91R3SuSjKXd2kdm9MtQiH1ZhmFgO0wO0XK3N02EsB6RVAJ/8QuY0Xnw==',key_name='tempest-keypair-1441417978',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1391a0a2167745348384e5890e6c22db',ramdisk_id='',reservation_id='r-k75faco7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1671295372',owner_user_name='tempest-AttachVolumeNegativeTest-1671295372-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:27:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3c5d292e9594e4aadad9ac72b9455ed',uuid=ef7587b9-995f-4b71-829d-223c6f520527,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca00b279-ef6b-4198-8208-0a8fb9cda4be", "address": "fa:16:3e:d9:11:0e", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca00b279-ef", "ovs_interfaceid": "ca00b279-ef6b-4198-8208-0a8fb9cda4be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Converting VIF {"id": "ca00b279-ef6b-4198-8208-0a8fb9cda4be", "address": "fa:16:3e:d9:11:0e", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca00b279-ef", "ovs_interfaceid": "ca00b279-ef6b-4198-8208-0a8fb9cda4be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:11:0e,bridge_name='br-int',has_traffic_filtering=True,id=ca00b279-ef6b-4198-8208-0a8fb9cda4be,network=Network(88e922e4-ec89-460a-954d-aff20a41293c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca00b279-ef') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG nova.objects.instance [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lazy-loading 'pci_devices' on Instance uuid ef7587b9-995f-4b71-829d-223c6f520527 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: ef7587b9-995f-4b71-829d-223c6f520527] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:27:48 user nova-compute[73078]:   <uuid>ef7587b9-995f-4b71-829d-223c6f520527</uuid>
Aug 14 18:27:48 user nova-compute[73078]:   <name>instance-00000025</name>
Aug 14 18:27:48 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:27:48 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:27:48 user nova-compute[73078]:   <metadata>
Aug 14 18:27:48 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:27:48 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:27:48 user nova-compute[73078]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1796655114</nova:name>
Aug 14 18:27:48 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:27:48</nova:creationTime>
Aug 14 18:27:48 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:27:48 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:27:48 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:27:48 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:27:48 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:27:48 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:27:48 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:27:48 user nova-compute[73078]:       <nova:owner>
Aug 14 18:27:48 user nova-compute[73078]:         <nova:user uuid="a3c5d292e9594e4aadad9ac72b9455ed">tempest-AttachVolumeNegativeTest-1671295372-project-member</nova:user>
Aug 14 18:27:48 user nova-compute[73078]:         <nova:project uuid="1391a0a2167745348384e5890e6c22db">tempest-AttachVolumeNegativeTest-1671295372</nova:project>
Aug 14 18:27:48 user nova-compute[73078]:       </nova:owner>
Aug 14 18:27:48 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:27:48 user nova-compute[73078]:       <nova:ports>
Aug 14 18:27:48 user nova-compute[73078]:         <nova:port uuid="ca00b279-ef6b-4198-8208-0a8fb9cda4be">
Aug 14 18:27:48 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 18:27:48 user nova-compute[73078]:         </nova:port>
Aug 14 18:27:48 user nova-compute[73078]:       </nova:ports>
Aug 14 18:27:48 user nova-compute[73078]:     </nova:instance>
Aug 14 18:27:48 user nova-compute[73078]:   </metadata>
Aug 14 18:27:48 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:27:48 user nova-compute[73078]:     <system>
Aug 14 18:27:48 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:27:48 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:27:48 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:27:48 user nova-compute[73078]:       <entry name="serial">ef7587b9-995f-4b71-829d-223c6f520527</entry>
Aug 14 18:27:48 user nova-compute[73078]:       <entry name="uuid">ef7587b9-995f-4b71-829d-223c6f520527</entry>
Aug 14 18:27:48 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:27:48 user nova-compute[73078]:     </system>
Aug 14 18:27:48 user nova-compute[73078]:   </sysinfo>
Aug 14 18:27:48 user nova-compute[73078]:   <os>
Aug 14 18:27:48 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:27:48 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:27:48 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:27:48 user nova-compute[73078]:   </os>
Aug 14 18:27:48 user nova-compute[73078]:   <features>
Aug 14 18:27:48 user nova-compute[73078]:     <acpi/>
Aug 14 18:27:48 user nova-compute[73078]:     <apic/>
Aug 14 18:27:48 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:27:48 user nova-compute[73078]:   </features>
Aug 14 18:27:48 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:27:48 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:27:48 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:27:48 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:27:48 user nova-compute[73078]:   </clock>
Aug 14 18:27:48 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:27:48 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:27:48 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:27:48 user nova-compute[73078]:   </cpu>
Aug 14 18:27:48 user nova-compute[73078]:   <devices>
Aug 14 18:27:48 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:27:48 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:27:48 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/ef7587b9-995f-4b71-829d-223c6f520527/disk"/>
Aug 14 18:27:48 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:27:48 user nova-compute[73078]:     </disk>
Aug 14 18:27:48 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:27:48 user nova-compute[73078]:       <mac address="fa:16:3e:d9:11:0e"/>
Aug 14 18:27:48 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:27:48 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:27:48 user nova-compute[73078]:       <target dev="tapca00b279-ef"/>
Aug 14 18:27:48 user nova-compute[73078]:     </interface>
Aug 14 18:27:48 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:27:48 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/ef7587b9-995f-4b71-829d-223c6f520527/console.log" append="off"/>
Aug 14 18:27:48 user nova-compute[73078]:     </serial>
Aug 14 18:27:48 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:27:48 user nova-compute[73078]:     <video>
Aug 14 18:27:48 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:27:48 user nova-compute[73078]:     </video>
Aug 14 18:27:48 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:27:48 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:27:48 user nova-compute[73078]:     </rng>
Aug 14 18:27:48 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:27:48 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:27:48 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:27:48 user nova-compute[73078]:     </memballoon>
Aug 14 18:27:48 user nova-compute[73078]:   </devices>
Aug 14 18:27:48 user nova-compute[73078]: </domain>
Aug 14 18:27:48 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:27:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1796655114',display_name='tempest-AttachVolumeNegativeTest-server-1796655114',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1796655114',id=37,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVkjDnvjE6VvF4tOc2pZbOtUBgw+ft9MSEGF3r6fGF11bOlEPiuBz5n1cuiXGRQYHzt45bgnQW91R3SuSjKXd2kdm9MtQiH1ZhmFgO0wO0XK3N02EsB6RVAJ/8QuY0Xnw==',key_name='tempest-keypair-1441417978',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1391a0a2167745348384e5890e6c22db',ramdisk_id='',reservation_id='r-k75faco7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1671295372',owner_user_name='tempest-AttachVolumeNegativeTest-1671295372-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:27:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3c5d292e9594e4aadad9ac72b9455ed',uuid=ef7587b9-995f-4b71-829d-223c6f520527,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca00b279-ef6b-4198-8208-0a8fb9cda4be", "address": "fa:16:3e:d9:11:0e", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca00b279-ef", "ovs_interfaceid": "ca00b279-ef6b-4198-8208-0a8fb9cda4be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Converting VIF {"id": "ca00b279-ef6b-4198-8208-0a8fb9cda4be", "address": "fa:16:3e:d9:11:0e", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca00b279-ef", "ovs_interfaceid": "ca00b279-ef6b-4198-8208-0a8fb9cda4be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:11:0e,bridge_name='br-int',has_traffic_filtering=True,id=ca00b279-ef6b-4198-8208-0a8fb9cda4be,network=Network(88e922e4-ec89-460a-954d-aff20a41293c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca00b279-ef') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG os_vif [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:11:0e,bridge_name='br-int',has_traffic_filtering=True,id=ca00b279-ef6b-4198-8208-0a8fb9cda4be,network=Network(88e922e4-ec89-460a-954d-aff20a41293c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca00b279-ef') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca00b279-ef, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapca00b279-ef, col_values=(('external_ids', {'iface-id': 'ca00b279-ef6b-4198-8208-0a8fb9cda4be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:11:0e', 'vm-uuid': 'ef7587b9-995f-4b71-829d-223c6f520527'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:48 user nova-compute[73078]: INFO os_vif [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:11:0e,bridge_name='br-int',has_traffic_filtering=True,id=ca00b279-ef6b-4198-8208-0a8fb9cda4be,network=Network(88e922e4-ec89-460a-954d-aff20a41293c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca00b279-ef')
Aug 14 18:27:48 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] No VIF found with MAC fa:16:3e:d9:11:0e, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG nova.network.neutron [req-17c076a0-8a97-48be-b538-25466187280e req-0293a588-6a00-4b31-a068-8c34904348cd service nova] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Updated VIF entry in instance network info cache for port ca00b279-ef6b-4198-8208-0a8fb9cda4be. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG nova.network.neutron [req-17c076a0-8a97-48be-b538-25466187280e req-0293a588-6a00-4b31-a068-8c34904348cd service nova] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Updating instance_info_cache with network_info: [{"id": "ca00b279-ef6b-4198-8208-0a8fb9cda4be", "address": "fa:16:3e:d9:11:0e", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca00b279-ef", "ovs_interfaceid": "ca00b279-ef6b-4198-8208-0a8fb9cda4be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:27:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-17c076a0-8a97-48be-b538-25466187280e req-0293a588-6a00-4b31-a068-8c34904348cd service nova] Releasing lock "refresh_cache-ef7587b9-995f-4b71-829d-223c6f520527" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:27:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:50 user nova-compute[73078]: DEBUG nova.compute.manager [req-8d2032ab-1b98-40a7-ae62-f642dbbf503f req-131bca15-3adb-4bc4-96a3-4791bece998d service nova] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Received event network-vif-plugged-665b631d-4caf-4f3f-8c30-3a8ab77e79c0 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:27:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-8d2032ab-1b98-40a7-ae62-f642dbbf503f req-131bca15-3adb-4bc4-96a3-4791bece998d service nova] Acquiring lock "2f960239-8deb-4d9f-9cab-eea0274aca38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-8d2032ab-1b98-40a7-ae62-f642dbbf503f req-131bca15-3adb-4bc4-96a3-4791bece998d service nova] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-8d2032ab-1b98-40a7-ae62-f642dbbf503f req-131bca15-3adb-4bc4-96a3-4791bece998d service nova] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:50 user nova-compute[73078]: DEBUG nova.compute.manager [req-8d2032ab-1b98-40a7-ae62-f642dbbf503f req-131bca15-3adb-4bc4-96a3-4791bece998d service nova] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] No waiting events found dispatching network-vif-plugged-665b631d-4caf-4f3f-8c30-3a8ab77e79c0 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:27:50 user nova-compute[73078]: WARNING nova.compute.manager [req-8d2032ab-1b98-40a7-ae62-f642dbbf503f req-131bca15-3adb-4bc4-96a3-4791bece998d service nova] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Received unexpected event network-vif-plugged-665b631d-4caf-4f3f-8c30-3a8ab77e79c0 for instance with vm_state building and task_state spawning.
Aug 14 18:27:50 user nova-compute[73078]: DEBUG nova.compute.manager [req-8d2032ab-1b98-40a7-ae62-f642dbbf503f req-131bca15-3adb-4bc4-96a3-4791bece998d service nova] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Received event network-vif-plugged-665b631d-4caf-4f3f-8c30-3a8ab77e79c0 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:27:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-8d2032ab-1b98-40a7-ae62-f642dbbf503f req-131bca15-3adb-4bc4-96a3-4791bece998d service nova] Acquiring lock "2f960239-8deb-4d9f-9cab-eea0274aca38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-8d2032ab-1b98-40a7-ae62-f642dbbf503f req-131bca15-3adb-4bc4-96a3-4791bece998d service nova] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-8d2032ab-1b98-40a7-ae62-f642dbbf503f req-131bca15-3adb-4bc4-96a3-4791bece998d service nova] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:50 user nova-compute[73078]: DEBUG nova.compute.manager [req-8d2032ab-1b98-40a7-ae62-f642dbbf503f req-131bca15-3adb-4bc4-96a3-4791bece998d service nova] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] No waiting events found dispatching network-vif-plugged-665b631d-4caf-4f3f-8c30-3a8ab77e79c0 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:27:50 user nova-compute[73078]: WARNING nova.compute.manager [req-8d2032ab-1b98-40a7-ae62-f642dbbf503f req-131bca15-3adb-4bc4-96a3-4791bece998d service nova] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Received unexpected event network-vif-plugged-665b631d-4caf-4f3f-8c30-3a8ab77e79c0 for instance with vm_state building and task_state spawning.
Aug 14 18:27:50 user nova-compute[73078]: DEBUG nova.compute.manager [req-8d2032ab-1b98-40a7-ae62-f642dbbf503f req-131bca15-3adb-4bc4-96a3-4791bece998d service nova] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Received event network-vif-plugged-ca00b279-ef6b-4198-8208-0a8fb9cda4be {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:27:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-8d2032ab-1b98-40a7-ae62-f642dbbf503f req-131bca15-3adb-4bc4-96a3-4791bece998d service nova] Acquiring lock "ef7587b9-995f-4b71-829d-223c6f520527-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-8d2032ab-1b98-40a7-ae62-f642dbbf503f req-131bca15-3adb-4bc4-96a3-4791bece998d service nova] Lock "ef7587b9-995f-4b71-829d-223c6f520527-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-8d2032ab-1b98-40a7-ae62-f642dbbf503f req-131bca15-3adb-4bc4-96a3-4791bece998d service nova] Lock "ef7587b9-995f-4b71-829d-223c6f520527-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:50 user nova-compute[73078]: DEBUG nova.compute.manager [req-8d2032ab-1b98-40a7-ae62-f642dbbf503f req-131bca15-3adb-4bc4-96a3-4791bece998d service nova] [instance: ef7587b9-995f-4b71-829d-223c6f520527] No waiting events found dispatching network-vif-plugged-ca00b279-ef6b-4198-8208-0a8fb9cda4be {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:27:50 user nova-compute[73078]: WARNING nova.compute.manager [req-8d2032ab-1b98-40a7-ae62-f642dbbf503f req-131bca15-3adb-4bc4-96a3-4791bece998d service nova] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Received unexpected event network-vif-plugged-ca00b279-ef6b-4198-8208-0a8fb9cda4be for instance with vm_state building and task_state spawning.
Aug 14 18:27:50 user nova-compute[73078]: DEBUG nova.compute.manager [req-8d2032ab-1b98-40a7-ae62-f642dbbf503f req-131bca15-3adb-4bc4-96a3-4791bece998d service nova] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Received event network-vif-plugged-ca00b279-ef6b-4198-8208-0a8fb9cda4be {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:27:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-8d2032ab-1b98-40a7-ae62-f642dbbf503f req-131bca15-3adb-4bc4-96a3-4791bece998d service nova] Acquiring lock "ef7587b9-995f-4b71-829d-223c6f520527-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-8d2032ab-1b98-40a7-ae62-f642dbbf503f req-131bca15-3adb-4bc4-96a3-4791bece998d service nova] Lock "ef7587b9-995f-4b71-829d-223c6f520527-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-8d2032ab-1b98-40a7-ae62-f642dbbf503f req-131bca15-3adb-4bc4-96a3-4791bece998d service nova] Lock "ef7587b9-995f-4b71-829d-223c6f520527-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:50 user nova-compute[73078]: DEBUG nova.compute.manager [req-8d2032ab-1b98-40a7-ae62-f642dbbf503f req-131bca15-3adb-4bc4-96a3-4791bece998d service nova] [instance: ef7587b9-995f-4b71-829d-223c6f520527] No waiting events found dispatching network-vif-plugged-ca00b279-ef6b-4198-8208-0a8fb9cda4be {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:27:50 user nova-compute[73078]: WARNING nova.compute.manager [req-8d2032ab-1b98-40a7-ae62-f642dbbf503f req-131bca15-3adb-4bc4-96a3-4791bece998d service nova] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Received unexpected event network-vif-plugged-ca00b279-ef6b-4198-8208-0a8fb9cda4be for instance with vm_state building and task_state spawning.
Aug 14 18:27:51 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037671.3488817, 2f960239-8deb-4d9f-9cab-eea0274aca38 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:27:51 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] VM Resumed (Lifecycle Event)
Aug 14 18:27:51 user nova-compute[73078]: DEBUG nova.compute.manager [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:27:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:27:51 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Instance spawned successfully.
Aug 14 18:27:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:27:51 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:27:51 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:27:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:27:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:27:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:27:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:27:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:27:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:27:51 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:27:51 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037671.3520951, 2f960239-8deb-4d9f-9cab-eea0274aca38 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:27:51 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] VM Started (Lifecycle Event)
Aug 14 18:27:51 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:27:51 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:27:51 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:27:51 user nova-compute[73078]: INFO nova.compute.manager [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Took 6.79 seconds to spawn the instance on the hypervisor.
Aug 14 18:27:51 user nova-compute[73078]: DEBUG nova.compute.manager [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:27:51 user nova-compute[73078]: INFO nova.compute.manager [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Took 7.53 seconds to build instance.
Aug 14 18:27:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b0286ecb-1818-4586-8c8c-4e8f786217b5 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.625s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:51 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037671.8828042, ef7587b9-995f-4b71-829d-223c6f520527 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:27:51 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ef7587b9-995f-4b71-829d-223c6f520527] VM Resumed (Lifecycle Event)
Aug 14 18:27:51 user nova-compute[73078]: DEBUG nova.compute.manager [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:27:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:27:51 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Instance spawned successfully.
Aug 14 18:27:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:27:51 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:27:51 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:27:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:27:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:27:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:27:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:27:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:27:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:27:51 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ef7587b9-995f-4b71-829d-223c6f520527] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:27:51 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037671.8875213, ef7587b9-995f-4b71-829d-223c6f520527 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:27:51 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ef7587b9-995f-4b71-829d-223c6f520527] VM Started (Lifecycle Event)
Aug 14 18:27:51 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:27:51 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:27:51 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ef7587b9-995f-4b71-829d-223c6f520527] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:27:51 user nova-compute[73078]: INFO nova.compute.manager [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Took 5.83 seconds to spawn the instance on the hypervisor.
Aug 14 18:27:51 user nova-compute[73078]: DEBUG nova.compute.manager [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:27:52 user nova-compute[73078]: INFO nova.compute.manager [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Took 6.59 seconds to build instance.
Aug 14 18:27:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ee73f134-97ac-4762-91dc-8fa634d308e7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "ef7587b9-995f-4b71-829d-223c6f520527" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.689s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:54 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:27:54 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:27:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-61dfe42b-c943-4617-bf8e-745eaf1a1bb8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:27:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-61dfe42b-c943-4617-bf8e-745eaf1a1bb8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:27:54 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:27:54 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Updating instance_info_cache with network_info: [{"id": "d801cd85-be91-4f26-9750-c2ce847cb33c", "address": "fa:16:3e:87:55:89", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd801cd85-be", "ovs_interfaceid": "d801cd85-be91-4f26-9750-c2ce847cb33c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:27:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-61dfe42b-c943-4617-bf8e-745eaf1a1bb8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:27:54 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:27:56 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:27:56 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:27:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:27:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:27:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:27:56 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:27:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:56 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:27:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3088da30-65b7-4801-b425-93df4fca6ad8/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3088da30-65b7-4801-b425-93df4fca6ad8/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:56 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3088da30-65b7-4801-b425-93df4fca6ad8/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3088da30-65b7-4801-b425-93df4fca6ad8/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7587b9-995f-4b71-829d-223c6f520527/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7587b9-995f-4b71-829d-223c6f520527/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7587b9-995f-4b71-829d-223c6f520527/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7587b9-995f-4b71-829d-223c6f520527/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16abee43-684b-415f-9c77-476ffb7283e8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16abee43-684b-415f-9c77-476ffb7283e8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16abee43-684b-415f-9c77-476ffb7283e8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16abee43-684b-415f-9c77-476ffb7283e8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:58 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:27:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:58 user nova-compute[73078]: INFO nova.compute.manager [None req-8d6276ff-9eb8-43fb-a1ef-aa6c564a9bca tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Unrescuing
Aug 14 18:27:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8d6276ff-9eb8-43fb-a1ef-aa6c564a9bca tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "refresh_cache-3088da30-65b7-4801-b425-93df4fca6ad8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:27:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8d6276ff-9eb8-43fb-a1ef-aa6c564a9bca tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquired lock "refresh_cache-3088da30-65b7-4801-b425-93df4fca6ad8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:27:58 user nova-compute[73078]: DEBUG nova.network.neutron [None req-8d6276ff-9eb8-43fb-a1ef-aa6c564a9bca tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:27:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:27:59 user nova-compute[73078]: DEBUG nova.network.neutron [None req-8d6276ff-9eb8-43fb-a1ef-aa6c564a9bca tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Updating instance_info_cache with network_info: [{"id": "52e93284-9b32-4191-8f06-ab9c4497579c", "address": "fa:16:3e:ec:04:07", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e93284-9b", "ovs_interfaceid": "52e93284-9b32-4191-8f06-ab9c4497579c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:27:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8d6276ff-9eb8-43fb-a1ef-aa6c564a9bca tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Releasing lock "refresh_cache-3088da30-65b7-4801-b425-93df4fca6ad8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:27:59 user nova-compute[73078]: DEBUG nova.objects.instance [None req-8d6276ff-9eb8-43fb-a1ef-aa6c564a9bca tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lazy-loading 'flavor' on Instance uuid 3088da30-65b7-4801-b425-93df4fca6ad8 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:27:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:27:59 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:27:59 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:27:59 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:27:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:27:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:00 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:00 user nova-compute[73078]: DEBUG nova.compute.manager [req-79e18ada-b430-478a-aa1a-3cf7ecbea683 req-9cde29fa-b812-4aff-bc43-e38416eeac14 service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Received event network-vif-unplugged-52e93284-9b32-4191-8f06-ab9c4497579c {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:28:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-79e18ada-b430-478a-aa1a-3cf7ecbea683 req-9cde29fa-b812-4aff-bc43-e38416eeac14 service nova] Acquiring lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:28:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-79e18ada-b430-478a-aa1a-3cf7ecbea683 req-9cde29fa-b812-4aff-bc43-e38416eeac14 service nova] Lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:28:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-79e18ada-b430-478a-aa1a-3cf7ecbea683 req-9cde29fa-b812-4aff-bc43-e38416eeac14 service nova] Lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:28:00 user nova-compute[73078]: DEBUG nova.compute.manager [req-79e18ada-b430-478a-aa1a-3cf7ecbea683 req-9cde29fa-b812-4aff-bc43-e38416eeac14 service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] No waiting events found dispatching network-vif-unplugged-52e93284-9b32-4191-8f06-ab9c4497579c {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:28:00 user nova-compute[73078]: WARNING nova.compute.manager [req-79e18ada-b430-478a-aa1a-3cf7ecbea683 req-9cde29fa-b812-4aff-bc43-e38416eeac14 service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Received unexpected event network-vif-unplugged-52e93284-9b32-4191-8f06-ab9c4497579c for instance with vm_state rescued and task_state unrescuing.
Aug 14 18:28:00 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:28:00 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:28:00 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=7231MB free_disk=25.010765075683594GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:28:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:28:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:28:00 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Instance destroyed successfully.
Aug 14 18:28:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance de80e188-9385-4613-8a6c-aa72b624ad55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:28:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 1f88cb97-4f22-439e-99f2-d7cb8d5aff36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:28:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 61dfe42b-c943-4617-bf8e-745eaf1a1bb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:28:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 3088da30-65b7-4801-b425-93df4fca6ad8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:28:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 8ebc48e0-0a24-4421-b180-f14eacc636ad actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:28:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 16abee43-684b-415f-9c77-476ffb7283e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:28:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance ef083dd3-67d6-48a8-846a-7fe6c6b32d5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:28:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:28:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:28:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 2f960239-8deb-4d9f-9cab-eea0274aca38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:28:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance ef7587b9-995f-4b71-829d-223c6f520527 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:28:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:28:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:28:01 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:28:01 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:28:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:28:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.458s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:28:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:02 user nova-compute[73078]: DEBUG nova.compute.manager [req-1f19b106-83a2-45ec-99f1-d1c09d3958bd req-46cdd4dd-8974-4a92-b804-b667cda0bde0 service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Received event network-vif-plugged-52e93284-9b32-4191-8f06-ab9c4497579c {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:28:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1f19b106-83a2-45ec-99f1-d1c09d3958bd req-46cdd4dd-8974-4a92-b804-b667cda0bde0 service nova] Acquiring lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:28:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1f19b106-83a2-45ec-99f1-d1c09d3958bd req-46cdd4dd-8974-4a92-b804-b667cda0bde0 service nova] Lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:28:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1f19b106-83a2-45ec-99f1-d1c09d3958bd req-46cdd4dd-8974-4a92-b804-b667cda0bde0 service nova] Lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:28:02 user nova-compute[73078]: DEBUG nova.compute.manager [req-1f19b106-83a2-45ec-99f1-d1c09d3958bd req-46cdd4dd-8974-4a92-b804-b667cda0bde0 service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] No waiting events found dispatching network-vif-plugged-52e93284-9b32-4191-8f06-ab9c4497579c {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:28:02 user nova-compute[73078]: WARNING nova.compute.manager [req-1f19b106-83a2-45ec-99f1-d1c09d3958bd req-46cdd4dd-8974-4a92-b804-b667cda0bde0 service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Received unexpected event network-vif-plugged-52e93284-9b32-4191-8f06-ab9c4497579c for instance with vm_state rescued and task_state unrescuing.
Aug 14 18:28:02 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:28:02 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:28:02 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:28:02 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:28:02 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:28:02 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:28:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:28:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:04 user nova-compute[73078]: DEBUG nova.compute.manager [req-039ffcae-726e-493b-87eb-2498a69ead9a req-635ab831-29a4-4691-84b7-19da0d8674a0 service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Received event network-vif-plugged-52e93284-9b32-4191-8f06-ab9c4497579c {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:28:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-039ffcae-726e-493b-87eb-2498a69ead9a req-635ab831-29a4-4691-84b7-19da0d8674a0 service nova] Acquiring lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:28:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-039ffcae-726e-493b-87eb-2498a69ead9a req-635ab831-29a4-4691-84b7-19da0d8674a0 service nova] Lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:28:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-039ffcae-726e-493b-87eb-2498a69ead9a req-635ab831-29a4-4691-84b7-19da0d8674a0 service nova] Lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:28:04 user nova-compute[73078]: DEBUG nova.compute.manager [req-039ffcae-726e-493b-87eb-2498a69ead9a req-635ab831-29a4-4691-84b7-19da0d8674a0 service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] No waiting events found dispatching network-vif-plugged-52e93284-9b32-4191-8f06-ab9c4497579c {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:28:04 user nova-compute[73078]: WARNING nova.compute.manager [req-039ffcae-726e-493b-87eb-2498a69ead9a req-635ab831-29a4-4691-84b7-19da0d8674a0 service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Received unexpected event network-vif-plugged-52e93284-9b32-4191-8f06-ab9c4497579c for instance with vm_state rescued and task_state unrescuing.
Aug 14 18:28:04 user nova-compute[73078]: DEBUG nova.compute.manager [req-039ffcae-726e-493b-87eb-2498a69ead9a req-635ab831-29a4-4691-84b7-19da0d8674a0 service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Received event network-vif-plugged-52e93284-9b32-4191-8f06-ab9c4497579c {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:28:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-039ffcae-726e-493b-87eb-2498a69ead9a req-635ab831-29a4-4691-84b7-19da0d8674a0 service nova] Acquiring lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:28:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-039ffcae-726e-493b-87eb-2498a69ead9a req-635ab831-29a4-4691-84b7-19da0d8674a0 service nova] Lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:28:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-039ffcae-726e-493b-87eb-2498a69ead9a req-635ab831-29a4-4691-84b7-19da0d8674a0 service nova] Lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:28:04 user nova-compute[73078]: DEBUG nova.compute.manager [req-039ffcae-726e-493b-87eb-2498a69ead9a req-635ab831-29a4-4691-84b7-19da0d8674a0 service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] No waiting events found dispatching network-vif-plugged-52e93284-9b32-4191-8f06-ab9c4497579c {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:28:04 user nova-compute[73078]: WARNING nova.compute.manager [req-039ffcae-726e-493b-87eb-2498a69ead9a req-635ab831-29a4-4691-84b7-19da0d8674a0 service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Received unexpected event network-vif-plugged-52e93284-9b32-4191-8f06-ab9c4497579c for instance with vm_state rescued and task_state unrescuing.
Aug 14 18:28:04 user nova-compute[73078]: DEBUG nova.compute.manager [None req-8d6276ff-9eb8-43fb-a1ef-aa6c564a9bca tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:28:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Removed pending event for 3088da30-65b7-4801-b425-93df4fca6ad8 due to event {{(pid=73078) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 18:28:04 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037684.3962612, 3088da30-65b7-4801-b425-93df4fca6ad8 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:28:04 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] VM Resumed (Lifecycle Event)
Aug 14 18:28:04 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:28:04 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:28:04 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 18:28:04 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037684.3964658, 3088da30-65b7-4801-b425-93df4fca6ad8 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:28:04 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] VM Started (Lifecycle Event)
Aug 14 18:28:04 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:28:04 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:28:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-24cba20c-1923-46c2-a46e-70fe773be459 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "de80e188-9385-4613-8a6c-aa72b624ad55" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:28:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-24cba20c-1923-46c2-a46e-70fe773be459 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "de80e188-9385-4613-8a6c-aa72b624ad55" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:28:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-24cba20c-1923-46c2-a46e-70fe773be459 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:28:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-24cba20c-1923-46c2-a46e-70fe773be459 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:28:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-24cba20c-1923-46c2-a46e-70fe773be459 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:28:06 user nova-compute[73078]: INFO nova.compute.manager [None req-24cba20c-1923-46c2-a46e-70fe773be459 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Terminating instance
Aug 14 18:28:06 user nova-compute[73078]: DEBUG nova.compute.manager [None req-24cba20c-1923-46c2-a46e-70fe773be459 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:28:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:07 user nova-compute[73078]: DEBUG nova.compute.manager [req-a879a544-8354-4c61-9a64-c690103a5d6c req-966ef11b-ae39-4768-a642-b2f7e37675fd service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Received event network-vif-unplugged-2afe973c-46fa-4336-996f-b5dcd374c96e {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:28:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a879a544-8354-4c61-9a64-c690103a5d6c req-966ef11b-ae39-4768-a642-b2f7e37675fd service nova] Acquiring lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:28:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a879a544-8354-4c61-9a64-c690103a5d6c req-966ef11b-ae39-4768-a642-b2f7e37675fd service nova] Lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:28:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a879a544-8354-4c61-9a64-c690103a5d6c req-966ef11b-ae39-4768-a642-b2f7e37675fd service nova] Lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:28:07 user nova-compute[73078]: DEBUG nova.compute.manager [req-a879a544-8354-4c61-9a64-c690103a5d6c req-966ef11b-ae39-4768-a642-b2f7e37675fd service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] No waiting events found dispatching network-vif-unplugged-2afe973c-46fa-4336-996f-b5dcd374c96e {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:28:07 user nova-compute[73078]: DEBUG nova.compute.manager [req-a879a544-8354-4c61-9a64-c690103a5d6c req-966ef11b-ae39-4768-a642-b2f7e37675fd service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Received event network-vif-unplugged-2afe973c-46fa-4336-996f-b5dcd374c96e for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:28:07 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Instance destroyed successfully.
Aug 14 18:28:07 user nova-compute[73078]: DEBUG nova.objects.instance [None req-24cba20c-1923-46c2-a46e-70fe773be459 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lazy-loading 'resources' on Instance uuid de80e188-9385-4613-8a6c-aa72b624ad55 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:28:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-24cba20c-1923-46c2-a46e-70fe773be459 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:10:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2143110433',display_name='tempest-ServerRescueNegativeTestJSON-server-2143110433',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2143110433',id=2,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:15:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ec53c6018ee44b09ee31ba712a789aa',ramdisk_id='',reservation_id='r-omwxdblo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-38557121',owner_user_name='tempest-ServerRescueNegativeTestJSON-38557121-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:17:40Z,user_data=None,user_id='d25ecea70e9e481e8a1957a94d79edfc',uuid=de80e188-9385-4613-8a6c-aa72b624ad55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2afe973c-46fa-4336-996f-b5dcd374c96e", "address": "fa:16:3e:5d:60:2f", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe973c-46", "ovs_interfaceid": "2afe973c-46fa-4336-996f-b5dcd374c96e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:28:07 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-24cba20c-1923-46c2-a46e-70fe773be459 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Converting VIF {"id": "2afe973c-46fa-4336-996f-b5dcd374c96e", "address": "fa:16:3e:5d:60:2f", "network": {"id": "33518dc6-7963-4995-b4c7-86d60b44a22f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1485092470-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec53c6018ee44b09ee31ba712a789aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe973c-46", "ovs_interfaceid": "2afe973c-46fa-4336-996f-b5dcd374c96e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:28:07 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-24cba20c-1923-46c2-a46e-70fe773be459 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:60:2f,bridge_name='br-int',has_traffic_filtering=True,id=2afe973c-46fa-4336-996f-b5dcd374c96e,network=Network(33518dc6-7963-4995-b4c7-86d60b44a22f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afe973c-46') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:28:07 user nova-compute[73078]: DEBUG os_vif [None req-24cba20c-1923-46c2-a46e-70fe773be459 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:60:2f,bridge_name='br-int',has_traffic_filtering=True,id=2afe973c-46fa-4336-996f-b5dcd374c96e,network=Network(33518dc6-7963-4995-b4c7-86d60b44a22f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afe973c-46') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:28:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2afe973c-46, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:28:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:07 user nova-compute[73078]: INFO os_vif [None req-24cba20c-1923-46c2-a46e-70fe773be459 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:60:2f,bridge_name='br-int',has_traffic_filtering=True,id=2afe973c-46fa-4336-996f-b5dcd374c96e,network=Network(33518dc6-7963-4995-b4c7-86d60b44a22f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afe973c-46')
Aug 14 18:28:07 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-24cba20c-1923-46c2-a46e-70fe773be459 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Deleting instance files /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55_del
Aug 14 18:28:07 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-24cba20c-1923-46c2-a46e-70fe773be459 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Deletion of /opt/stack/data/nova/instances/de80e188-9385-4613-8a6c-aa72b624ad55_del complete
Aug 14 18:28:07 user nova-compute[73078]: INFO nova.compute.manager [None req-24cba20c-1923-46c2-a46e-70fe773be459 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Took 0.65 seconds to destroy the instance on the hypervisor.
Aug 14 18:28:07 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-24cba20c-1923-46c2-a46e-70fe773be459 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:28:07 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:28:07 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:28:07 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:28:07 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Took 0.42 seconds to deallocate network for instance.
Aug 14 18:28:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-24cba20c-1923-46c2-a46e-70fe773be459 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:28:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-24cba20c-1923-46c2-a46e-70fe773be459 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:28:08 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-24cba20c-1923-46c2-a46e-70fe773be459 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:28:08 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-24cba20c-1923-46c2-a46e-70fe773be459 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:28:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-24cba20c-1923-46c2-a46e-70fe773be459 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:28:08 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-24cba20c-1923-46c2-a46e-70fe773be459 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Deleted allocations for instance de80e188-9385-4613-8a6c-aa72b624ad55
Aug 14 18:28:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-24cba20c-1923-46c2-a46e-70fe773be459 tempest-ServerRescueNegativeTestJSON-38557121 tempest-ServerRescueNegativeTestJSON-38557121-project-member] Lock "de80e188-9385-4613-8a6c-aa72b624ad55" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.554s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:28:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:09 user nova-compute[73078]: DEBUG nova.compute.manager [req-a1ee45b9-7a24-4fc2-9e66-3f885c37f3a1 req-562bf184-6952-41e2-9c6d-beb6c6a92c19 service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Received event network-vif-plugged-2afe973c-46fa-4336-996f-b5dcd374c96e {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:28:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a1ee45b9-7a24-4fc2-9e66-3f885c37f3a1 req-562bf184-6952-41e2-9c6d-beb6c6a92c19 service nova] Acquiring lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:28:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a1ee45b9-7a24-4fc2-9e66-3f885c37f3a1 req-562bf184-6952-41e2-9c6d-beb6c6a92c19 service nova] Lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:28:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a1ee45b9-7a24-4fc2-9e66-3f885c37f3a1 req-562bf184-6952-41e2-9c6d-beb6c6a92c19 service nova] Lock "de80e188-9385-4613-8a6c-aa72b624ad55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:28:09 user nova-compute[73078]: DEBUG nova.compute.manager [req-a1ee45b9-7a24-4fc2-9e66-3f885c37f3a1 req-562bf184-6952-41e2-9c6d-beb6c6a92c19 service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] No waiting events found dispatching network-vif-plugged-2afe973c-46fa-4336-996f-b5dcd374c96e {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:28:09 user nova-compute[73078]: WARNING nova.compute.manager [req-a1ee45b9-7a24-4fc2-9e66-3f885c37f3a1 req-562bf184-6952-41e2-9c6d-beb6c6a92c19 service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Received unexpected event network-vif-plugged-2afe973c-46fa-4336-996f-b5dcd374c96e for instance with vm_state deleted and task_state None.
Aug 14 18:28:09 user nova-compute[73078]: DEBUG nova.compute.manager [req-a1ee45b9-7a24-4fc2-9e66-3f885c37f3a1 req-562bf184-6952-41e2-9c6d-beb6c6a92c19 service nova] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Received event network-vif-deleted-2afe973c-46fa-4336-996f-b5dcd374c96e {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:28:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:15 user nova-compute[73078]: INFO nova.compute.manager [None req-588ce9b3-714b-45a1-a166-d93b70acf4e0 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Get console output
Aug 14 18:28:16 user nova-compute[73078]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 14 18:28:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:22 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692037687.36673, de80e188-9385-4613-8a6c-aa72b624ad55 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:28:22 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] VM Stopped (Lifecycle Event)
Aug 14 18:28:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:22 user nova-compute[73078]: DEBUG nova.compute.manager [None req-791e4a96-613d-4cd1-a894-2bcd6bb2b826 None None] [instance: de80e188-9385-4613-8a6c-aa72b624ad55] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:28:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:28:34 user nova-compute[73078]: DEBUG nova.compute.manager [None req-b0510eaf-3c56-4b2f-93c0-e03fe92158fc tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:28:34 user nova-compute[73078]: INFO nova.compute.manager [None req-b0510eaf-3c56-4b2f-93c0-e03fe92158fc tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] instance snapshotting
Aug 14 18:28:34 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-b0510eaf-3c56-4b2f-93c0-e03fe92158fc tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Beginning live snapshot process
Aug 14 18:28:34 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-b0510eaf-3c56-4b2f-93c0-e03fe92158fc tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk --force-share --output=json -f qcow2 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:28:34 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-b0510eaf-3c56-4b2f-93c0-e03fe92158fc tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:28:34 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-b0510eaf-3c56-4b2f-93c0-e03fe92158fc tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk --force-share --output=json -f qcow2 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:28:34 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-b0510eaf-3c56-4b2f-93c0-e03fe92158fc tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:28:34 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-b0510eaf-3c56-4b2f-93c0-e03fe92158fc tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:28:34 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-b0510eaf-3c56-4b2f-93c0-e03fe92158fc tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.173s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:28:34 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-b0510eaf-3c56-4b2f-93c0-e03fe92158fc tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmppa6wrxn9/a283e127161b47d58847815d0860390e.delta 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:28:34 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-b0510eaf-3c56-4b2f-93c0-e03fe92158fc tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmppa6wrxn9/a283e127161b47d58847815d0860390e.delta 1073741824" returned: 0 in 0.049s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:28:34 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-b0510eaf-3c56-4b2f-93c0-e03fe92158fc tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 14 18:28:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-b0510eaf-3c56-4b2f-93c0-e03fe92158fc tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=73078) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 18:28:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-b0510eaf-3c56-4b2f-93c0-e03fe92158fc tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73078) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 18:28:36 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-b0510eaf-3c56-4b2f-93c0-e03fe92158fc tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 18:28:36 user nova-compute[73078]: DEBUG nova.privsep.utils [None req-b0510eaf-3c56-4b2f-93c0-e03fe92158fc tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73078) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 18:28:36 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-b0510eaf-3c56-4b2f-93c0-e03fe92158fc tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmppa6wrxn9/a283e127161b47d58847815d0860390e.delta /opt/stack/data/nova/instances/snapshots/tmppa6wrxn9/a283e127161b47d58847815d0860390e {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:28:36 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-b0510eaf-3c56-4b2f-93c0-e03fe92158fc tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmppa6wrxn9/a283e127161b47d58847815d0860390e.delta /opt/stack/data/nova/instances/snapshots/tmppa6wrxn9/a283e127161b47d58847815d0860390e" returned: 0 in 0.275s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:28:36 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-b0510eaf-3c56-4b2f-93c0-e03fe92158fc tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Snapshot extracted, beginning image upload
Aug 14 18:28:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:28:38 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-b0510eaf-3c56-4b2f-93c0-e03fe92158fc tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Snapshot image upload complete
Aug 14 18:28:38 user nova-compute[73078]: INFO nova.compute.manager [None req-b0510eaf-3c56-4b2f-93c0-e03fe92158fc tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Took 4.73 seconds to snapshot the instance on the hypervisor.
Aug 14 18:28:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Acquiring lock "5bf260cc-5c85-46e0-8326-7f23165065b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:28:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "5bf260cc-5c85-46e0-8326-7f23165065b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:28:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:28:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:28:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:28:40 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:28:40 user nova-compute[73078]: INFO nova.compute.claims [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Claim successful on node user
Aug 14 18:28:41 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:28:41 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:28:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:28:41 user nova-compute[73078]: DEBUG nova.compute.manager [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:28:41 user nova-compute[73078]: DEBUG nova.compute.manager [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:28:41 user nova-compute[73078]: DEBUG nova.network.neutron [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:28:41 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:28:41 user nova-compute[73078]: DEBUG nova.compute.manager [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:28:41 user nova-compute[73078]: DEBUG nova.policy [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '08f7cf7e532f46c8942157b99f9ccd77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce3bd6c6a784ee3a395c368d667c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:28:41 user nova-compute[73078]: DEBUG nova.compute.manager [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:28:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:28:41 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Creating image(s)
Aug 14 18:28:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Acquiring lock "/opt/stack/data/nova/instances/5bf260cc-5c85-46e0-8326-7f23165065b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:28:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "/opt/stack/data/nova/instances/5bf260cc-5c85-46e0-8326-7f23165065b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:28:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "/opt/stack/data/nova/instances/5bf260cc-5c85-46e0-8326-7f23165065b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:28:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Acquiring lock "dce954bcb987737be8c6c5fc1e5c1a74d5f40f18" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:28:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "dce954bcb987737be8c6c5fc1e5c1a74d5f40f18" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:28:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dce954bcb987737be8c6c5fc1e5c1a74d5f40f18.part --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:28:42 user nova-compute[73078]: DEBUG nova.network.neutron [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Successfully created port: 33b84b58-09ca-49f0-a118-2870cd38d6d3 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:28:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dce954bcb987737be8c6c5fc1e5c1a74d5f40f18.part --force-share --output=json" returned: 0 in 0.177s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:28:42 user nova-compute[73078]: DEBUG nova.virt.images [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] 30756806-1030-4804-b5e8-82296f27a7fd was qcow2, converting to raw {{(pid=73078) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 18:28:42 user nova-compute[73078]: DEBUG nova.privsep.utils [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73078) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 18:28:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dce954bcb987737be8c6c5fc1e5c1a74d5f40f18.part /opt/stack/data/nova/instances/_base/dce954bcb987737be8c6c5fc1e5c1a74d5f40f18.converted {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:28:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dce954bcb987737be8c6c5fc1e5c1a74d5f40f18.part /opt/stack/data/nova/instances/_base/dce954bcb987737be8c6c5fc1e5c1a74d5f40f18.converted" returned: 0 in 0.359s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:28:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dce954bcb987737be8c6c5fc1e5c1a74d5f40f18.converted --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:28:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dce954bcb987737be8c6c5fc1e5c1a74d5f40f18.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:28:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "dce954bcb987737be8c6c5fc1e5c1a74d5f40f18" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.507s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:28:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dce954bcb987737be8c6c5fc1e5c1a74d5f40f18 --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:28:43 user nova-compute[73078]: DEBUG nova.network.neutron [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Successfully updated port: 33b84b58-09ca-49f0-a118-2870cd38d6d3 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:28:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dce954bcb987737be8c6c5fc1e5c1a74d5f40f18 --force-share --output=json" returned: 0 in 0.195s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:28:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Acquiring lock "dce954bcb987737be8c6c5fc1e5c1a74d5f40f18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:28:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "dce954bcb987737be8c6c5fc1e5c1a74d5f40f18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:28:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dce954bcb987737be8c6c5fc1e5c1a74d5f40f18 --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:28:43 user nova-compute[73078]: DEBUG nova.compute.manager [req-97cb897d-4c5a-4717-bf97-374ff1547b9d req-258d896f-c97f-4953-a8c4-c9f46991df26 service nova] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Received event network-changed-33b84b58-09ca-49f0-a118-2870cd38d6d3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:28:43 user nova-compute[73078]: DEBUG nova.compute.manager [req-97cb897d-4c5a-4717-bf97-374ff1547b9d req-258d896f-c97f-4953-a8c4-c9f46991df26 service nova] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Refreshing instance network info cache due to event network-changed-33b84b58-09ca-49f0-a118-2870cd38d6d3. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:28:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-97cb897d-4c5a-4717-bf97-374ff1547b9d req-258d896f-c97f-4953-a8c4-c9f46991df26 service nova] Acquiring lock "refresh_cache-5bf260cc-5c85-46e0-8326-7f23165065b7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:28:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-97cb897d-4c5a-4717-bf97-374ff1547b9d req-258d896f-c97f-4953-a8c4-c9f46991df26 service nova] Acquired lock "refresh_cache-5bf260cc-5c85-46e0-8326-7f23165065b7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:28:43 user nova-compute[73078]: DEBUG nova.network.neutron [req-97cb897d-4c5a-4717-bf97-374ff1547b9d req-258d896f-c97f-4953-a8c4-c9f46991df26 service nova] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Refreshing network info cache for port 33b84b58-09ca-49f0-a118-2870cd38d6d3 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:28:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Acquiring lock "refresh_cache-5bf260cc-5c85-46e0-8326-7f23165065b7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:28:43 user nova-compute[73078]: DEBUG nova.network.neutron [req-97cb897d-4c5a-4717-bf97-374ff1547b9d req-258d896f-c97f-4953-a8c4-c9f46991df26 service nova] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:28:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dce954bcb987737be8c6c5fc1e5c1a74d5f40f18 --force-share --output=json" returned: 0 in 0.182s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:28:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dce954bcb987737be8c6c5fc1e5c1a74d5f40f18,backing_fmt=raw /opt/stack/data/nova/instances/5bf260cc-5c85-46e0-8326-7f23165065b7/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:28:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dce954bcb987737be8c6c5fc1e5c1a74d5f40f18,backing_fmt=raw /opt/stack/data/nova/instances/5bf260cc-5c85-46e0-8326-7f23165065b7/disk 1073741824" returned: 0 in 0.051s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:28:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "dce954bcb987737be8c6c5fc1e5c1a74d5f40f18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:28:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dce954bcb987737be8c6c5fc1e5c1a74d5f40f18 --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:28:43 user nova-compute[73078]: DEBUG nova.network.neutron [req-97cb897d-4c5a-4717-bf97-374ff1547b9d req-258d896f-c97f-4953-a8c4-c9f46991df26 service nova] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:28:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dce954bcb987737be8c6c5fc1e5c1a74d5f40f18 --force-share --output=json" returned: 0 in 0.191s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:28:43 user nova-compute[73078]: DEBUG nova.objects.instance [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lazy-loading 'migration_context' on Instance uuid 5bf260cc-5c85-46e0-8326-7f23165065b7 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:28:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-97cb897d-4c5a-4717-bf97-374ff1547b9d req-258d896f-c97f-4953-a8c4-c9f46991df26 service nova] Releasing lock "refresh_cache-5bf260cc-5c85-46e0-8326-7f23165065b7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:28:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Acquired lock "refresh_cache-5bf260cc-5c85-46e0-8326-7f23165065b7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:28:43 user nova-compute[73078]: DEBUG nova.network.neutron [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:28:43 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:28:43 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Ensure instance console log exists: /opt/stack/data/nova/instances/5bf260cc-5c85-46e0-8326-7f23165065b7/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:28:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:28:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:28:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:28:43 user nova-compute[73078]: DEBUG nova.network.neutron [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:28:44 user nova-compute[73078]: DEBUG nova.network.neutron [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Updating instance_info_cache with network_info: [{"id": "33b84b58-09ca-49f0-a118-2870cd38d6d3", "address": "fa:16:3e:66:a1:dc", "network": {"id": "21c76d99-2d0a-42b9-b7a0-b068f0cb938f", "bridge": "br-int", "label": "tempest-TestStampPattern-1682035048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce3bd6c6a784ee3a395c368d667c1b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b84b58-09", "ovs_interfaceid": "33b84b58-09ca-49f0-a118-2870cd38d6d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:28:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Releasing lock "refresh_cache-5bf260cc-5c85-46e0-8326-7f23165065b7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:28:44 user nova-compute[73078]: DEBUG nova.compute.manager [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Instance network_info: |[{"id": "33b84b58-09ca-49f0-a118-2870cd38d6d3", "address": "fa:16:3e:66:a1:dc", "network": {"id": "21c76d99-2d0a-42b9-b7a0-b068f0cb938f", "bridge": "br-int", "label": "tempest-TestStampPattern-1682035048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce3bd6c6a784ee3a395c368d667c1b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b84b58-09", "ovs_interfaceid": "33b84b58-09ca-49f0-a118-2870cd38d6d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:28:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Start _get_guest_xml network_info=[{"id": "33b84b58-09ca-49f0-a118-2870cd38d6d3", "address": "fa:16:3e:66:a1:dc", "network": {"id": "21c76d99-2d0a-42b9-b7a0-b068f0cb938f", "bridge": "br-int", "label": "tempest-TestStampPattern-1682035048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce3bd6c6a784ee3a395c368d667c1b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b84b58-09", "ovs_interfaceid": "33b84b58-09ca-49f0-a118-2870cd38d6d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='6b0ff5db07460bc25b079b35505b73de',container_format='bare',created_at=2023-08-14T18:28:34Z,direct_url=<?>,disk_format='qcow2',id=30756806-1030-4804-b5e8-82296f27a7fd,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2015214357',owner='0ce3bd6c6a784ee3a395c368d667c1b3',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-14T18:28:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '30756806-1030-4804-b5e8-82296f27a7fd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:28:44 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:28:44 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:28:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:28:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:28:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:28:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:28:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:28:44 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='6b0ff5db07460bc25b079b35505b73de',container_format='bare',created_at=2023-08-14T18:28:34Z,direct_url=<?>,disk_format='qcow2',id=30756806-1030-4804-b5e8-82296f27a7fd,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2015214357',owner='0ce3bd6c6a784ee3a395c368d667c1b3',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-14T18:28:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:28:44 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:28:44 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:28:44 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:28:44 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:28:44 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:28:44 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:28:44 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:28:44 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:28:44 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:28:44 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:28:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:28:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-535819277',display_name='tempest-TestStampPattern-server-535819277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-535819277',id=38,image_ref='30756806-1030-4804-b5e8-82296f27a7fd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCcJMv1AV17ylcLliWNA6MPLR+aDJkzXeqhllF0bf2imCcrbw2X6UlhzsHI25lDDbRh7U/jFMtBw5eymdUYDpVK4u5ZUqAplS3uUj5rbwGNZVg+pHSh9eSszqkvnE3m/A==',key_name='tempest-TestStampPattern-762241101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ce3bd6c6a784ee3a395c368d667c1b3',ramdisk_id='',reservation_id='r-gl0rxoa0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='ef083dd3-67d6-48a8-846a-7fe6c6b32d5c',image_min_disk='1',image_min_ram='0',image_owner_id='0ce3bd6c6a784ee3a395c368d667c1b3',image_owner_project_name='tempest-TestStampPattern-11663352',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-11663352-project-member',image_user_id='08f7cf7e532f46c8942157b99f9ccd77',network_allocated='True',owner_project_name='tempest-TestStampPattern-11663352',owner_user_name='tempest-TestStampPattern-11663352-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:28:42Z,user_data=None,user_id='08f7cf7e532f46c8942157b99f9ccd77',uuid=5bf260cc-5c85-46e0-8326-7f23165065b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33b84b58-09ca-49f0-a118-2870cd38d6d3", "address": "fa:16:3e:66:a1:dc", "network": {"id": "21c76d99-2d0a-42b9-b7a0-b068f0cb938f", "bridge": "br-int", "label": "tempest-TestStampPattern-1682035048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce3bd6c6a784ee3a395c368d667c1b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b84b58-09", "ovs_interfaceid": "33b84b58-09ca-49f0-a118-2870cd38d6d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:28:44 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Converting VIF {"id": "33b84b58-09ca-49f0-a118-2870cd38d6d3", "address": "fa:16:3e:66:a1:dc", "network": {"id": "21c76d99-2d0a-42b9-b7a0-b068f0cb938f", "bridge": "br-int", "label": "tempest-TestStampPattern-1682035048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce3bd6c6a784ee3a395c368d667c1b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b84b58-09", "ovs_interfaceid": "33b84b58-09ca-49f0-a118-2870cd38d6d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:28:44 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:a1:dc,bridge_name='br-int',has_traffic_filtering=True,id=33b84b58-09ca-49f0-a118-2870cd38d6d3,network=Network(21c76d99-2d0a-42b9-b7a0-b068f0cb938f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33b84b58-09') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:28:44 user nova-compute[73078]: DEBUG nova.objects.instance [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lazy-loading 'pci_devices' on Instance uuid 5bf260cc-5c85-46e0-8326-7f23165065b7 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:28:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:28:44 user nova-compute[73078]:   <uuid>5bf260cc-5c85-46e0-8326-7f23165065b7</uuid>
Aug 14 18:28:44 user nova-compute[73078]:   <name>instance-00000026</name>
Aug 14 18:28:44 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:28:44 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:28:44 user nova-compute[73078]:   <metadata>
Aug 14 18:28:44 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:28:44 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:28:44 user nova-compute[73078]:       <nova:name>tempest-TestStampPattern-server-535819277</nova:name>
Aug 14 18:28:44 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:28:44</nova:creationTime>
Aug 14 18:28:44 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:28:44 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:28:44 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:28:44 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:28:44 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:28:44 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:28:44 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:28:44 user nova-compute[73078]:       <nova:owner>
Aug 14 18:28:44 user nova-compute[73078]:         <nova:user uuid="08f7cf7e532f46c8942157b99f9ccd77">tempest-TestStampPattern-11663352-project-member</nova:user>
Aug 14 18:28:44 user nova-compute[73078]:         <nova:project uuid="0ce3bd6c6a784ee3a395c368d667c1b3">tempest-TestStampPattern-11663352</nova:project>
Aug 14 18:28:44 user nova-compute[73078]:       </nova:owner>
Aug 14 18:28:44 user nova-compute[73078]:       <nova:root type="image" uuid="30756806-1030-4804-b5e8-82296f27a7fd"/>
Aug 14 18:28:44 user nova-compute[73078]:       <nova:ports>
Aug 14 18:28:44 user nova-compute[73078]:         <nova:port uuid="33b84b58-09ca-49f0-a118-2870cd38d6d3">
Aug 14 18:28:44 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 18:28:44 user nova-compute[73078]:         </nova:port>
Aug 14 18:28:44 user nova-compute[73078]:       </nova:ports>
Aug 14 18:28:44 user nova-compute[73078]:     </nova:instance>
Aug 14 18:28:44 user nova-compute[73078]:   </metadata>
Aug 14 18:28:44 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:28:44 user nova-compute[73078]:     <system>
Aug 14 18:28:44 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:28:44 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:28:44 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:28:44 user nova-compute[73078]:       <entry name="serial">5bf260cc-5c85-46e0-8326-7f23165065b7</entry>
Aug 14 18:28:44 user nova-compute[73078]:       <entry name="uuid">5bf260cc-5c85-46e0-8326-7f23165065b7</entry>
Aug 14 18:28:44 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:28:44 user nova-compute[73078]:     </system>
Aug 14 18:28:44 user nova-compute[73078]:   </sysinfo>
Aug 14 18:28:44 user nova-compute[73078]:   <os>
Aug 14 18:28:44 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:28:44 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:28:44 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:28:44 user nova-compute[73078]:   </os>
Aug 14 18:28:44 user nova-compute[73078]:   <features>
Aug 14 18:28:44 user nova-compute[73078]:     <acpi/>
Aug 14 18:28:44 user nova-compute[73078]:     <apic/>
Aug 14 18:28:44 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:28:44 user nova-compute[73078]:   </features>
Aug 14 18:28:44 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:28:44 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:28:44 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:28:44 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:28:44 user nova-compute[73078]:   </clock>
Aug 14 18:28:44 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:28:44 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:28:44 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:28:44 user nova-compute[73078]:   </cpu>
Aug 14 18:28:44 user nova-compute[73078]:   <devices>
Aug 14 18:28:44 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:28:44 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:28:44 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/5bf260cc-5c85-46e0-8326-7f23165065b7/disk"/>
Aug 14 18:28:44 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:28:44 user nova-compute[73078]:     </disk>
Aug 14 18:28:44 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:28:44 user nova-compute[73078]:       <mac address="fa:16:3e:66:a1:dc"/>
Aug 14 18:28:44 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:28:44 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:28:44 user nova-compute[73078]:       <target dev="tap33b84b58-09"/>
Aug 14 18:28:44 user nova-compute[73078]:     </interface>
Aug 14 18:28:44 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:28:44 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/5bf260cc-5c85-46e0-8326-7f23165065b7/console.log" append="off"/>
Aug 14 18:28:44 user nova-compute[73078]:     </serial>
Aug 14 18:28:44 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:28:44 user nova-compute[73078]:     <video>
Aug 14 18:28:44 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:28:44 user nova-compute[73078]:     </video>
Aug 14 18:28:44 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:28:44 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:28:44 user nova-compute[73078]:     </rng>
Aug 14 18:28:44 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:28:44 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:28:44 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:28:44 user nova-compute[73078]:     </memballoon>
Aug 14 18:28:44 user nova-compute[73078]:   </devices>
Aug 14 18:28:44 user nova-compute[73078]: </domain>
Aug 14 18:28:44 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:28:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:28:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-535819277',display_name='tempest-TestStampPattern-server-535819277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-535819277',id=38,image_ref='30756806-1030-4804-b5e8-82296f27a7fd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCcJMv1AV17ylcLliWNA6MPLR+aDJkzXeqhllF0bf2imCcrbw2X6UlhzsHI25lDDbRh7U/jFMtBw5eymdUYDpVK4u5ZUqAplS3uUj5rbwGNZVg+pHSh9eSszqkvnE3m/A==',key_name='tempest-TestStampPattern-762241101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ce3bd6c6a784ee3a395c368d667c1b3',ramdisk_id='',reservation_id='r-gl0rxoa0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='ef083dd3-67d6-48a8-846a-7fe6c6b32d5c',image_min_disk='1',image_min_ram='0',image_owner_id='0ce3bd6c6a784ee3a395c368d667c1b3',image_owner_project_name='tempest-TestStampPattern-11663352',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-11663352-project-member',image_user_id='08f7cf7e532f46c8942157b99f9ccd77',network_allocated='True',owner_project_name='tempest-TestStampPattern-11663352',owner_user_name='tempest-TestStampPattern-11663352-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:28:42Z,user_data=None,user_id='08f7cf7e532f46c8942157b99f9ccd77',uuid=5bf260cc-5c85-46e0-8326-7f23165065b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33b84b58-09ca-49f0-a118-2870cd38d6d3", "address": "fa:16:3e:66:a1:dc", "network": {"id": "21c76d99-2d0a-42b9-b7a0-b068f0cb938f", "bridge": "br-int", "label": "tempest-TestStampPattern-1682035048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce3bd6c6a784ee3a395c368d667c1b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b84b58-09", "ovs_interfaceid": "33b84b58-09ca-49f0-a118-2870cd38d6d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:28:44 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Converting VIF {"id": "33b84b58-09ca-49f0-a118-2870cd38d6d3", "address": "fa:16:3e:66:a1:dc", "network": {"id": "21c76d99-2d0a-42b9-b7a0-b068f0cb938f", "bridge": "br-int", "label": "tempest-TestStampPattern-1682035048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce3bd6c6a784ee3a395c368d667c1b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b84b58-09", "ovs_interfaceid": "33b84b58-09ca-49f0-a118-2870cd38d6d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:28:44 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:a1:dc,bridge_name='br-int',has_traffic_filtering=True,id=33b84b58-09ca-49f0-a118-2870cd38d6d3,network=Network(21c76d99-2d0a-42b9-b7a0-b068f0cb938f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33b84b58-09') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:28:44 user nova-compute[73078]: DEBUG os_vif [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:a1:dc,bridge_name='br-int',has_traffic_filtering=True,id=33b84b58-09ca-49f0-a118-2870cd38d6d3,network=Network(21c76d99-2d0a-42b9-b7a0-b068f0cb938f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33b84b58-09') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:28:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:28:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:28:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33b84b58-09, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:28:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap33b84b58-09, col_values=(('external_ids', {'iface-id': '33b84b58-09ca-49f0-a118-2870cd38d6d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:a1:dc', 'vm-uuid': '5bf260cc-5c85-46e0-8326-7f23165065b7'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:28:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:28:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:44 user nova-compute[73078]: INFO os_vif [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:a1:dc,bridge_name='br-int',has_traffic_filtering=True,id=33b84b58-09ca-49f0-a118-2870cd38d6d3,network=Network(21c76d99-2d0a-42b9-b7a0-b068f0cb938f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33b84b58-09')
Aug 14 18:28:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:28:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] No VIF found with MAC fa:16:3e:66:a1:dc, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:28:45 user nova-compute[73078]: DEBUG nova.compute.manager [req-7f11cdcf-4a09-4c19-a340-fc084f9bfa8b req-fe4a6767-68c2-49cf-af45-adc7b7d94d7b service nova] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Received event network-changed-02c80090-d3ca-47eb-882f-9f29edc28895 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:28:45 user nova-compute[73078]: DEBUG nova.compute.manager [req-7f11cdcf-4a09-4c19-a340-fc084f9bfa8b req-fe4a6767-68c2-49cf-af45-adc7b7d94d7b service nova] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Refreshing instance network info cache due to event network-changed-02c80090-d3ca-47eb-882f-9f29edc28895. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:28:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-7f11cdcf-4a09-4c19-a340-fc084f9bfa8b req-fe4a6767-68c2-49cf-af45-adc7b7d94d7b service nova] Acquiring lock "refresh_cache-7ad61d3c-db7d-407f-b2ee-f2f9d9256ced" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:28:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-7f11cdcf-4a09-4c19-a340-fc084f9bfa8b req-fe4a6767-68c2-49cf-af45-adc7b7d94d7b service nova] Acquired lock "refresh_cache-7ad61d3c-db7d-407f-b2ee-f2f9d9256ced" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:28:45 user nova-compute[73078]: DEBUG nova.network.neutron [req-7f11cdcf-4a09-4c19-a340-fc084f9bfa8b req-fe4a6767-68c2-49cf-af45-adc7b7d94d7b service nova] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Refreshing network info cache for port 02c80090-d3ca-47eb-882f-9f29edc28895 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:28:45 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:45 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:45 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:45 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:46 user nova-compute[73078]: DEBUG nova.compute.manager [req-bc68b185-24ba-4628-b620-02c742d7aa8c req-32d0899a-f8c9-4b35-8478-9db09fc95e90 service nova] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Received event network-vif-plugged-33b84b58-09ca-49f0-a118-2870cd38d6d3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:28:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-bc68b185-24ba-4628-b620-02c742d7aa8c req-32d0899a-f8c9-4b35-8478-9db09fc95e90 service nova] Acquiring lock "5bf260cc-5c85-46e0-8326-7f23165065b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:28:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-bc68b185-24ba-4628-b620-02c742d7aa8c req-32d0899a-f8c9-4b35-8478-9db09fc95e90 service nova] Lock "5bf260cc-5c85-46e0-8326-7f23165065b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:28:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-bc68b185-24ba-4628-b620-02c742d7aa8c req-32d0899a-f8c9-4b35-8478-9db09fc95e90 service nova] Lock "5bf260cc-5c85-46e0-8326-7f23165065b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:28:46 user nova-compute[73078]: DEBUG nova.compute.manager [req-bc68b185-24ba-4628-b620-02c742d7aa8c req-32d0899a-f8c9-4b35-8478-9db09fc95e90 service nova] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] No waiting events found dispatching network-vif-plugged-33b84b58-09ca-49f0-a118-2870cd38d6d3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:28:46 user nova-compute[73078]: WARNING nova.compute.manager [req-bc68b185-24ba-4628-b620-02c742d7aa8c req-32d0899a-f8c9-4b35-8478-9db09fc95e90 service nova] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Received unexpected event network-vif-plugged-33b84b58-09ca-49f0-a118-2870cd38d6d3 for instance with vm_state building and task_state spawning.
Aug 14 18:28:46 user nova-compute[73078]: DEBUG nova.network.neutron [req-7f11cdcf-4a09-4c19-a340-fc084f9bfa8b req-fe4a6767-68c2-49cf-af45-adc7b7d94d7b service nova] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Updated VIF entry in instance network info cache for port 02c80090-d3ca-47eb-882f-9f29edc28895. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:28:46 user nova-compute[73078]: DEBUG nova.network.neutron [req-7f11cdcf-4a09-4c19-a340-fc084f9bfa8b req-fe4a6767-68c2-49cf-af45-adc7b7d94d7b service nova] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Updating instance_info_cache with network_info: [{"id": "02c80090-d3ca-47eb-882f-9f29edc28895", "address": "fa:16:3e:c3:46:2f", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c80090-d3", "ovs_interfaceid": "02c80090-d3ca-47eb-882f-9f29edc28895", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:28:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-7f11cdcf-4a09-4c19-a340-fc084f9bfa8b req-fe4a6767-68c2-49cf-af45-adc7b7d94d7b service nova] Releasing lock "refresh_cache-7ad61d3c-db7d-407f-b2ee-f2f9d9256ced" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:28:47 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037727.802194, 5bf260cc-5c85-46e0-8326-7f23165065b7 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:28:47 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] VM Resumed (Lifecycle Event)
Aug 14 18:28:47 user nova-compute[73078]: DEBUG nova.compute.manager [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:28:47 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:28:47 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Instance spawned successfully.
Aug 14 18:28:47 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:28:47 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:28:47 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:28:47 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:28:47 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:28:47 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:28:47 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037727.8098176, 5bf260cc-5c85-46e0-8326-7f23165065b7 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:28:47 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] VM Started (Lifecycle Event)
Aug 14 18:28:47 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:28:47 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:28:47 user nova-compute[73078]: INFO nova.compute.manager [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Took 6.26 seconds to spawn the instance on the hypervisor.
Aug 14 18:28:47 user nova-compute[73078]: DEBUG nova.compute.manager [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:28:47 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:28:48 user nova-compute[73078]: INFO nova.compute.manager [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Took 7.14 seconds to build instance.
Aug 14 18:28:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d1bb943c-2ce7-46ef-9bda-2617705c2feb tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "5bf260cc-5c85-46e0-8326-7f23165065b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.241s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:28:48 user nova-compute[73078]: DEBUG nova.compute.manager [req-417b4a7b-8a73-435c-a4cd-02726b1cdb6a req-14f19739-d112-41a0-972b-ed05a094f852 service nova] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Received event network-vif-plugged-33b84b58-09ca-49f0-a118-2870cd38d6d3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:28:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-417b4a7b-8a73-435c-a4cd-02726b1cdb6a req-14f19739-d112-41a0-972b-ed05a094f852 service nova] Acquiring lock "5bf260cc-5c85-46e0-8326-7f23165065b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:28:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-417b4a7b-8a73-435c-a4cd-02726b1cdb6a req-14f19739-d112-41a0-972b-ed05a094f852 service nova] Lock "5bf260cc-5c85-46e0-8326-7f23165065b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:28:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-417b4a7b-8a73-435c-a4cd-02726b1cdb6a req-14f19739-d112-41a0-972b-ed05a094f852 service nova] Lock "5bf260cc-5c85-46e0-8326-7f23165065b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:28:48 user nova-compute[73078]: DEBUG nova.compute.manager [req-417b4a7b-8a73-435c-a4cd-02726b1cdb6a req-14f19739-d112-41a0-972b-ed05a094f852 service nova] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] No waiting events found dispatching network-vif-plugged-33b84b58-09ca-49f0-a118-2870cd38d6d3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:28:48 user nova-compute[73078]: WARNING nova.compute.manager [req-417b4a7b-8a73-435c-a4cd-02726b1cdb6a req-14f19739-d112-41a0-972b-ed05a094f852 service nova] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Received unexpected event network-vif-plugged-33b84b58-09ca-49f0-a118-2870cd38d6d3 for instance with vm_state active and task_state None.
Aug 14 18:28:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-05416f79-87d3-44fc-b715-99008820d130 req-c910a26d-3517-453d-a345-2cf616f53857 service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Received event network-changed-ea900923-9066-4aa4-81f3-9d06fc2329f3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:28:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-05416f79-87d3-44fc-b715-99008820d130 req-c910a26d-3517-453d-a345-2cf616f53857 service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Refreshing instance network info cache due to event network-changed-ea900923-9066-4aa4-81f3-9d06fc2329f3. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:28:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-05416f79-87d3-44fc-b715-99008820d130 req-c910a26d-3517-453d-a345-2cf616f53857 service nova] Acquiring lock "refresh_cache-16abee43-684b-415f-9c77-476ffb7283e8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:28:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-05416f79-87d3-44fc-b715-99008820d130 req-c910a26d-3517-453d-a345-2cf616f53857 service nova] Acquired lock "refresh_cache-16abee43-684b-415f-9c77-476ffb7283e8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:28:51 user nova-compute[73078]: DEBUG nova.network.neutron [req-05416f79-87d3-44fc-b715-99008820d130 req-c910a26d-3517-453d-a345-2cf616f53857 service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Refreshing network info cache for port ea900923-9066-4aa4-81f3-9d06fc2329f3 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:28:52 user nova-compute[73078]: DEBUG nova.network.neutron [req-05416f79-87d3-44fc-b715-99008820d130 req-c910a26d-3517-453d-a345-2cf616f53857 service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Updated VIF entry in instance network info cache for port ea900923-9066-4aa4-81f3-9d06fc2329f3. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:28:52 user nova-compute[73078]: DEBUG nova.network.neutron [req-05416f79-87d3-44fc-b715-99008820d130 req-c910a26d-3517-453d-a345-2cf616f53857 service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Updating instance_info_cache with network_info: [{"id": "ea900923-9066-4aa4-81f3-9d06fc2329f3", "address": "fa:16:3e:80:d9:0f", "network": {"id": "4c337404-9329-43e7-bed1-7b5dc32f6cd9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-902748542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6461284f1d491c9cd726d8550a445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea900923-90", "ovs_interfaceid": "ea900923-9066-4aa4-81f3-9d06fc2329f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:28:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-05416f79-87d3-44fc-b715-99008820d130 req-c910a26d-3517-453d-a345-2cf616f53857 service nova] Releasing lock "refresh_cache-16abee43-684b-415f-9c77-476ffb7283e8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:28:52 user nova-compute[73078]: DEBUG nova.compute.manager [req-b3b1df0e-9edb-4785-ae75-faecd24aa8ed req-f24d6518-7d2f-4349-b7fd-c546ee3a912a service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Received event network-changed-ea900923-9066-4aa4-81f3-9d06fc2329f3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:28:52 user nova-compute[73078]: DEBUG nova.compute.manager [req-b3b1df0e-9edb-4785-ae75-faecd24aa8ed req-f24d6518-7d2f-4349-b7fd-c546ee3a912a service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Refreshing instance network info cache due to event network-changed-ea900923-9066-4aa4-81f3-9d06fc2329f3. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:28:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b3b1df0e-9edb-4785-ae75-faecd24aa8ed req-f24d6518-7d2f-4349-b7fd-c546ee3a912a service nova] Acquiring lock "refresh_cache-16abee43-684b-415f-9c77-476ffb7283e8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:28:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b3b1df0e-9edb-4785-ae75-faecd24aa8ed req-f24d6518-7d2f-4349-b7fd-c546ee3a912a service nova] Acquired lock "refresh_cache-16abee43-684b-415f-9c77-476ffb7283e8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:28:52 user nova-compute[73078]: DEBUG nova.network.neutron [req-b3b1df0e-9edb-4785-ae75-faecd24aa8ed req-f24d6518-7d2f-4349-b7fd-c546ee3a912a service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Refreshing network info cache for port ea900923-9066-4aa4-81f3-9d06fc2329f3 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-5f99a2e6-984a-41c7-a580-74524ed0c583 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "16abee43-684b-415f-9c77-476ffb7283e8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-5f99a2e6-984a-41c7-a580-74524ed0c583 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "16abee43-684b-415f-9c77-476ffb7283e8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:28:53 user nova-compute[73078]: INFO nova.compute.manager [None req-5f99a2e6-984a-41c7-a580-74524ed0c583 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Detaching volume 540ba89c-9cfa-4330-87cb-33348eb9968b
Aug 14 18:28:53 user nova-compute[73078]: INFO nova.virt.block_device [None req-5f99a2e6-984a-41c7-a580-74524ed0c583 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Attempting to driver detach volume 540ba89c-9cfa-4330-87cb-33348eb9968b from mountpoint /dev/vdb
Aug 14 18:28:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-5f99a2e6-984a-41c7-a580-74524ed0c583 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Attempting to detach device vdb from instance 16abee43-684b-415f-9c77-476ffb7283e8 from the persistent domain config. {{(pid=73078) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-5f99a2e6-984a-41c7-a580-74524ed0c583 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:28:53 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:28:53 user nova-compute[73078]:   <source dev="/dev/sdc"/>
Aug 14 18:28:53 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:28:53 user nova-compute[73078]:   <serial>540ba89c-9cfa-4330-87cb-33348eb9968b</serial>
Aug 14 18:28:53 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:28:53 user nova-compute[73078]: </disk>
Aug 14 18:28:53 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:28:53 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-5f99a2e6-984a-41c7-a580-74524ed0c583 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Successfully detached device vdb from instance 16abee43-684b-415f-9c77-476ffb7283e8 from the persistent domain config.
Aug 14 18:28:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-5f99a2e6-984a-41c7-a580-74524ed0c583 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 16abee43-684b-415f-9c77-476ffb7283e8 from the live domain config. {{(pid=73078) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-5f99a2e6-984a-41c7-a580-74524ed0c583 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:28:53 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:28:53 user nova-compute[73078]:   <source dev="/dev/sdc"/>
Aug 14 18:28:53 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:28:53 user nova-compute[73078]:   <serial>540ba89c-9cfa-4330-87cb-33348eb9968b</serial>
Aug 14 18:28:53 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:28:53 user nova-compute[73078]: </disk>
Aug 14 18:28:53 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG nova.network.neutron [req-b3b1df0e-9edb-4785-ae75-faecd24aa8ed req-f24d6518-7d2f-4349-b7fd-c546ee3a912a service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Updated VIF entry in instance network info cache for port ea900923-9066-4aa4-81f3-9d06fc2329f3. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG nova.network.neutron [req-b3b1df0e-9edb-4785-ae75-faecd24aa8ed req-f24d6518-7d2f-4349-b7fd-c546ee3a912a service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Updating instance_info_cache with network_info: [{"id": "ea900923-9066-4aa4-81f3-9d06fc2329f3", "address": "fa:16:3e:80:d9:0f", "network": {"id": "4c337404-9329-43e7-bed1-7b5dc32f6cd9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-902748542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6461284f1d491c9cd726d8550a445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea900923-90", "ovs_interfaceid": "ea900923-9066-4aa4-81f3-9d06fc2329f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b3b1df0e-9edb-4785-ae75-faecd24aa8ed req-f24d6518-7d2f-4349-b7fd-c546ee3a912a service nova] Releasing lock "refresh_cache-16abee43-684b-415f-9c77-476ffb7283e8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Received event <DeviceRemovedEvent: 1692037733.7498991, 16abee43-684b-415f-9c77-476ffb7283e8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73078) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-5f99a2e6-984a-41c7-a580-74524ed0c583 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 16abee43-684b-415f-9c77-476ffb7283e8 {{(pid=73078) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 18:28:53 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-5f99a2e6-984a-41c7-a580-74524ed0c583 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Successfully detached device vdb from instance 16abee43-684b-415f-9c77-476ffb7283e8 from the live domain config.
Aug 14 18:28:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f99a2e6-984a-41c7-a580-74524ed0c583 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f99a2e6-984a-41c7-a580-74524ed0c583 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LRjgnHBi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:28:53 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-5f99a2e6-984a-41c7-a580-74524ed0c583 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:28:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-5f99a2e6-984a-41c7-a580-74524ed0c583 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-5f99a2e6-984a-41c7-a580-74524ed0c583 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f99a2e6-984a-41c7-a580-74524ed0c583 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5616415f-4ffe-436b-8f74-4f1e49d31673]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3296fc91-9ffc-44f7-950d-ec02b9b383b0]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f99a2e6-984a-41c7-a580-74524ed0c583 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:28:53 user nova-compute[73078]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:28:53 user nova-compute[73078]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b (non-flash)
Aug 14 18:28:53 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:28:53 user nova-compute[73078]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af (non-flash)
Aug 14 18:28:53 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f99a2e6-984a-41c7-a580-74524ed0c583 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:28:53 user nova-compute[73078]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:28:53 user nova-compute[73078]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b (non-flash)
Aug 14 18:28:53 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:28:53 user nova-compute[73078]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af (non-flash)
Aug 14 18:28:53 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f99a2e6-984a-41c7-a580-74524ed0c583 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe98820d510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b'): ({'sdc'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-5f99a2e6-984a-41c7-a580-74524ed0c583 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Removing single pathed devices sdc {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd64c4d7-f77c-4845-9435-5ee7a4473ba6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c13d491-8ec0-4a0f-8554-bee0e81158c3]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-5f99a2e6-984a-41c7-a580-74524ed0c583 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Flushing IO for device /dev/sdc {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[df414142-4235-49ce-9aab-45d3b193f95e]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-5f99a2e6-984a-41c7-a580-74524ed0c583 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[db471ecf-7f75-4631-8a75-bf74a872b519]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-5f99a2e6-984a-41c7-a580-74524ed0c583 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-5f99a2e6-984a-41c7-a580-74524ed0c583 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] SCSI volumes sdc have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f99a2e6-984a-41c7-a580-74524ed0c583 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98b2a1c-7c93-4571-b115-9650467f62e3]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f99a2e6-984a-41c7-a580-74524ed0c583 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:28:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:28:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:28:54 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4019bdd-f240-4854-a256-71fe3f542e7f]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:28:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f99a2e6-984a-41c7-a580-74524ed0c583 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b, portal: 172.16.0.220,3260]
Aug 14 18:28:54 user nova-compute[73078]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b, portal: 172.16.0.220,3260] successful.
Aug 14 18:28:54 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:28:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:28:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:540ba89c-9cfa-4330-87cb-33348eb9968b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:28:54 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2a573e-fb24-4412-b42c-0df58f3e7a8a]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:28:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f99a2e6-984a-41c7-a580-74524ed0c583 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:28:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-5f99a2e6-984a-41c7-a580-74524ed0c583 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:28:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f99a2e6-984a-41c7-a580-74524ed0c583 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] <== disconnect_volume: return (306ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:28:54 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f99a2e6-984a-41c7-a580-74524ed0c583 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:28:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:28:54 user nova-compute[73078]: DEBUG nova.objects.instance [None req-5f99a2e6-984a-41c7-a580-74524ed0c583 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lazy-loading 'flavor' on Instance uuid 16abee43-684b-415f-9c77-476ffb7283e8 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:28:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-5f99a2e6-984a-41c7-a580-74524ed0c583 tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "16abee43-684b-415f-9c77-476ffb7283e8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.740s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:28:56 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:28:56 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:28:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-8ebc48e0-0a24-4421-b180-f14eacc636ad" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:28:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-8ebc48e0-0a24-4421-b180-f14eacc636ad" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:28:56 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:28:56 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Updating instance_info_cache with network_info: [{"id": "de400e10-3372-4eb4-b121-48ed70e471d3", "address": "fa:16:3e:9d:54:60", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde400e10-33", "ovs_interfaceid": "de400e10-3372-4eb4-b121-48ed70e471d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:28:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-8ebc48e0-0a24-4421-b180-f14eacc636ad" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:28:56 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:28:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "f6c3a593-c42a-497e-8470-f87be7828a56" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:28:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "f6c3a593-c42a-497e-8470-f87be7828a56" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:28:56 user nova-compute[73078]: DEBUG nova.compute.manager [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:28:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:28:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:28:56 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:28:56 user nova-compute[73078]: INFO nova.compute.claims [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Claim successful on node user
Aug 14 18:28:57 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:28:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:28:57 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:28:57 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:28:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:28:57 user nova-compute[73078]: DEBUG nova.compute.manager [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:28:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.229s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:28:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:28:57 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:28:57 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:28:57 user nova-compute[73078]: DEBUG nova.compute.manager [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:28:57 user nova-compute[73078]: DEBUG nova.network.neutron [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:28:57 user nova-compute[73078]: DEBUG nova.compute.manager [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:28:57 user nova-compute[73078]: INFO nova.virt.block_device [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Booting with volume snapshot 27b18d53-0c39-48ba-b8c8-a1416a3b33df at /dev/vda
Aug 14 18:28:57 user nova-compute[73078]: DEBUG nova.policy [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe79455616584e0fb80e6007edf0b706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7142101014c4defa7261a34fb9f28e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:28:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:28:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:28:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:28:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:28:57 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:28:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:28:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:28:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:28:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:28:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7587b9-995f-4b71-829d-223c6f520527/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:28:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7587b9-995f-4b71-829d-223c6f520527/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:28:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7587b9-995f-4b71-829d-223c6f520527/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:28:58 user nova-compute[73078]: DEBUG nova.network.neutron [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Successfully created port: 674a05ec-043f-429c-9dee-7d77ade5ec7b {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:28:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef7587b9-995f-4b71-829d-223c6f520527/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:28:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:28:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:28:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:28:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:28:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16abee43-684b-415f-9c77-476ffb7283e8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:28:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:28:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16abee43-684b-415f-9c77-476ffb7283e8/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:28:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16abee43-684b-415f-9c77-476ffb7283e8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:28:59 user nova-compute[73078]: DEBUG nova.network.neutron [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Successfully updated port: 674a05ec-043f-429c-9dee-7d77ade5ec7b {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:28:59 user nova-compute[73078]: DEBUG nova.compute.manager [req-b711f5da-5254-4f65-9149-733aea46b308 req-9fb9b89e-a221-444a-b751-128b82c8f721 service nova] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Received event network-changed-674a05ec-043f-429c-9dee-7d77ade5ec7b {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:28:59 user nova-compute[73078]: DEBUG nova.compute.manager [req-b711f5da-5254-4f65-9149-733aea46b308 req-9fb9b89e-a221-444a-b751-128b82c8f721 service nova] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Refreshing instance network info cache due to event network-changed-674a05ec-043f-429c-9dee-7d77ade5ec7b. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:28:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b711f5da-5254-4f65-9149-733aea46b308 req-9fb9b89e-a221-444a-b751-128b82c8f721 service nova] Acquiring lock "refresh_cache-f6c3a593-c42a-497e-8470-f87be7828a56" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:28:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b711f5da-5254-4f65-9149-733aea46b308 req-9fb9b89e-a221-444a-b751-128b82c8f721 service nova] Acquired lock "refresh_cache-f6c3a593-c42a-497e-8470-f87be7828a56" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:28:59 user nova-compute[73078]: DEBUG nova.network.neutron [req-b711f5da-5254-4f65-9149-733aea46b308 req-9fb9b89e-a221-444a-b751-128b82c8f721 service nova] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Refreshing network info cache for port 674a05ec-043f-429c-9dee-7d77ade5ec7b {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:28:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "refresh_cache-f6c3a593-c42a-497e-8470-f87be7828a56" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:28:59 user nova-compute[73078]: DEBUG nova.network.neutron [req-b711f5da-5254-4f65-9149-733aea46b308 req-9fb9b89e-a221-444a-b751-128b82c8f721 service nova] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:28:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16abee43-684b-415f-9c77-476ffb7283e8/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:28:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:28:59 user nova-compute[73078]: DEBUG nova.network.neutron [req-b711f5da-5254-4f65-9149-733aea46b308 req-9fb9b89e-a221-444a-b751-128b82c8f721 service nova] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:28:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b711f5da-5254-4f65-9149-733aea46b308 req-9fb9b89e-a221-444a-b751-128b82c8f721 service nova] Releasing lock "refresh_cache-f6c3a593-c42a-497e-8470-f87be7828a56" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:28:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquired lock "refresh_cache-f6c3a593-c42a-497e-8470-f87be7828a56" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:28:59 user nova-compute[73078]: DEBUG nova.network.neutron [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:28:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:28:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:28:59 user nova-compute[73078]: DEBUG nova.network.neutron [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:29:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:00 user nova-compute[73078]: DEBUG nova.network.neutron [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Updating instance_info_cache with network_info: [{"id": "674a05ec-043f-429c-9dee-7d77ade5ec7b", "address": "fa:16:3e:2a:09:93", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap674a05ec-04", "ovs_interfaceid": "674a05ec-043f-429c-9dee-7d77ade5ec7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:29:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Releasing lock "refresh_cache-f6c3a593-c42a-497e-8470-f87be7828a56" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:29:00 user nova-compute[73078]: DEBUG nova.compute.manager [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Instance network_info: |[{"id": "674a05ec-043f-429c-9dee-7d77ade5ec7b", "address": "fa:16:3e:2a:09:93", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap674a05ec-04", "ovs_interfaceid": "674a05ec-043f-429c-9dee-7d77ade5ec7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:29:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:00 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:29:00 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:29:00 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:29:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bf260cc-5c85-46e0-8326-7f23165065b7/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:00 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bf260cc-5c85-46e0-8326-7f23165065b7/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bf260cc-5c85-46e0-8326-7f23165065b7/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bf260cc-5c85-46e0-8326-7f23165065b7/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:01 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:29:01 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:29:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=7201MB free_disk=24.838180541992188GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:29:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:29:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:29:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 1f88cb97-4f22-439e-99f2-d7cb8d5aff36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:29:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 61dfe42b-c943-4617-bf8e-745eaf1a1bb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:29:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 3088da30-65b7-4801-b425-93df4fca6ad8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:29:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 8ebc48e0-0a24-4421-b180-f14eacc636ad actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:29:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 16abee43-684b-415f-9c77-476ffb7283e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:29:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance ef083dd3-67d6-48a8-846a-7fe6c6b32d5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:29:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:29:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:29:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 2f960239-8deb-4d9f-9cab-eea0274aca38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:29:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance ef7587b9-995f-4b71-829d-223c6f520527 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:29:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 5bf260cc-5c85-46e0-8326-7f23165065b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:29:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance f6c3a593-c42a-497e-8470-f87be7828a56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:29:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:29:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:29:01 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:29:01 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:29:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:29:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.522s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:29:02 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:29:02 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:29:02 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:29:02 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:29:02 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:29:02 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:29:02 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:29:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:29:03 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:29:03 user nova-compute[73078]: DEBUG os_brick.utils [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:29:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:03 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[103e5b4e-f2c0-4518-8e9b-6e0197f07655]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:03 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f8acb5-21bf-40fc-8e1d-30a2d7965420]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:03 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1629c448-0268-4cda-9d35-58b68145c834]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:03 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a57b723-52c2-4282-accb-7f6c7ae5e61a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:29:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:29:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:29:03 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:29:03 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6250172-3c0d-463f-bf11-62bdf8a228d8]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:29:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:29:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:29:03 user nova-compute[73078]: DEBUG os_brick.utils [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:29:03 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Updating existing volume attachment record: de39f64a-6cda-4483-92da-54523c8788c7 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:29:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:29:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:29:12 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Creating image(s)
Aug 14 18:29:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Did not create local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 18:29:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Ensure instance console log exists: /opt/stack/data/nova/instances/f6c3a593-c42a-497e-8470-f87be7828a56/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:29:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:29:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:29:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:29:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Start _get_guest_xml network_info=[{"id": "674a05ec-043f-429c-9dee-7d77ade5ec7b", "address": "fa:16:3e:2a:09:93", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap674a05ec-04", "ovs_interfaceid": "674a05ec-043f-429c-9dee-7d77ade5ec7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-14T18:28:47Z,direct_url=<?>,disk_format='qcow2',id=2146a8cf-70f0-4b53-93b4-c60a69daf9ca,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1780322949',owner='e7142101014c4defa7261a34fb9f28e4',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-14T18:28:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'de39f64a-6cda-4483-92da-54523c8788c7', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xnUKaigj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f6c3a593-c42a-497e-8470-f87be7828a56', 'attached_at': '', 'detached_at': '', 'volume_id': 'a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7', 'serial': 'a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7'}, 'volume_type': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:29:12 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:29:12 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:29:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:29:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:29:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:29:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:29:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:29:12 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-14T18:28:47Z,direct_url=<?>,disk_format='qcow2',id=2146a8cf-70f0-4b53-93b4-c60a69daf9ca,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1780322949',owner='e7142101014c4defa7261a34fb9f28e4',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-14T18:28:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:29:12 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:29:12 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:29:12 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:29:12 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:29:12 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:29:12 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:29:12 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:29:12 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:29:12 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:29:12 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:29:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:29:12 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xnUKaigj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:29:12 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:29:12 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:29:12 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:29:12 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:29:12 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:29:12 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:29:12 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:29:12 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:12 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:12 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb8f856-9acb-4346-8707-5cca57008abd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:12 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:29:12 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:29:12 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[643a7a51-47d3-4a40-bc92-11683ed6ad22]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7] added
Aug 14 18:29:13 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad880d3-5903-44c2-84a6-a87a86cb384f]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a55d11-e4fc-4077-a97a-a8e774bc1b78]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xnUKaigj {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xnUKaigj" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[54de9dc6-9fea-4992-beaf-11412dcd737b]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xnUKaigj'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3219f80-a0ed-47ac-b79d-b2e0c6381641]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0100e25-19f4-4c50-af18-5a617594c53b]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:29:13 user nova-compute[73078]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:29:13 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:29:13 user nova-compute[73078]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af (non-flash)
Aug 14 18:29:13 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:29:13 user nova-compute[73078]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:29:13 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:29:13 user nova-compute[73078]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af (non-flash)
Aug 14 18:29:13 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e8507e-5edd-4a70-bc78-1c4787082d80]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7, portal: 172.16.0.220,3260]
Aug 14 18:29:13 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7, portal: 172.16.0.220,3260] successful.
Aug 14 18:29:13 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4ea932-6dd1-4cc7-b7c5-d33552d13d39]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6016c343-91f3-41a2-9616-ef86ae743cf1]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:29:13 user nova-compute[73078]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:29:13 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:29:13 user nova-compute[73078]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af (non-flash)
Aug 14 18:29:13 user nova-compute[73078]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 (non-flash)
Aug 14 18:29:13 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:29:13 user nova-compute[73078]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:29:13 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:29:13 user nova-compute[73078]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af (non-flash)
Aug 14 18:29:13 user nova-compute[73078]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 (non-flash)
Aug 14 18:29:13 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc7cac2-b11e-4e0f-b687-c0e1044be7f6]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xnUKaigj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:29:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:14 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:29:14 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23833616134366530', 'path': '/dev/sdc'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:29:14 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833616134366530', 'path': '/dev/sdc'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:29:14 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:28:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2094980478',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2094980478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2094980478',id=39,image_ref='2146a8cf-70f0-4b53-93b4-c60a69daf9ca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOclhEanEuGVmBktXH02lpjr6vdTrXMLdHVbOibcfQB+lrMAremSipx9f9aiQqwrOhN4NmtnIBabiGWzcrdP+7ulXyPlWOpUtLRo5W6XTqSpVbNsu5PibQkmwWqr3IJY2A==',key_name='tempest-keypair-357822921',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7142101014c4defa7261a34fb9f28e4',ramdisk_id='',reservation_id='r-lyvxhb9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1889877750',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1889877750-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1889877750',owner_user_name='tempest-TestVolumeBootPattern-1889877750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:28:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe79455616584e0fb80e6007edf0b706',uuid=f6c3a593-c42a-497e-8470-f87be7828a56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "674a05ec-043f-429c-9dee-7d77ade5ec7b", "address": "fa:16:3e:2a:09:93", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap674a05ec-04", "ovs_interfaceid": "674a05ec-043f-429c-9dee-7d77ade5ec7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:29:14 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Converting VIF {"id": "674a05ec-043f-429c-9dee-7d77ade5ec7b", "address": "fa:16:3e:2a:09:93", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap674a05ec-04", "ovs_interfaceid": "674a05ec-043f-429c-9dee-7d77ade5ec7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:29:14 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:09:93,bridge_name='br-int',has_traffic_filtering=True,id=674a05ec-043f-429c-9dee-7d77ade5ec7b,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap674a05ec-04') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:29:14 user nova-compute[73078]: DEBUG nova.objects.instance [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lazy-loading 'pci_devices' on Instance uuid f6c3a593-c42a-497e-8470-f87be7828a56 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:29:14 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:29:14 user nova-compute[73078]:   <uuid>f6c3a593-c42a-497e-8470-f87be7828a56</uuid>
Aug 14 18:29:14 user nova-compute[73078]:   <name>instance-00000027</name>
Aug 14 18:29:14 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:29:14 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:29:14 user nova-compute[73078]:   <metadata>
Aug 14 18:29:14 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:29:14 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:29:14 user nova-compute[73078]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-2094980478</nova:name>
Aug 14 18:29:14 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:29:12</nova:creationTime>
Aug 14 18:29:14 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:29:14 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:29:14 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:29:14 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:29:14 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:29:14 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:29:14 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:29:14 user nova-compute[73078]:       <nova:owner>
Aug 14 18:29:14 user nova-compute[73078]:         <nova:user uuid="fe79455616584e0fb80e6007edf0b706">tempest-TestVolumeBootPattern-1889877750-project-member</nova:user>
Aug 14 18:29:14 user nova-compute[73078]:         <nova:project uuid="e7142101014c4defa7261a34fb9f28e4">tempest-TestVolumeBootPattern-1889877750</nova:project>
Aug 14 18:29:14 user nova-compute[73078]:       </nova:owner>
Aug 14 18:29:14 user nova-compute[73078]:       <nova:root type="image" uuid="2146a8cf-70f0-4b53-93b4-c60a69daf9ca"/>
Aug 14 18:29:14 user nova-compute[73078]:       <nova:ports>
Aug 14 18:29:14 user nova-compute[73078]:         <nova:port uuid="674a05ec-043f-429c-9dee-7d77ade5ec7b">
Aug 14 18:29:14 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 18:29:14 user nova-compute[73078]:         </nova:port>
Aug 14 18:29:14 user nova-compute[73078]:       </nova:ports>
Aug 14 18:29:14 user nova-compute[73078]:     </nova:instance>
Aug 14 18:29:14 user nova-compute[73078]:   </metadata>
Aug 14 18:29:14 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:29:14 user nova-compute[73078]:     <system>
Aug 14 18:29:14 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:29:14 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:29:14 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:29:14 user nova-compute[73078]:       <entry name="serial">f6c3a593-c42a-497e-8470-f87be7828a56</entry>
Aug 14 18:29:14 user nova-compute[73078]:       <entry name="uuid">f6c3a593-c42a-497e-8470-f87be7828a56</entry>
Aug 14 18:29:14 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:29:14 user nova-compute[73078]:     </system>
Aug 14 18:29:14 user nova-compute[73078]:   </sysinfo>
Aug 14 18:29:14 user nova-compute[73078]:   <os>
Aug 14 18:29:14 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:29:14 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:29:14 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:29:14 user nova-compute[73078]:   </os>
Aug 14 18:29:14 user nova-compute[73078]:   <features>
Aug 14 18:29:14 user nova-compute[73078]:     <acpi/>
Aug 14 18:29:14 user nova-compute[73078]:     <apic/>
Aug 14 18:29:14 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:29:14 user nova-compute[73078]:   </features>
Aug 14 18:29:14 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:29:14 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:29:14 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:29:14 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:29:14 user nova-compute[73078]:   </clock>
Aug 14 18:29:14 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:29:14 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:29:14 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:29:14 user nova-compute[73078]:   </cpu>
Aug 14 18:29:14 user nova-compute[73078]:   <devices>
Aug 14 18:29:14 user nova-compute[73078]:     <disk type="block" device="disk">
Aug 14 18:29:14 user nova-compute[73078]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:29:14 user nova-compute[73078]:       <source dev="/dev/sdc"/>
Aug 14 18:29:14 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:29:14 user nova-compute[73078]:       <serial>a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7</serial>
Aug 14 18:29:14 user nova-compute[73078]:     </disk>
Aug 14 18:29:14 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:29:14 user nova-compute[73078]:       <mac address="fa:16:3e:2a:09:93"/>
Aug 14 18:29:14 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:29:14 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:29:14 user nova-compute[73078]:       <target dev="tap674a05ec-04"/>
Aug 14 18:29:14 user nova-compute[73078]:     </interface>
Aug 14 18:29:14 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:29:14 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/f6c3a593-c42a-497e-8470-f87be7828a56/console.log" append="off"/>
Aug 14 18:29:14 user nova-compute[73078]:     </serial>
Aug 14 18:29:14 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:29:14 user nova-compute[73078]:     <video>
Aug 14 18:29:14 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:29:14 user nova-compute[73078]:     </video>
Aug 14 18:29:14 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:29:14 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:29:14 user nova-compute[73078]:     </rng>
Aug 14 18:29:14 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:29:14 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:29:14 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:29:14 user nova-compute[73078]:     </memballoon>
Aug 14 18:29:14 user nova-compute[73078]:   </devices>
Aug 14 18:29:14 user nova-compute[73078]: </domain>
Aug 14 18:29:14 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:29:14 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:28:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2094980478',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2094980478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2094980478',id=39,image_ref='2146a8cf-70f0-4b53-93b4-c60a69daf9ca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOclhEanEuGVmBktXH02lpjr6vdTrXMLdHVbOibcfQB+lrMAremSipx9f9aiQqwrOhN4NmtnIBabiGWzcrdP+7ulXyPlWOpUtLRo5W6XTqSpVbNsu5PibQkmwWqr3IJY2A==',key_name='tempest-keypair-357822921',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7142101014c4defa7261a34fb9f28e4',ramdisk_id='',reservation_id='r-lyvxhb9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1889877750',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1889877750-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1889877750',owner_user_name='tempest-TestVolumeBootPattern-1889877750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:28:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe79455616584e0fb80e6007edf0b706',uuid=f6c3a593-c42a-497e-8470-f87be7828a56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "674a05ec-043f-429c-9dee-7d77ade5ec7b", "address": "fa:16:3e:2a:09:93", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap674a05ec-04", "ovs_interfaceid": "674a05ec-043f-429c-9dee-7d77ade5ec7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:29:14 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Converting VIF {"id": "674a05ec-043f-429c-9dee-7d77ade5ec7b", "address": "fa:16:3e:2a:09:93", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap674a05ec-04", "ovs_interfaceid": "674a05ec-043f-429c-9dee-7d77ade5ec7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:29:14 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:09:93,bridge_name='br-int',has_traffic_filtering=True,id=674a05ec-043f-429c-9dee-7d77ade5ec7b,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap674a05ec-04') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:29:14 user nova-compute[73078]: DEBUG os_vif [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:09:93,bridge_name='br-int',has_traffic_filtering=True,id=674a05ec-043f-429c-9dee-7d77ade5ec7b,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap674a05ec-04') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:29:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:29:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:29:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap674a05ec-04, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:29:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap674a05ec-04, col_values=(('external_ids', {'iface-id': '674a05ec-043f-429c-9dee-7d77ade5ec7b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:09:93', 'vm-uuid': 'f6c3a593-c42a-497e-8470-f87be7828a56'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:29:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:29:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:14 user nova-compute[73078]: INFO os_vif [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:09:93,bridge_name='br-int',has_traffic_filtering=True,id=674a05ec-043f-429c-9dee-7d77ade5ec7b,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap674a05ec-04')
Aug 14 18:29:14 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:29:14 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] No VIF found with MAC fa:16:3e:2a:09:93, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:29:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:15 user nova-compute[73078]: DEBUG nova.compute.manager [req-467a7c84-0fae-4116-ac03-a22b5da314c5 req-40052c15-8576-43d7-996f-1f33d42e62d4 service nova] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Received event network-vif-plugged-674a05ec-043f-429c-9dee-7d77ade5ec7b {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:29:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-467a7c84-0fae-4116-ac03-a22b5da314c5 req-40052c15-8576-43d7-996f-1f33d42e62d4 service nova] Acquiring lock "f6c3a593-c42a-497e-8470-f87be7828a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:29:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-467a7c84-0fae-4116-ac03-a22b5da314c5 req-40052c15-8576-43d7-996f-1f33d42e62d4 service nova] Lock "f6c3a593-c42a-497e-8470-f87be7828a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:29:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-467a7c84-0fae-4116-ac03-a22b5da314c5 req-40052c15-8576-43d7-996f-1f33d42e62d4 service nova] Lock "f6c3a593-c42a-497e-8470-f87be7828a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:29:15 user nova-compute[73078]: DEBUG nova.compute.manager [req-467a7c84-0fae-4116-ac03-a22b5da314c5 req-40052c15-8576-43d7-996f-1f33d42e62d4 service nova] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] No waiting events found dispatching network-vif-plugged-674a05ec-043f-429c-9dee-7d77ade5ec7b {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:29:15 user nova-compute[73078]: WARNING nova.compute.manager [req-467a7c84-0fae-4116-ac03-a22b5da314c5 req-40052c15-8576-43d7-996f-1f33d42e62d4 service nova] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Received unexpected event network-vif-plugged-674a05ec-043f-429c-9dee-7d77ade5ec7b for instance with vm_state building and task_state spawning.
Aug 14 18:29:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "8ebc48e0-0a24-4421-b180-f14eacc636ad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:29:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "8ebc48e0-0a24-4421-b180-f14eacc636ad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:29:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "8ebc48e0-0a24-4421-b180-f14eacc636ad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:29:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "8ebc48e0-0a24-4421-b180-f14eacc636ad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:29:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "8ebc48e0-0a24-4421-b180-f14eacc636ad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:29:17 user nova-compute[73078]: INFO nova.compute.manager [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Terminating instance
Aug 14 18:29:17 user nova-compute[73078]: DEBUG nova.compute.manager [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:29:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:17 user nova-compute[73078]: DEBUG nova.compute.manager [req-a1ad3de9-e46a-4a89-91f7-93c4986e8c9c req-72107c4c-71dc-44f5-a14c-c37078c31f40 service nova] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Received event network-vif-unplugged-de400e10-3372-4eb4-b121-48ed70e471d3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:29:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a1ad3de9-e46a-4a89-91f7-93c4986e8c9c req-72107c4c-71dc-44f5-a14c-c37078c31f40 service nova] Acquiring lock "8ebc48e0-0a24-4421-b180-f14eacc636ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:29:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a1ad3de9-e46a-4a89-91f7-93c4986e8c9c req-72107c4c-71dc-44f5-a14c-c37078c31f40 service nova] Lock "8ebc48e0-0a24-4421-b180-f14eacc636ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:29:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a1ad3de9-e46a-4a89-91f7-93c4986e8c9c req-72107c4c-71dc-44f5-a14c-c37078c31f40 service nova] Lock "8ebc48e0-0a24-4421-b180-f14eacc636ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:29:17 user nova-compute[73078]: DEBUG nova.compute.manager [req-a1ad3de9-e46a-4a89-91f7-93c4986e8c9c req-72107c4c-71dc-44f5-a14c-c37078c31f40 service nova] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] No waiting events found dispatching network-vif-unplugged-de400e10-3372-4eb4-b121-48ed70e471d3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:29:17 user nova-compute[73078]: DEBUG nova.compute.manager [req-a1ad3de9-e46a-4a89-91f7-93c4986e8c9c req-72107c4c-71dc-44f5-a14c-c37078c31f40 service nova] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Received event network-vif-unplugged-de400e10-3372-4eb4-b121-48ed70e471d3 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:29:17 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037757.7362862, f6c3a593-c42a-497e-8470-f87be7828a56 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:29:17 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] VM Resumed (Lifecycle Event)
Aug 14 18:29:17 user nova-compute[73078]: DEBUG nova.compute.manager [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:29:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:29:17 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Instance spawned successfully.
Aug 14 18:29:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:29:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:29:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:29:17 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:29:17 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:29:17 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:29:17 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037757.7414298, f6c3a593-c42a-497e-8470-f87be7828a56 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:29:17 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] VM Started (Lifecycle Event)
Aug 14 18:29:17 user nova-compute[73078]: INFO nova.compute.manager [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Took 4.94 seconds to spawn the instance on the hypervisor.
Aug 14 18:29:17 user nova-compute[73078]: DEBUG nova.compute.manager [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:29:17 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:29:17 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:29:17 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:29:17 user nova-compute[73078]: DEBUG nova.compute.manager [req-5104813c-ce81-4ab1-9604-da5cc7b9164c req-28dbfdf5-9c65-41e6-b9ae-11269e71cee9 service nova] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Received event network-vif-plugged-674a05ec-043f-429c-9dee-7d77ade5ec7b {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:29:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5104813c-ce81-4ab1-9604-da5cc7b9164c req-28dbfdf5-9c65-41e6-b9ae-11269e71cee9 service nova] Acquiring lock "f6c3a593-c42a-497e-8470-f87be7828a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:29:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5104813c-ce81-4ab1-9604-da5cc7b9164c req-28dbfdf5-9c65-41e6-b9ae-11269e71cee9 service nova] Lock "f6c3a593-c42a-497e-8470-f87be7828a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:29:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5104813c-ce81-4ab1-9604-da5cc7b9164c req-28dbfdf5-9c65-41e6-b9ae-11269e71cee9 service nova] Lock "f6c3a593-c42a-497e-8470-f87be7828a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:29:17 user nova-compute[73078]: DEBUG nova.compute.manager [req-5104813c-ce81-4ab1-9604-da5cc7b9164c req-28dbfdf5-9c65-41e6-b9ae-11269e71cee9 service nova] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] No waiting events found dispatching network-vif-plugged-674a05ec-043f-429c-9dee-7d77ade5ec7b {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:29:17 user nova-compute[73078]: WARNING nova.compute.manager [req-5104813c-ce81-4ab1-9604-da5cc7b9164c req-28dbfdf5-9c65-41e6-b9ae-11269e71cee9 service nova] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Received unexpected event network-vif-plugged-674a05ec-043f-429c-9dee-7d77ade5ec7b for instance with vm_state active and task_state None.
Aug 14 18:29:17 user nova-compute[73078]: INFO nova.compute.manager [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Took 21.06 seconds to build instance.
Aug 14 18:29:17 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Instance destroyed successfully.
Aug 14 18:29:17 user nova-compute[73078]: DEBUG nova.objects.instance [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lazy-loading 'resources' on Instance uuid 8ebc48e0-0a24-4421-b180-f14eacc636ad {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:29:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:22:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1344711315',display_name='tempest-ServerActionsTestOtherA-server-1344711315',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1344711315',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuBLKmid5aFtC8N9oGYPXkgiYGtDjSt/w1+99DQRyNH3SIh+uGteRP9ufywJ7TgR1607B3dJ2h6LnLGhohKOdL1yNPsWQsmTBErDFfyfHJa2VycZ+ceyQwLi9NhHpa6xg==',key_name='tempest-keypair-1366091689',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:24:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='993dd55f40454640824687ffb6a3c581',ramdisk_id='',reservation_id='r-o28i8x37',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1876890021',owner_user_name='tempest-ServerActionsTestOtherA-1876890021-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:26:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cca1112ab354f9fb31658e18c0d03b1',uuid=8ebc48e0-0a24-4421-b180-f14eacc636ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de400e10-3372-4eb4-b121-48ed70e471d3", "address": "fa:16:3e:9d:54:60", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde400e10-33", "ovs_interfaceid": "de400e10-3372-4eb4-b121-48ed70e471d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:29:17 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Converting VIF {"id": "de400e10-3372-4eb4-b121-48ed70e471d3", "address": "fa:16:3e:9d:54:60", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde400e10-33", "ovs_interfaceid": "de400e10-3372-4eb4-b121-48ed70e471d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:29:17 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:54:60,bridge_name='br-int',has_traffic_filtering=True,id=de400e10-3372-4eb4-b121-48ed70e471d3,network=Network(bfef9745-5a40-44b6-a6d5-2ef1e77fc5db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde400e10-33') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:29:17 user nova-compute[73078]: DEBUG os_vif [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:54:60,bridge_name='br-int',has_traffic_filtering=True,id=de400e10-3372-4eb4-b121-48ed70e471d3,network=Network(bfef9745-5a40-44b6-a6d5-2ef1e77fc5db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde400e10-33') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:29:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-525a5e32-fd4e-4975-89fa-86baeb7a7c30 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "f6c3a593-c42a-497e-8470-f87be7828a56" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.172s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:29:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde400e10-33, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:29:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:29:18 user nova-compute[73078]: INFO os_vif [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:54:60,bridge_name='br-int',has_traffic_filtering=True,id=de400e10-3372-4eb4-b121-48ed70e471d3,network=Network(bfef9745-5a40-44b6-a6d5-2ef1e77fc5db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde400e10-33')
Aug 14 18:29:18 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxmiXRqA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:29:18 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:29:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1059df0b-c640-4847-b72d-9c2cc1604e4c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d29168-4e41-49f5-afce-0ff076bbac44]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:29:18 user nova-compute[73078]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:29:18 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:29:18 user nova-compute[73078]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af (non-flash)
Aug 14 18:29:18 user nova-compute[73078]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 (non-flash)
Aug 14 18:29:18 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:29:18 user nova-compute[73078]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb (non-flash)
Aug 14 18:29:18 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:29:18 user nova-compute[73078]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af (non-flash)
Aug 14 18:29:18 user nova-compute[73078]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 (non-flash)
Aug 14 18:29:18 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9783cbbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb'): ({'sde'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Removing single pathed devices sde {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5aa44ee-59fe-41e0-b3c7-6453735b7796]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[76549a29-2744-4cc7-bec6-95dd0afa037b]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Flushing IO for device /dev/sde {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f335e5-528c-477c-b2b1-5a7b6281ea17]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e39bee0-7369-4b6b-b11d-fddd82f70e4e]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] SCSI volumes sde have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23364613930663831', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8faef669', '/dev/disk/by-id/scsi-1SCST_BIO8faef669-3da90f81d448772a') {{(pid=84732) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65d27e7-711c-4ecf-adc0-d11b600ca619]: (4, None) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ae18ec-219f-4c9d-995d-0a7f2d0c3887]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3b68fc-ca87-4de9-a071-6ef08fcc2ebd]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb, portal: 172.16.0.220,3260]
Aug 14 18:29:18 user nova-compute[73078]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb, portal: 172.16.0.220,3260] successful.
Aug 14 18:29:18 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:394c2c9e-1cec-4548-8c12-2699fdd049cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[454b35c8-52bd-4a13-8149-e22aa2dbdf0c]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] <== disconnect_volume: return (340ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:29:18 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Deleting instance files /opt/stack/data/nova/instances/8ebc48e0-0a24-4421-b180-f14eacc636ad_del
Aug 14 18:29:18 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Deletion of /opt/stack/data/nova/instances/8ebc48e0-0a24-4421-b180-f14eacc636ad_del complete
Aug 14 18:29:18 user nova-compute[73078]: INFO nova.compute.manager [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 14 18:29:18 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:29:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:19 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:29:19 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Took 0.92 seconds to deallocate network for instance.
Aug 14 18:29:19 user nova-compute[73078]: DEBUG nova.compute.manager [req-326502e3-1af5-457a-bd5f-6501c384ee3a req-db407496-8c7a-4d9f-906b-cb0ac6ff708b service nova] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Received event network-vif-plugged-de400e10-3372-4eb4-b121-48ed70e471d3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:29:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-326502e3-1af5-457a-bd5f-6501c384ee3a req-db407496-8c7a-4d9f-906b-cb0ac6ff708b service nova] Acquiring lock "8ebc48e0-0a24-4421-b180-f14eacc636ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:29:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-326502e3-1af5-457a-bd5f-6501c384ee3a req-db407496-8c7a-4d9f-906b-cb0ac6ff708b service nova] Lock "8ebc48e0-0a24-4421-b180-f14eacc636ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:29:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-326502e3-1af5-457a-bd5f-6501c384ee3a req-db407496-8c7a-4d9f-906b-cb0ac6ff708b service nova] Lock "8ebc48e0-0a24-4421-b180-f14eacc636ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:29:19 user nova-compute[73078]: DEBUG nova.compute.manager [req-326502e3-1af5-457a-bd5f-6501c384ee3a req-db407496-8c7a-4d9f-906b-cb0ac6ff708b service nova] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] No waiting events found dispatching network-vif-plugged-de400e10-3372-4eb4-b121-48ed70e471d3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:29:19 user nova-compute[73078]: WARNING nova.compute.manager [req-326502e3-1af5-457a-bd5f-6501c384ee3a req-db407496-8c7a-4d9f-906b-cb0ac6ff708b service nova] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Received unexpected event network-vif-plugged-de400e10-3372-4eb4-b121-48ed70e471d3 for instance with vm_state active and task_state deleting.
Aug 14 18:29:19 user nova-compute[73078]: DEBUG nova.compute.manager [req-326502e3-1af5-457a-bd5f-6501c384ee3a req-db407496-8c7a-4d9f-906b-cb0ac6ff708b service nova] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Received event network-vif-deleted-de400e10-3372-4eb4-b121-48ed70e471d3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:29:20 user nova-compute[73078]: INFO nova.compute.manager [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Took 0.82 seconds to detach 1 volumes for instance.
Aug 14 18:29:20 user nova-compute[73078]: DEBUG nova.compute.manager [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Deleting volume: 394c2c9e-1cec-4548-8c12-2699fdd049cb {{(pid=73078) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 18:29:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:29:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:29:20 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:29:20 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:29:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.420s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:29:20 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Deleted allocations for instance 8ebc48e0-0a24-4421-b180-f14eacc636ad
Aug 14 18:29:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-7ca88ab9-da9c-4b1d-91de-48379f19c9ae tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "8ebc48e0-0a24-4421-b180-f14eacc636ad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.644s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:29:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:32 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692037757.9468412, 8ebc48e0-0a24-4421-b180-f14eacc636ad => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:29:32 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] VM Stopped (Lifecycle Event)
Aug 14 18:29:32 user nova-compute[73078]: DEBUG nova.compute.manager [None req-3d8da304-ea30-4dc9-b812-2e00643cec56 None None] [instance: 8ebc48e0-0a24-4421-b180-f14eacc636ad] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:29:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:29:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:29:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:29:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:29:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:35 user nova-compute[73078]: DEBUG nova.compute.manager [req-acc85c5a-71cb-4fbe-9a1b-0bd7d93a2be5 req-dad55efc-14e9-4597-a4db-5ed704a7ae24 service nova] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Received event network-changed-665b631d-4caf-4f3f-8c30-3a8ab77e79c0 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:29:35 user nova-compute[73078]: DEBUG nova.compute.manager [req-acc85c5a-71cb-4fbe-9a1b-0bd7d93a2be5 req-dad55efc-14e9-4597-a4db-5ed704a7ae24 service nova] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Refreshing instance network info cache due to event network-changed-665b631d-4caf-4f3f-8c30-3a8ab77e79c0. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:29:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-acc85c5a-71cb-4fbe-9a1b-0bd7d93a2be5 req-dad55efc-14e9-4597-a4db-5ed704a7ae24 service nova] Acquiring lock "refresh_cache-2f960239-8deb-4d9f-9cab-eea0274aca38" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:29:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-acc85c5a-71cb-4fbe-9a1b-0bd7d93a2be5 req-dad55efc-14e9-4597-a4db-5ed704a7ae24 service nova] Acquired lock "refresh_cache-2f960239-8deb-4d9f-9cab-eea0274aca38" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:29:35 user nova-compute[73078]: DEBUG nova.network.neutron [req-acc85c5a-71cb-4fbe-9a1b-0bd7d93a2be5 req-dad55efc-14e9-4597-a4db-5ed704a7ae24 service nova] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Refreshing network info cache for port 665b631d-4caf-4f3f-8c30-3a8ab77e79c0 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:29:35 user nova-compute[73078]: DEBUG nova.network.neutron [req-acc85c5a-71cb-4fbe-9a1b-0bd7d93a2be5 req-dad55efc-14e9-4597-a4db-5ed704a7ae24 service nova] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Updated VIF entry in instance network info cache for port 665b631d-4caf-4f3f-8c30-3a8ab77e79c0. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:29:35 user nova-compute[73078]: DEBUG nova.network.neutron [req-acc85c5a-71cb-4fbe-9a1b-0bd7d93a2be5 req-dad55efc-14e9-4597-a4db-5ed704a7ae24 service nova] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Updating instance_info_cache with network_info: [{"id": "665b631d-4caf-4f3f-8c30-3a8ab77e79c0", "address": "fa:16:3e:38:ed:9c", "network": {"id": "9231db47-733a-46df-876b-ee8ed8157a6e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1021535791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c449c8c411c34206af9251f78b912565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665b631d-4c", "ovs_interfaceid": "665b631d-4caf-4f3f-8c30-3a8ab77e79c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:29:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-acc85c5a-71cb-4fbe-9a1b-0bd7d93a2be5 req-dad55efc-14e9-4597-a4db-5ed704a7ae24 service nova] Releasing lock "refresh_cache-2f960239-8deb-4d9f-9cab-eea0274aca38" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:29:36 user nova-compute[73078]: DEBUG nova.compute.manager [req-d5fae01c-35b8-4252-a2d1-d1b68cb63b85 req-a4f6bbdf-0faa-4255-85f2-e26111661b37 service nova] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Received event network-changed-ca00b279-ef6b-4198-8208-0a8fb9cda4be {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:29:36 user nova-compute[73078]: DEBUG nova.compute.manager [req-d5fae01c-35b8-4252-a2d1-d1b68cb63b85 req-a4f6bbdf-0faa-4255-85f2-e26111661b37 service nova] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Refreshing instance network info cache due to event network-changed-ca00b279-ef6b-4198-8208-0a8fb9cda4be. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:29:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d5fae01c-35b8-4252-a2d1-d1b68cb63b85 req-a4f6bbdf-0faa-4255-85f2-e26111661b37 service nova] Acquiring lock "refresh_cache-ef7587b9-995f-4b71-829d-223c6f520527" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:29:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d5fae01c-35b8-4252-a2d1-d1b68cb63b85 req-a4f6bbdf-0faa-4255-85f2-e26111661b37 service nova] Acquired lock "refresh_cache-ef7587b9-995f-4b71-829d-223c6f520527" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:29:36 user nova-compute[73078]: DEBUG nova.network.neutron [req-d5fae01c-35b8-4252-a2d1-d1b68cb63b85 req-a4f6bbdf-0faa-4255-85f2-e26111661b37 service nova] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Refreshing network info cache for port ca00b279-ef6b-4198-8208-0a8fb9cda4be {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:29:36 user nova-compute[73078]: DEBUG nova.network.neutron [req-d5fae01c-35b8-4252-a2d1-d1b68cb63b85 req-a4f6bbdf-0faa-4255-85f2-e26111661b37 service nova] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Updated VIF entry in instance network info cache for port ca00b279-ef6b-4198-8208-0a8fb9cda4be. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:29:36 user nova-compute[73078]: DEBUG nova.network.neutron [req-d5fae01c-35b8-4252-a2d1-d1b68cb63b85 req-a4f6bbdf-0faa-4255-85f2-e26111661b37 service nova] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Updating instance_info_cache with network_info: [{"id": "ca00b279-ef6b-4198-8208-0a8fb9cda4be", "address": "fa:16:3e:d9:11:0e", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca00b279-ef", "ovs_interfaceid": "ca00b279-ef6b-4198-8208-0a8fb9cda4be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:29:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ecec7f39-9fc0-4f5f-b00f-31712db74d3e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "ef7587b9-995f-4b71-829d-223c6f520527" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:29:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ecec7f39-9fc0-4f5f-b00f-31712db74d3e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "ef7587b9-995f-4b71-829d-223c6f520527" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:29:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ecec7f39-9fc0-4f5f-b00f-31712db74d3e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "ef7587b9-995f-4b71-829d-223c6f520527-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:29:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ecec7f39-9fc0-4f5f-b00f-31712db74d3e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "ef7587b9-995f-4b71-829d-223c6f520527-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:29:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ecec7f39-9fc0-4f5f-b00f-31712db74d3e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "ef7587b9-995f-4b71-829d-223c6f520527-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:29:36 user nova-compute[73078]: INFO nova.compute.manager [None req-ecec7f39-9fc0-4f5f-b00f-31712db74d3e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Terminating instance
Aug 14 18:29:36 user nova-compute[73078]: DEBUG nova.compute.manager [None req-ecec7f39-9fc0-4f5f-b00f-31712db74d3e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:29:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d5fae01c-35b8-4252-a2d1-d1b68cb63b85 req-a4f6bbdf-0faa-4255-85f2-e26111661b37 service nova] Releasing lock "refresh_cache-ef7587b9-995f-4b71-829d-223c6f520527" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:29:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:37 user nova-compute[73078]: DEBUG nova.compute.manager [req-9bbf1d35-e7ce-4ac5-9f01-88cc46c7d9d8 req-e1561231-f708-436b-82de-7c5e9e49e000 service nova] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Received event network-vif-unplugged-ca00b279-ef6b-4198-8208-0a8fb9cda4be {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:29:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9bbf1d35-e7ce-4ac5-9f01-88cc46c7d9d8 req-e1561231-f708-436b-82de-7c5e9e49e000 service nova] Acquiring lock "ef7587b9-995f-4b71-829d-223c6f520527-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:29:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9bbf1d35-e7ce-4ac5-9f01-88cc46c7d9d8 req-e1561231-f708-436b-82de-7c5e9e49e000 service nova] Lock "ef7587b9-995f-4b71-829d-223c6f520527-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:29:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9bbf1d35-e7ce-4ac5-9f01-88cc46c7d9d8 req-e1561231-f708-436b-82de-7c5e9e49e000 service nova] Lock "ef7587b9-995f-4b71-829d-223c6f520527-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:29:37 user nova-compute[73078]: DEBUG nova.compute.manager [req-9bbf1d35-e7ce-4ac5-9f01-88cc46c7d9d8 req-e1561231-f708-436b-82de-7c5e9e49e000 service nova] [instance: ef7587b9-995f-4b71-829d-223c6f520527] No waiting events found dispatching network-vif-unplugged-ca00b279-ef6b-4198-8208-0a8fb9cda4be {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:29:37 user nova-compute[73078]: DEBUG nova.compute.manager [req-9bbf1d35-e7ce-4ac5-9f01-88cc46c7d9d8 req-e1561231-f708-436b-82de-7c5e9e49e000 service nova] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Received event network-vif-unplugged-ca00b279-ef6b-4198-8208-0a8fb9cda4be for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:29:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:37 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Instance destroyed successfully.
Aug 14 18:29:37 user nova-compute[73078]: DEBUG nova.objects.instance [None req-ecec7f39-9fc0-4f5f-b00f-31712db74d3e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lazy-loading 'resources' on Instance uuid ef7587b9-995f-4b71-829d-223c6f520527 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:29:37 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-ecec7f39-9fc0-4f5f-b00f-31712db74d3e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:27:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1796655114',display_name='tempest-AttachVolumeNegativeTest-server-1796655114',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1796655114',id=37,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVkjDnvjE6VvF4tOc2pZbOtUBgw+ft9MSEGF3r6fGF11bOlEPiuBz5n1cuiXGRQYHzt45bgnQW91R3SuSjKXd2kdm9MtQiH1ZhmFgO0wO0XK3N02EsB6RVAJ/8QuY0Xnw==',key_name='tempest-keypair-1441417978',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:27:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1391a0a2167745348384e5890e6c22db',ramdisk_id='',reservation_id='r-k75faco7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1671295372',owner_user_name='tempest-AttachVolumeNegativeTest-1671295372-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:27:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3c5d292e9594e4aadad9ac72b9455ed',uuid=ef7587b9-995f-4b71-829d-223c6f520527,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca00b279-ef6b-4198-8208-0a8fb9cda4be", "address": "fa:16:3e:d9:11:0e", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca00b279-ef", "ovs_interfaceid": "ca00b279-ef6b-4198-8208-0a8fb9cda4be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:29:37 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-ecec7f39-9fc0-4f5f-b00f-31712db74d3e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Converting VIF {"id": "ca00b279-ef6b-4198-8208-0a8fb9cda4be", "address": "fa:16:3e:d9:11:0e", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca00b279-ef", "ovs_interfaceid": "ca00b279-ef6b-4198-8208-0a8fb9cda4be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:29:37 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-ecec7f39-9fc0-4f5f-b00f-31712db74d3e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:11:0e,bridge_name='br-int',has_traffic_filtering=True,id=ca00b279-ef6b-4198-8208-0a8fb9cda4be,network=Network(88e922e4-ec89-460a-954d-aff20a41293c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca00b279-ef') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:29:37 user nova-compute[73078]: DEBUG os_vif [None req-ecec7f39-9fc0-4f5f-b00f-31712db74d3e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:11:0e,bridge_name='br-int',has_traffic_filtering=True,id=ca00b279-ef6b-4198-8208-0a8fb9cda4be,network=Network(88e922e4-ec89-460a-954d-aff20a41293c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca00b279-ef') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:29:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca00b279-ef, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:29:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:29:37 user nova-compute[73078]: INFO os_vif [None req-ecec7f39-9fc0-4f5f-b00f-31712db74d3e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:11:0e,bridge_name='br-int',has_traffic_filtering=True,id=ca00b279-ef6b-4198-8208-0a8fb9cda4be,network=Network(88e922e4-ec89-460a-954d-aff20a41293c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca00b279-ef')
Aug 14 18:29:37 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-ecec7f39-9fc0-4f5f-b00f-31712db74d3e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Deleting instance files /opt/stack/data/nova/instances/ef7587b9-995f-4b71-829d-223c6f520527_del
Aug 14 18:29:37 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-ecec7f39-9fc0-4f5f-b00f-31712db74d3e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Deletion of /opt/stack/data/nova/instances/ef7587b9-995f-4b71-829d-223c6f520527_del complete
Aug 14 18:29:37 user nova-compute[73078]: INFO nova.compute.manager [None req-ecec7f39-9fc0-4f5f-b00f-31712db74d3e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Took 0.72 seconds to destroy the instance on the hypervisor.
Aug 14 18:29:37 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-ecec7f39-9fc0-4f5f-b00f-31712db74d3e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:29:37 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:29:37 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: ef7587b9-995f-4b71-829d-223c6f520527] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:29:38 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:29:38 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Took 0.79 seconds to deallocate network for instance.
Aug 14 18:29:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ecec7f39-9fc0-4f5f-b00f-31712db74d3e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:29:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ecec7f39-9fc0-4f5f-b00f-31712db74d3e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:29:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:38 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-ecec7f39-9fc0-4f5f-b00f-31712db74d3e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:29:38 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-ecec7f39-9fc0-4f5f-b00f-31712db74d3e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:29:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ecec7f39-9fc0-4f5f-b00f-31712db74d3e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:29:38 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-ecec7f39-9fc0-4f5f-b00f-31712db74d3e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Deleted allocations for instance ef7587b9-995f-4b71-829d-223c6f520527
Aug 14 18:29:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-ecec7f39-9fc0-4f5f-b00f-31712db74d3e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "ef7587b9-995f-4b71-829d-223c6f520527" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.070s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:29:39 user nova-compute[73078]: DEBUG nova.compute.manager [req-1f9992cd-e861-45b6-b54f-a35b87a6caab req-15cbc566-bab9-4771-842a-d7c863c5793a service nova] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Received event network-vif-plugged-ca00b279-ef6b-4198-8208-0a8fb9cda4be {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:29:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1f9992cd-e861-45b6-b54f-a35b87a6caab req-15cbc566-bab9-4771-842a-d7c863c5793a service nova] Acquiring lock "ef7587b9-995f-4b71-829d-223c6f520527-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:29:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1f9992cd-e861-45b6-b54f-a35b87a6caab req-15cbc566-bab9-4771-842a-d7c863c5793a service nova] Lock "ef7587b9-995f-4b71-829d-223c6f520527-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:29:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1f9992cd-e861-45b6-b54f-a35b87a6caab req-15cbc566-bab9-4771-842a-d7c863c5793a service nova] Lock "ef7587b9-995f-4b71-829d-223c6f520527-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:29:39 user nova-compute[73078]: DEBUG nova.compute.manager [req-1f9992cd-e861-45b6-b54f-a35b87a6caab req-15cbc566-bab9-4771-842a-d7c863c5793a service nova] [instance: ef7587b9-995f-4b71-829d-223c6f520527] No waiting events found dispatching network-vif-plugged-ca00b279-ef6b-4198-8208-0a8fb9cda4be {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:29:39 user nova-compute[73078]: WARNING nova.compute.manager [req-1f9992cd-e861-45b6-b54f-a35b87a6caab req-15cbc566-bab9-4771-842a-d7c863c5793a service nova] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Received unexpected event network-vif-plugged-ca00b279-ef6b-4198-8208-0a8fb9cda4be for instance with vm_state deleted and task_state None.
Aug 14 18:29:39 user nova-compute[73078]: DEBUG nova.compute.manager [req-1f9992cd-e861-45b6-b54f-a35b87a6caab req-15cbc566-bab9-4771-842a-d7c863c5793a service nova] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Received event network-vif-deleted-ca00b279-ef6b-4198-8208-0a8fb9cda4be {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:29:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Acquiring lock "2f960239-8deb-4d9f-9cab-eea0274aca38" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:29:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:29:39 user nova-compute[73078]: DEBUG nova.objects.instance [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lazy-loading 'flavor' on Instance uuid 2f960239-8deb-4d9f-9cab-eea0274aca38 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:29:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:29:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Acquiring lock "2f960239-8deb-4d9f-9cab-eea0274aca38" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:29:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:29:39 user nova-compute[73078]: INFO nova.compute.manager [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Attaching volume 852567bc-a1b0-427c-b062-a625585069f5 to /dev/vdb
Aug 14 18:29:39 user nova-compute[73078]: DEBUG os_brick.utils [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:29:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[af338f05-fa01-4875-808b-e6519d5438db]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[610d8692-0740-4175-b046-1f3a7f716621]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04aeaf9-7894-4cec-83d3-aad734b485fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd7d3a0-8e2d-4456-8bcb-820565ee4697]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:29:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:29:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:29:40 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:29:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a766556-0a15-4865-88c0-8ac6387d4321]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:29:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:29:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:29:40 user nova-compute[73078]: DEBUG os_brick.utils [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:29:40 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Updating existing volume attachment record: 36d5cbc4-ab86-4e94-be49-f3ab6b2467ff {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:29:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:43 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-67f84241-650e-488e-9d55-78a25c2b0c1a tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "16abee43-684b-415f-9c77-476ffb7283e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:29:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-67f84241-650e-488e-9d55-78a25c2b0c1a tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "16abee43-684b-415f-9c77-476ffb7283e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:29:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-67f84241-650e-488e-9d55-78a25c2b0c1a tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "16abee43-684b-415f-9c77-476ffb7283e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:29:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-67f84241-650e-488e-9d55-78a25c2b0c1a tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "16abee43-684b-415f-9c77-476ffb7283e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:29:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-67f84241-650e-488e-9d55-78a25c2b0c1a tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "16abee43-684b-415f-9c77-476ffb7283e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:29:48 user nova-compute[73078]: INFO nova.compute.manager [None req-67f84241-650e-488e-9d55-78a25c2b0c1a tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Terminating instance
Aug 14 18:29:48 user nova-compute[73078]: DEBUG nova.compute.manager [None req-67f84241-650e-488e-9d55-78a25c2b0c1a tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:29:48 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pAKkYtEh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:29:49 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:29:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:29:49 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:29:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:29:49 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:29:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad97007-1372-45d4-ac37-434e9fbb7a27]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:29:49 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[76540498-75c5-46f2-b107-aecb1f770d34]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5] added
Aug 14 18:29:49 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c09232-64f9-4aaa-ba67-eba0f4751e31]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c3c445-e009-4a63-9e24-3a7f881a2d78]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pAKkYtEh {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pAKkYtEh" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[928a1ada-7b29-4c99-906b-c6ac637c4156]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pAKkYtEh'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ab6900-5a2f-46d9-9c62-1509ee290c92]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[922d5d30-d89e-4f2a-9e83-780e947b0a23]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:29:49 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:29:49 user nova-compute[73078]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af (non-flash)
Aug 14 18:29:49 user nova-compute[73078]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 (non-flash)
Aug 14 18:29:49 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:29:49 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:29:49 user nova-compute[73078]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af (non-flash)
Aug 14 18:29:49 user nova-compute[73078]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 (non-flash)
Aug 14 18:29:49 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c42683-977f-4dfc-9766-f91376686ca4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5, portal: 172.16.0.220,3260]
Aug 14 18:29:49 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5, portal: 172.16.0.220,3260] successful.
Aug 14 18:29:49 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG nova.compute.manager [req-d4bad250-6aca-4167-b971-1aaa83b65979 req-ff9bb592-5af5-4dc9-b1bf-febcfd085fb8 service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Received event network-vif-unplugged-ea900923-9066-4aa4-81f3-9d06fc2329f3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d4bad250-6aca-4167-b971-1aaa83b65979 req-ff9bb592-5af5-4dc9-b1bf-febcfd085fb8 service nova] Acquiring lock "16abee43-684b-415f-9c77-476ffb7283e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d4bad250-6aca-4167-b971-1aaa83b65979 req-ff9bb592-5af5-4dc9-b1bf-febcfd085fb8 service nova] Lock "16abee43-684b-415f-9c77-476ffb7283e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d4bad250-6aca-4167-b971-1aaa83b65979 req-ff9bb592-5af5-4dc9-b1bf-febcfd085fb8 service nova] Lock "16abee43-684b-415f-9c77-476ffb7283e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG nova.compute.manager [req-d4bad250-6aca-4167-b971-1aaa83b65979 req-ff9bb592-5af5-4dc9-b1bf-febcfd085fb8 service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] No waiting events found dispatching network-vif-unplugged-ea900923-9066-4aa4-81f3-9d06fc2329f3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG nova.compute.manager [req-d4bad250-6aca-4167-b971-1aaa83b65979 req-ff9bb592-5af5-4dc9-b1bf-febcfd085fb8 service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Received event network-vif-unplugged-ea900923-9066-4aa4-81f3-9d06fc2329f3 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf3742a-1326-4fee-89de-5129e908d030]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbb8b1b-18c6-485a-a7f2-bbbedf7dfd02]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:29:49 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:29:49 user nova-compute[73078]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af (non-flash)
Aug 14 18:29:49 user nova-compute[73078]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 (non-flash)
Aug 14 18:29:49 user nova-compute[73078]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5 (non-flash)
Aug 14 18:29:49 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:29:49 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:29:49 user nova-compute[73078]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af (non-flash)
Aug 14 18:29:49 user nova-compute[73078]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 (non-flash)
Aug 14 18:29:49 user nova-compute[73078]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5 (non-flash)
Aug 14 18:29:49 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] HCTL ('36', '-', '-', 0) found on session 46 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f448dfbe-9164-4821-bd2b-5cc70b9bffd5]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: None {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:49 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Instance destroyed successfully.
Aug 14 18:29:49 user nova-compute[73078]: DEBUG nova.objects.instance [None req-67f84241-650e-488e-9d55-78a25c2b0c1a tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lazy-loading 'resources' on Instance uuid 16abee43-684b-415f-9c77-476ffb7283e8 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-67f84241-650e-488e-9d55-78a25c2b0c1a tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:24:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1500960157',display_name='tempest-TestMinimumBasicScenario-server-1500960157',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1500960157',id=32,image_ref='dc4c33dc-d2f6-41df-b72b-428a95aaba5e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHae15UZ2iRsxNJBje5JQ3VvHItdqEHnAxxnIKoNyEyXMol8pb6MQCaGZedHQWxdQ/k94ka8aw7SUGmRxIIYg12Mi/fJqhVBTLHkBVjhgyRJ5b3DV/1J1fc87fEHebTyQ==',key_name='tempest-TestMinimumBasicScenario-1618869034',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:24:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d6461284f1d491c9cd726d8550a445b',ramdisk_id='',reservation_id='r-novw2rts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dc4c33dc-d2f6-41df-b72b-428a95aaba5e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-703150932',owner_user_name='tempest-TestMinimumBasicScenario-703150932-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:27:08Z,user_data=None,user_id='6ffd9b3d18374103918d71165106f131',uuid=16abee43-684b-415f-9c77-476ffb7283e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea900923-9066-4aa4-81f3-9d06fc2329f3", "address": "fa:16:3e:80:d9:0f", "network": {"id": "4c337404-9329-43e7-bed1-7b5dc32f6cd9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-902748542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6461284f1d491c9cd726d8550a445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea900923-90", "ovs_interfaceid": "ea900923-9066-4aa4-81f3-9d06fc2329f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-67f84241-650e-488e-9d55-78a25c2b0c1a tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Converting VIF {"id": "ea900923-9066-4aa4-81f3-9d06fc2329f3", "address": "fa:16:3e:80:d9:0f", "network": {"id": "4c337404-9329-43e7-bed1-7b5dc32f6cd9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-902748542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6461284f1d491c9cd726d8550a445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea900923-90", "ovs_interfaceid": "ea900923-9066-4aa4-81f3-9d06fc2329f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-67f84241-650e-488e-9d55-78a25c2b0c1a tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:d9:0f,bridge_name='br-int',has_traffic_filtering=True,id=ea900923-9066-4aa4-81f3-9d06fc2329f3,network=Network(4c337404-9329-43e7-bed1-7b5dc32f6cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea900923-90') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG os_vif [None req-67f84241-650e-488e-9d55-78a25c2b0c1a tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:d9:0f,bridge_name='br-int',has_traffic_filtering=True,id=ea900923-9066-4aa4-81f3-9d06fc2329f3,network=Network(4c337404-9329-43e7-bed1-7b5dc32f6cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea900923-90') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea900923-90, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:29:49 user nova-compute[73078]: INFO os_vif [None req-67f84241-650e-488e-9d55-78a25c2b0c1a tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:d9:0f,bridge_name='br-int',has_traffic_filtering=True,id=ea900923-9066-4aa4-81f3-9d06fc2329f3,network=Network(4c337404-9329-43e7-bed1-7b5dc32f6cd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea900923-90')
Aug 14 18:29:49 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-67f84241-650e-488e-9d55-78a25c2b0c1a tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Deleting instance files /opt/stack/data/nova/instances/16abee43-684b-415f-9c77-476ffb7283e8_del
Aug 14 18:29:49 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-67f84241-650e-488e-9d55-78a25c2b0c1a tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Deletion of /opt/stack/data/nova/instances/16abee43-684b-415f-9c77-476ffb7283e8_del complete
Aug 14 18:29:49 user nova-compute[73078]: INFO nova.compute.manager [None req-67f84241-650e-488e-9d55-78a25c2b0c1a tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 14 18:29:49 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-67f84241-650e-488e-9d55-78a25c2b0c1a tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:29:49 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:29:50 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:29:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pAKkYtEh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:29:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:29:50 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '26130336334316234', 'path': '/dev/sde'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:29:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130336334316234', 'path': '/dev/sde'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:29:50 user nova-compute[73078]: DEBUG nova.objects.instance [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lazy-loading 'flavor' on Instance uuid 2f960239-8deb-4d9f-9cab-eea0274aca38 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:29:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 18:29:50 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:29:50 user nova-compute[73078]:   <source dev="/dev/sde"/>
Aug 14 18:29:50 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:29:50 user nova-compute[73078]:   <serial>852567bc-a1b0-427c-b062-a625585069f5</serial>
Aug 14 18:29:50 user nova-compute[73078]: </disk>
Aug 14 18:29:50 user nova-compute[73078]:  {{(pid=73078) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 18:29:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:50 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:29:50 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Took 0.85 seconds to deallocate network for instance.
Aug 14 18:29:50 user nova-compute[73078]: DEBUG nova.compute.manager [req-a564f674-e265-4905-9cae-dc43a7e5b8b4 req-0c802210-d729-4f56-9642-844be827b690 service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Received event network-vif-deleted-ea900923-9066-4aa4-81f3-9d06fc2329f3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:29:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-67f84241-650e-488e-9d55-78a25c2b0c1a tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:29:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-67f84241-650e-488e-9d55-78a25c2b0c1a tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:29:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "ebbaec07-9843-4cc0-bcb6-f993e62d88c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:29:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "ebbaec07-9843-4cc0-bcb6-f993e62d88c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:29:50 user nova-compute[73078]: DEBUG nova.compute.manager [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:29:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:29:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:29:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] No VIF found with MAC fa:16:3e:38:ed:9c, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:29:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:29:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-1b945a4d-6a62-42db-b71e-a21633b6f395 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.165s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:29:51 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-67f84241-650e-488e-9d55-78a25c2b0c1a tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:29:51 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-67f84241-650e-488e-9d55-78a25c2b0c1a tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:29:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-67f84241-650e-488e-9d55-78a25c2b0c1a tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:29:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.216s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:29:51 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:29:51 user nova-compute[73078]: INFO nova.compute.claims [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Claim successful on node user
Aug 14 18:29:51 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-67f84241-650e-488e-9d55-78a25c2b0c1a tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Deleted allocations for instance 16abee43-684b-415f-9c77-476ffb7283e8
Aug 14 18:29:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-67f84241-650e-488e-9d55-78a25c2b0c1a tempest-TestMinimumBasicScenario-703150932 tempest-TestMinimumBasicScenario-703150932-project-member] Lock "16abee43-684b-415f-9c77-476ffb7283e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.311s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:29:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-347eadd3-861f-4985-b4dc-96e2847c7fcd req-2ebc5ce3-1ed5-4ac2-b44e-0743a1b3e90b service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Received event network-vif-plugged-ea900923-9066-4aa4-81f3-9d06fc2329f3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:29:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-347eadd3-861f-4985-b4dc-96e2847c7fcd req-2ebc5ce3-1ed5-4ac2-b44e-0743a1b3e90b service nova] Acquiring lock "16abee43-684b-415f-9c77-476ffb7283e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:29:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-347eadd3-861f-4985-b4dc-96e2847c7fcd req-2ebc5ce3-1ed5-4ac2-b44e-0743a1b3e90b service nova] Lock "16abee43-684b-415f-9c77-476ffb7283e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:29:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-347eadd3-861f-4985-b4dc-96e2847c7fcd req-2ebc5ce3-1ed5-4ac2-b44e-0743a1b3e90b service nova] Lock "16abee43-684b-415f-9c77-476ffb7283e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:29:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-347eadd3-861f-4985-b4dc-96e2847c7fcd req-2ebc5ce3-1ed5-4ac2-b44e-0743a1b3e90b service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] No waiting events found dispatching network-vif-plugged-ea900923-9066-4aa4-81f3-9d06fc2329f3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:29:51 user nova-compute[73078]: WARNING nova.compute.manager [req-347eadd3-861f-4985-b4dc-96e2847c7fcd req-2ebc5ce3-1ed5-4ac2-b44e-0743a1b3e90b service nova] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Received unexpected event network-vif-plugged-ea900923-9066-4aa4-81f3-9d06fc2329f3 for instance with vm_state deleted and task_state None.
Aug 14 18:29:51 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:29:51 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:29:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.406s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:29:51 user nova-compute[73078]: DEBUG nova.compute.manager [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:29:51 user nova-compute[73078]: DEBUG nova.compute.manager [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:29:51 user nova-compute[73078]: DEBUG nova.network.neutron [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:29:51 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:29:51 user nova-compute[73078]: DEBUG nova.compute.manager [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:29:51 user nova-compute[73078]: DEBUG nova.policy [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0bff079d90d942bb8ab3ba53fb007125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e938ed650845d0a64b49273c9f6287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:29:51 user nova-compute[73078]: DEBUG nova.compute.manager [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:29:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:29:51 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Creating image(s)
Aug 14 18:29:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "/opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:29:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "/opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:29:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "/opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:29:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.173s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:29:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:29:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.178s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk 1073741824" returned: 0 in 0.055s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:29:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:52 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692037777.323652, ef7587b9-995f-4b71-829d-223c6f520527 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:29:52 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: ef7587b9-995f-4b71-829d-223c6f520527] VM Stopped (Lifecycle Event)
Aug 14 18:29:52 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63cb9fd6-eaff-45e0-bb99-bda290634880 None None] [instance: ef7587b9-995f-4b71-829d-223c6f520527] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:29:52 user nova-compute[73078]: DEBUG nova.network.neutron [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Successfully created port: f4b39d8b-c9a2-4747-88ba-834f2542b617 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:29:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.218s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:52 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:29:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:52 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Cannot resize image /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:29:52 user nova-compute[73078]: DEBUG nova.objects.instance [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lazy-loading 'migration_context' on Instance uuid ebbaec07-9843-4cc0-bcb6-f993e62d88c1 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:29:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:29:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Ensure instance console log exists: /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:29:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:29:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:29:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG nova.network.neutron [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Successfully updated port: f4b39d8b-c9a2-4747-88ba-834f2542b617 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "refresh_cache-ebbaec07-9843-4cc0-bcb6-f993e62d88c1" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquired lock "refresh_cache-ebbaec07-9843-4cc0-bcb6-f993e62d88c1" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG nova.network.neutron [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG nova.compute.manager [req-a3aeeb48-3105-479d-84c6-b62ad56d5590 req-827a553b-30a8-4873-8ff6-b478fb39acb2 service nova] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Received event network-changed-f4b39d8b-c9a2-4747-88ba-834f2542b617 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG nova.compute.manager [req-a3aeeb48-3105-479d-84c6-b62ad56d5590 req-827a553b-30a8-4873-8ff6-b478fb39acb2 service nova] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Refreshing instance network info cache due to event network-changed-f4b39d8b-c9a2-4747-88ba-834f2542b617. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a3aeeb48-3105-479d-84c6-b62ad56d5590 req-827a553b-30a8-4873-8ff6-b478fb39acb2 service nova] Acquiring lock "refresh_cache-ebbaec07-9843-4cc0-bcb6-f993e62d88c1" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG nova.network.neutron [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG nova.network.neutron [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Updating instance_info_cache with network_info: [{"id": "f4b39d8b-c9a2-4747-88ba-834f2542b617", "address": "fa:16:3e:7d:d8:49", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b39d8b-c9", "ovs_interfaceid": "f4b39d8b-c9a2-4747-88ba-834f2542b617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Releasing lock "refresh_cache-ebbaec07-9843-4cc0-bcb6-f993e62d88c1" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG nova.compute.manager [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Instance network_info: |[{"id": "f4b39d8b-c9a2-4747-88ba-834f2542b617", "address": "fa:16:3e:7d:d8:49", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b39d8b-c9", "ovs_interfaceid": "f4b39d8b-c9a2-4747-88ba-834f2542b617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a3aeeb48-3105-479d-84c6-b62ad56d5590 req-827a553b-30a8-4873-8ff6-b478fb39acb2 service nova] Acquired lock "refresh_cache-ebbaec07-9843-4cc0-bcb6-f993e62d88c1" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG nova.network.neutron [req-a3aeeb48-3105-479d-84c6-b62ad56d5590 req-827a553b-30a8-4873-8ff6-b478fb39acb2 service nova] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Refreshing network info cache for port f4b39d8b-c9a2-4747-88ba-834f2542b617 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Start _get_guest_xml network_info=[{"id": "f4b39d8b-c9a2-4747-88ba-834f2542b617", "address": "fa:16:3e:7d:d8:49", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b39d8b-c9", "ovs_interfaceid": "f4b39d8b-c9a2-4747-88ba-834f2542b617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:29:53 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:29:53 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:29:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:29:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1399755996',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1399755996',id=40,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16e938ed650845d0a64b49273c9f6287',ramdisk_id='',reservation_id='r-we05iq9j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1267883434',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:29:52Z,user_data=None,user_id='0bff079d90d942bb8ab3ba53fb007125',uuid=ebbaec07-9843-4cc0-bcb6-f993e62d88c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4b39d8b-c9a2-4747-88ba-834f2542b617", "address": "fa:16:3e:7d:d8:49", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b39d8b-c9", "ovs_interfaceid": "f4b39d8b-c9a2-4747-88ba-834f2542b617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Converting VIF {"id": "f4b39d8b-c9a2-4747-88ba-834f2542b617", "address": "fa:16:3e:7d:d8:49", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b39d8b-c9", "ovs_interfaceid": "f4b39d8b-c9a2-4747-88ba-834f2542b617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:d8:49,bridge_name='br-int',has_traffic_filtering=True,id=f4b39d8b-c9a2-4747-88ba-834f2542b617,network=Network(98a29135-c5de-46a6-a2bf-46c90b4e255b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4b39d8b-c9') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG nova.objects.instance [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lazy-loading 'pci_devices' on Instance uuid ebbaec07-9843-4cc0-bcb6-f993e62d88c1 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:29:53 user nova-compute[73078]:   <uuid>ebbaec07-9843-4cc0-bcb6-f993e62d88c1</uuid>
Aug 14 18:29:53 user nova-compute[73078]:   <name>instance-00000028</name>
Aug 14 18:29:53 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:29:53 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:29:53 user nova-compute[73078]:   <metadata>
Aug 14 18:29:53 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:29:53 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:29:53 user nova-compute[73078]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1399755996</nova:name>
Aug 14 18:29:53 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:29:53</nova:creationTime>
Aug 14 18:29:53 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:29:53 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:29:53 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:29:53 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:29:53 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:29:53 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:29:53 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:29:53 user nova-compute[73078]:       <nova:owner>
Aug 14 18:29:53 user nova-compute[73078]:         <nova:user uuid="0bff079d90d942bb8ab3ba53fb007125">tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member</nova:user>
Aug 14 18:29:53 user nova-compute[73078]:         <nova:project uuid="16e938ed650845d0a64b49273c9f6287">tempest-ServerBootFromVolumeStableRescueTest-1267883434</nova:project>
Aug 14 18:29:53 user nova-compute[73078]:       </nova:owner>
Aug 14 18:29:53 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:29:53 user nova-compute[73078]:       <nova:ports>
Aug 14 18:29:53 user nova-compute[73078]:         <nova:port uuid="f4b39d8b-c9a2-4747-88ba-834f2542b617">
Aug 14 18:29:53 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 18:29:53 user nova-compute[73078]:         </nova:port>
Aug 14 18:29:53 user nova-compute[73078]:       </nova:ports>
Aug 14 18:29:53 user nova-compute[73078]:     </nova:instance>
Aug 14 18:29:53 user nova-compute[73078]:   </metadata>
Aug 14 18:29:53 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:29:53 user nova-compute[73078]:     <system>
Aug 14 18:29:53 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:29:53 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:29:53 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:29:53 user nova-compute[73078]:       <entry name="serial">ebbaec07-9843-4cc0-bcb6-f993e62d88c1</entry>
Aug 14 18:29:53 user nova-compute[73078]:       <entry name="uuid">ebbaec07-9843-4cc0-bcb6-f993e62d88c1</entry>
Aug 14 18:29:53 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:29:53 user nova-compute[73078]:     </system>
Aug 14 18:29:53 user nova-compute[73078]:   </sysinfo>
Aug 14 18:29:53 user nova-compute[73078]:   <os>
Aug 14 18:29:53 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:29:53 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:29:53 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:29:53 user nova-compute[73078]:   </os>
Aug 14 18:29:53 user nova-compute[73078]:   <features>
Aug 14 18:29:53 user nova-compute[73078]:     <acpi/>
Aug 14 18:29:53 user nova-compute[73078]:     <apic/>
Aug 14 18:29:53 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:29:53 user nova-compute[73078]:   </features>
Aug 14 18:29:53 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:29:53 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:29:53 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:29:53 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:29:53 user nova-compute[73078]:   </clock>
Aug 14 18:29:53 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:29:53 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:29:53 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:29:53 user nova-compute[73078]:   </cpu>
Aug 14 18:29:53 user nova-compute[73078]:   <devices>
Aug 14 18:29:53 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:29:53 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:29:53 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk"/>
Aug 14 18:29:53 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:29:53 user nova-compute[73078]:     </disk>
Aug 14 18:29:53 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:29:53 user nova-compute[73078]:       <mac address="fa:16:3e:7d:d8:49"/>
Aug 14 18:29:53 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:29:53 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:29:53 user nova-compute[73078]:       <target dev="tapf4b39d8b-c9"/>
Aug 14 18:29:53 user nova-compute[73078]:     </interface>
Aug 14 18:29:53 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:29:53 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/console.log" append="off"/>
Aug 14 18:29:53 user nova-compute[73078]:     </serial>
Aug 14 18:29:53 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:29:53 user nova-compute[73078]:     <video>
Aug 14 18:29:53 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:29:53 user nova-compute[73078]:     </video>
Aug 14 18:29:53 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:29:53 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:29:53 user nova-compute[73078]:     </rng>
Aug 14 18:29:53 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:29:53 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:29:53 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:29:53 user nova-compute[73078]:     </memballoon>
Aug 14 18:29:53 user nova-compute[73078]:   </devices>
Aug 14 18:29:53 user nova-compute[73078]: </domain>
Aug 14 18:29:53 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:29:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1399755996',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1399755996',id=40,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16e938ed650845d0a64b49273c9f6287',ramdisk_id='',reservation_id='r-we05iq9j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1267883434',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:29:52Z,user_data=None,user_id='0bff079d90d942bb8ab3ba53fb007125',uuid=ebbaec07-9843-4cc0-bcb6-f993e62d88c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4b39d8b-c9a2-4747-88ba-834f2542b617", "address": "fa:16:3e:7d:d8:49", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b39d8b-c9", "ovs_interfaceid": "f4b39d8b-c9a2-4747-88ba-834f2542b617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Converting VIF {"id": "f4b39d8b-c9a2-4747-88ba-834f2542b617", "address": "fa:16:3e:7d:d8:49", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b39d8b-c9", "ovs_interfaceid": "f4b39d8b-c9a2-4747-88ba-834f2542b617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:d8:49,bridge_name='br-int',has_traffic_filtering=True,id=f4b39d8b-c9a2-4747-88ba-834f2542b617,network=Network(98a29135-c5de-46a6-a2bf-46c90b4e255b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4b39d8b-c9') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG os_vif [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:d8:49,bridge_name='br-int',has_traffic_filtering=True,id=f4b39d8b-c9a2-4747-88ba-834f2542b617,network=Network(98a29135-c5de-46a6-a2bf-46c90b4e255b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4b39d8b-c9') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4b39d8b-c9, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf4b39d8b-c9, col_values=(('external_ids', {'iface-id': 'f4b39d8b-c9a2-4747-88ba-834f2542b617', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:d8:49', 'vm-uuid': 'ebbaec07-9843-4cc0-bcb6-f993e62d88c1'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:53 user nova-compute[73078]: INFO os_vif [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:d8:49,bridge_name='br-int',has_traffic_filtering=True,id=f4b39d8b-c9a2-4747-88ba-834f2542b617,network=Network(98a29135-c5de-46a6-a2bf-46c90b4e255b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4b39d8b-c9')
Aug 14 18:29:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:29:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] No VIF found with MAC fa:16:3e:7d:d8:49, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:29:54 user nova-compute[73078]: DEBUG nova.network.neutron [req-a3aeeb48-3105-479d-84c6-b62ad56d5590 req-827a553b-30a8-4873-8ff6-b478fb39acb2 service nova] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Updated VIF entry in instance network info cache for port f4b39d8b-c9a2-4747-88ba-834f2542b617. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:29:54 user nova-compute[73078]: DEBUG nova.network.neutron [req-a3aeeb48-3105-479d-84c6-b62ad56d5590 req-827a553b-30a8-4873-8ff6-b478fb39acb2 service nova] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Updating instance_info_cache with network_info: [{"id": "f4b39d8b-c9a2-4747-88ba-834f2542b617", "address": "fa:16:3e:7d:d8:49", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b39d8b-c9", "ovs_interfaceid": "f4b39d8b-c9a2-4747-88ba-834f2542b617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:29:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a3aeeb48-3105-479d-84c6-b62ad56d5590 req-827a553b-30a8-4873-8ff6-b478fb39acb2 service nova] Releasing lock "refresh_cache-ebbaec07-9843-4cc0-bcb6-f993e62d88c1" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:29:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:55 user nova-compute[73078]: DEBUG nova.compute.manager [req-3321952b-bd73-46a2-9c8a-5fd726cf0faa req-6fecdf06-ef81-4521-96f4-f71c58fd52ea service nova] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Received event network-vif-plugged-f4b39d8b-c9a2-4747-88ba-834f2542b617 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:29:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3321952b-bd73-46a2-9c8a-5fd726cf0faa req-6fecdf06-ef81-4521-96f4-f71c58fd52ea service nova] Acquiring lock "ebbaec07-9843-4cc0-bcb6-f993e62d88c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:29:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3321952b-bd73-46a2-9c8a-5fd726cf0faa req-6fecdf06-ef81-4521-96f4-f71c58fd52ea service nova] Lock "ebbaec07-9843-4cc0-bcb6-f993e62d88c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:29:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3321952b-bd73-46a2-9c8a-5fd726cf0faa req-6fecdf06-ef81-4521-96f4-f71c58fd52ea service nova] Lock "ebbaec07-9843-4cc0-bcb6-f993e62d88c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:29:55 user nova-compute[73078]: DEBUG nova.compute.manager [req-3321952b-bd73-46a2-9c8a-5fd726cf0faa req-6fecdf06-ef81-4521-96f4-f71c58fd52ea service nova] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] No waiting events found dispatching network-vif-plugged-f4b39d8b-c9a2-4747-88ba-834f2542b617 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:29:55 user nova-compute[73078]: WARNING nova.compute.manager [req-3321952b-bd73-46a2-9c8a-5fd726cf0faa req-6fecdf06-ef81-4521-96f4-f71c58fd52ea service nova] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Received unexpected event network-vif-plugged-f4b39d8b-c9a2-4747-88ba-834f2542b617 for instance with vm_state building and task_state spawning.
Aug 14 18:29:57 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:29:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:29:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:29:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:29:57 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:29:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:57 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037797.3528917, ebbaec07-9843-4cc0-bcb6-f993e62d88c1 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:29:57 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] VM Resumed (Lifecycle Event)
Aug 14 18:29:57 user nova-compute[73078]: DEBUG nova.compute.manager [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:29:57 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:29:57 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Instance spawned successfully.
Aug 14 18:29:57 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:29:57 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:29:57 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:29:57 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:29:57 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:29:57 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:29:57 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:29:57 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:29:57 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:29:57 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:29:57 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037797.3584168, ebbaec07-9843-4cc0-bcb6-f993e62d88c1 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:29:57 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] VM Started (Lifecycle Event)
Aug 14 18:29:57 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:29:57 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:29:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:57 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:29:57 user nova-compute[73078]: INFO nova.compute.manager [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Took 5.74 seconds to spawn the instance on the hypervisor.
Aug 14 18:29:57 user nova-compute[73078]: DEBUG nova.compute.manager [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:29:57 user nova-compute[73078]: INFO nova.compute.manager [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Took 6.74 seconds to build instance.
Aug 14 18:29:57 user nova-compute[73078]: DEBUG nova.compute.manager [req-b321ee17-c042-44be-ad0c-ad268914a594 req-d234bc2b-5d85-4c09-b882-1d7a2f3d7bd0 service nova] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Received event network-vif-plugged-f4b39d8b-c9a2-4747-88ba-834f2542b617 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:29:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b321ee17-c042-44be-ad0c-ad268914a594 req-d234bc2b-5d85-4c09-b882-1d7a2f3d7bd0 service nova] Acquiring lock "ebbaec07-9843-4cc0-bcb6-f993e62d88c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:29:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b321ee17-c042-44be-ad0c-ad268914a594 req-d234bc2b-5d85-4c09-b882-1d7a2f3d7bd0 service nova] Lock "ebbaec07-9843-4cc0-bcb6-f993e62d88c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:29:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b321ee17-c042-44be-ad0c-ad268914a594 req-d234bc2b-5d85-4c09-b882-1d7a2f3d7bd0 service nova] Lock "ebbaec07-9843-4cc0-bcb6-f993e62d88c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:29:57 user nova-compute[73078]: DEBUG nova.compute.manager [req-b321ee17-c042-44be-ad0c-ad268914a594 req-d234bc2b-5d85-4c09-b882-1d7a2f3d7bd0 service nova] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] No waiting events found dispatching network-vif-plugged-f4b39d8b-c9a2-4747-88ba-834f2542b617 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:29:57 user nova-compute[73078]: WARNING nova.compute.manager [req-b321ee17-c042-44be-ad0c-ad268914a594 req-d234bc2b-5d85-4c09-b882-1d7a2f3d7bd0 service nova] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Received unexpected event network-vif-plugged-f4b39d8b-c9a2-4747-88ba-834f2542b617 for instance with vm_state active and task_state None.
Aug 14 18:29:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9873b8a1-e654-421a-bed4-950422d663f8 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "ebbaec07-9843-4cc0-bcb6-f993e62d88c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.873s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:29:57 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:29:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:58 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:29:58 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:29:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:29:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:59 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:29:59 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:29:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bf260cc-5c85-46e0-8326-7f23165065b7/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:29:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bf260cc-5c85-46e0-8326-7f23165065b7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:29:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bf260cc-5c85-46e0-8326-7f23165065b7/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bf260cc-5c85-46e0-8326-7f23165065b7/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:00 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:30:00 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:30:00 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=7472MB free_disk=24.879356384277344GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:30:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:30:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:30:00 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 1f88cb97-4f22-439e-99f2-d7cb8d5aff36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:30:00 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 61dfe42b-c943-4617-bf8e-745eaf1a1bb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:30:00 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 3088da30-65b7-4801-b425-93df4fca6ad8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:30:00 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance ef083dd3-67d6-48a8-846a-7fe6c6b32d5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:30:00 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:30:00 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:30:00 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 2f960239-8deb-4d9f-9cab-eea0274aca38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:30:00 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 5bf260cc-5c85-46e0-8326-7f23165065b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:30:00 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance f6c3a593-c42a-497e-8470-f87be7828a56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:30:00 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance ebbaec07-9843-4cc0-bcb6-f993e62d88c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:30:00 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:30:00 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:30:01 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:30:01 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:30:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:30:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.601s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:30:02 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:30:02 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:30:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:30:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-3088da30-65b7-4801-b425-93df4fca6ad8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:30:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-3088da30-65b7-4801-b425-93df4fca6ad8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:30:02 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:30:02 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Updating instance_info_cache with network_info: [{"id": "52e93284-9b32-4191-8f06-ab9c4497579c", "address": "fa:16:3e:ec:04:07", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e93284-9b", "ovs_interfaceid": "52e93284-9b32-4191-8f06-ab9c4497579c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:30:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-3088da30-65b7-4801-b425-93df4fca6ad8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:30:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:30:02 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:30:02 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:30:02 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:30:02 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:30:02 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:30:02 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:30:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:30:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:30:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:30:04 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692037789.7093496, 16abee43-684b-415f-9c77-476ffb7283e8 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:30:04 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] VM Stopped (Lifecycle Event)
Aug 14 18:30:04 user nova-compute[73078]: DEBUG nova.compute.manager [None req-720af4ac-02f7-4f46-9659-eb9bdae20b81 None None] [instance: 16abee43-684b-415f-9c77-476ffb7283e8] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:30:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:30:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:30:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:30:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:30:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c708b6fd-add6-492a-98bf-3a7a28961814 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "1f88cb97-4f22-439e-99f2-d7cb8d5aff36" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:30:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c708b6fd-add6-492a-98bf-3a7a28961814 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "1f88cb97-4f22-439e-99f2-d7cb8d5aff36" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:30:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c708b6fd-add6-492a-98bf-3a7a28961814 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "1f88cb97-4f22-439e-99f2-d7cb8d5aff36-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:30:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c708b6fd-add6-492a-98bf-3a7a28961814 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "1f88cb97-4f22-439e-99f2-d7cb8d5aff36-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:30:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c708b6fd-add6-492a-98bf-3a7a28961814 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "1f88cb97-4f22-439e-99f2-d7cb8d5aff36-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:30:14 user nova-compute[73078]: INFO nova.compute.manager [None req-c708b6fd-add6-492a-98bf-3a7a28961814 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Terminating instance
Aug 14 18:30:14 user nova-compute[73078]: DEBUG nova.compute.manager [None req-c708b6fd-add6-492a-98bf-3a7a28961814 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:30:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:30:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:30:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:30:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:30:14 user nova-compute[73078]: DEBUG nova.compute.manager [req-d68f58c5-a7ef-4735-bb1a-595e439f0044 req-b82ba5e1-9a74-4aac-acec-f5a51f88a6dd service nova] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Received event network-vif-unplugged-8df77a26-faab-47ca-a39b-3df6930cd1d5 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:30:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d68f58c5-a7ef-4735-bb1a-595e439f0044 req-b82ba5e1-9a74-4aac-acec-f5a51f88a6dd service nova] Acquiring lock "1f88cb97-4f22-439e-99f2-d7cb8d5aff36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:30:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d68f58c5-a7ef-4735-bb1a-595e439f0044 req-b82ba5e1-9a74-4aac-acec-f5a51f88a6dd service nova] Lock "1f88cb97-4f22-439e-99f2-d7cb8d5aff36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:30:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d68f58c5-a7ef-4735-bb1a-595e439f0044 req-b82ba5e1-9a74-4aac-acec-f5a51f88a6dd service nova] Lock "1f88cb97-4f22-439e-99f2-d7cb8d5aff36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:30:14 user nova-compute[73078]: DEBUG nova.compute.manager [req-d68f58c5-a7ef-4735-bb1a-595e439f0044 req-b82ba5e1-9a74-4aac-acec-f5a51f88a6dd service nova] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] No waiting events found dispatching network-vif-unplugged-8df77a26-faab-47ca-a39b-3df6930cd1d5 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:30:14 user nova-compute[73078]: DEBUG nova.compute.manager [req-d68f58c5-a7ef-4735-bb1a-595e439f0044 req-b82ba5e1-9a74-4aac-acec-f5a51f88a6dd service nova] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Received event network-vif-unplugged-8df77a26-faab-47ca-a39b-3df6930cd1d5 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:30:15 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Instance destroyed successfully.
Aug 14 18:30:15 user nova-compute[73078]: DEBUG nova.objects.instance [None req-c708b6fd-add6-492a-98bf-3a7a28961814 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lazy-loading 'resources' on Instance uuid 1f88cb97-4f22-439e-99f2-d7cb8d5aff36 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:30:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-c708b6fd-add6-492a-98bf-3a7a28961814 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:10:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1024624425',display_name='tempest-ServerActionsTestOtherA-server-1024624425',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1024624425',id=3,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuBLKmid5aFtC8N9oGYPXkgiYGtDjSt/w1+99DQRyNH3SIh+uGteRP9ufywJ7TgR1607B3dJ2h6LnLGhohKOdL1yNPsWQsmTBErDFfyfHJa2VycZ+ceyQwLi9NhHpa6xg==',key_name='tempest-keypair-1366091689',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:11:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='993dd55f40454640824687ffb6a3c581',ramdisk_id='',reservation_id='r-a57kop58',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1876890021',owner_user_name='tempest-ServerActionsTestOtherA-1876890021-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:11:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cca1112ab354f9fb31658e18c0d03b1',uuid=1f88cb97-4f22-439e-99f2-d7cb8d5aff36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8df77a26-faab-47ca-a39b-3df6930cd1d5", "address": "fa:16:3e:2d:25:52", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df77a26-fa", "ovs_interfaceid": "8df77a26-faab-47ca-a39b-3df6930cd1d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:30:15 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-c708b6fd-add6-492a-98bf-3a7a28961814 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Converting VIF {"id": "8df77a26-faab-47ca-a39b-3df6930cd1d5", "address": "fa:16:3e:2d:25:52", "network": {"id": "bfef9745-5a40-44b6-a6d5-2ef1e77fc5db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1624554992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "993dd55f40454640824687ffb6a3c581", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8df77a26-fa", "ovs_interfaceid": "8df77a26-faab-47ca-a39b-3df6930cd1d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:30:15 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-c708b6fd-add6-492a-98bf-3a7a28961814 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:25:52,bridge_name='br-int',has_traffic_filtering=True,id=8df77a26-faab-47ca-a39b-3df6930cd1d5,network=Network(bfef9745-5a40-44b6-a6d5-2ef1e77fc5db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8df77a26-fa') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:30:15 user nova-compute[73078]: DEBUG os_vif [None req-c708b6fd-add6-492a-98bf-3a7a28961814 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:25:52,bridge_name='br-int',has_traffic_filtering=True,id=8df77a26-faab-47ca-a39b-3df6930cd1d5,network=Network(bfef9745-5a40-44b6-a6d5-2ef1e77fc5db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8df77a26-fa') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:30:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:30:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8df77a26-fa, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:30:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:30:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:30:15 user nova-compute[73078]: INFO os_vif [None req-c708b6fd-add6-492a-98bf-3a7a28961814 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:25:52,bridge_name='br-int',has_traffic_filtering=True,id=8df77a26-faab-47ca-a39b-3df6930cd1d5,network=Network(bfef9745-5a40-44b6-a6d5-2ef1e77fc5db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8df77a26-fa')
Aug 14 18:30:15 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-c708b6fd-add6-492a-98bf-3a7a28961814 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Deleting instance files /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36_del
Aug 14 18:30:15 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-c708b6fd-add6-492a-98bf-3a7a28961814 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Deletion of /opt/stack/data/nova/instances/1f88cb97-4f22-439e-99f2-d7cb8d5aff36_del complete
Aug 14 18:30:15 user nova-compute[73078]: INFO nova.compute.manager [None req-c708b6fd-add6-492a-98bf-3a7a28961814 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 14 18:30:15 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-c708b6fd-add6-492a-98bf-3a7a28961814 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:30:15 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:30:15 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:30:15 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:30:15 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Took 0.52 seconds to deallocate network for instance.
Aug 14 18:30:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c708b6fd-add6-492a-98bf-3a7a28961814 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:30:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c708b6fd-add6-492a-98bf-3a7a28961814 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:30:16 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-c708b6fd-add6-492a-98bf-3a7a28961814 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:30:16 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-c708b6fd-add6-492a-98bf-3a7a28961814 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:30:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c708b6fd-add6-492a-98bf-3a7a28961814 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:30:16 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-c708b6fd-add6-492a-98bf-3a7a28961814 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Deleted allocations for instance 1f88cb97-4f22-439e-99f2-d7cb8d5aff36
Aug 14 18:30:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c708b6fd-add6-492a-98bf-3a7a28961814 tempest-ServerActionsTestOtherA-1876890021 tempest-ServerActionsTestOtherA-1876890021-project-member] Lock "1f88cb97-4f22-439e-99f2-d7cb8d5aff36" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.944s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:30:16 user nova-compute[73078]: DEBUG nova.compute.manager [req-12945c61-329f-433b-a784-df3c11c3ec03 req-fe901f31-b597-4ea6-ab14-5a604cae2a5e service nova] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Received event network-vif-plugged-8df77a26-faab-47ca-a39b-3df6930cd1d5 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:30:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-12945c61-329f-433b-a784-df3c11c3ec03 req-fe901f31-b597-4ea6-ab14-5a604cae2a5e service nova] Acquiring lock "1f88cb97-4f22-439e-99f2-d7cb8d5aff36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:30:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-12945c61-329f-433b-a784-df3c11c3ec03 req-fe901f31-b597-4ea6-ab14-5a604cae2a5e service nova] Lock "1f88cb97-4f22-439e-99f2-d7cb8d5aff36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:30:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-12945c61-329f-433b-a784-df3c11c3ec03 req-fe901f31-b597-4ea6-ab14-5a604cae2a5e service nova] Lock "1f88cb97-4f22-439e-99f2-d7cb8d5aff36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:30:16 user nova-compute[73078]: DEBUG nova.compute.manager [req-12945c61-329f-433b-a784-df3c11c3ec03 req-fe901f31-b597-4ea6-ab14-5a604cae2a5e service nova] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] No waiting events found dispatching network-vif-plugged-8df77a26-faab-47ca-a39b-3df6930cd1d5 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:30:16 user nova-compute[73078]: WARNING nova.compute.manager [req-12945c61-329f-433b-a784-df3c11c3ec03 req-fe901f31-b597-4ea6-ab14-5a604cae2a5e service nova] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Received unexpected event network-vif-plugged-8df77a26-faab-47ca-a39b-3df6930cd1d5 for instance with vm_state deleted and task_state None.
Aug 14 18:30:16 user nova-compute[73078]: DEBUG nova.compute.manager [req-12945c61-329f-433b-a784-df3c11c3ec03 req-fe901f31-b597-4ea6-ab14-5a604cae2a5e service nova] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Received event network-vif-deleted-8df77a26-faab-47ca-a39b-3df6930cd1d5 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-63383aba-096b-44ad-aaa2-97ed5b179971 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Acquiring lock "2f960239-8deb-4d9f-9cab-eea0274aca38" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-63383aba-096b-44ad-aaa2-97ed5b179971 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:30:17 user nova-compute[73078]: INFO nova.compute.manager [None req-63383aba-096b-44ad-aaa2-97ed5b179971 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Detaching volume 852567bc-a1b0-427c-b062-a625585069f5
Aug 14 18:30:17 user nova-compute[73078]: INFO nova.virt.block_device [None req-63383aba-096b-44ad-aaa2-97ed5b179971 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Attempting to driver detach volume 852567bc-a1b0-427c-b062-a625585069f5 from mountpoint /dev/vdb
Aug 14 18:30:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63383aba-096b-44ad-aaa2-97ed5b179971 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Attempting to detach device vdb from instance 2f960239-8deb-4d9f-9cab-eea0274aca38 from the persistent domain config. {{(pid=73078) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-63383aba-096b-44ad-aaa2-97ed5b179971 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:30:17 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:30:17 user nova-compute[73078]:   <source dev="/dev/sde"/>
Aug 14 18:30:17 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:30:17 user nova-compute[73078]:   <serial>852567bc-a1b0-427c-b062-a625585069f5</serial>
Aug 14 18:30:17 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:30:17 user nova-compute[73078]: </disk>
Aug 14 18:30:17 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:30:17 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-63383aba-096b-44ad-aaa2-97ed5b179971 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Successfully detached device vdb from instance 2f960239-8deb-4d9f-9cab-eea0274aca38 from the persistent domain config.
Aug 14 18:30:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63383aba-096b-44ad-aaa2-97ed5b179971 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2f960239-8deb-4d9f-9cab-eea0274aca38 from the live domain config. {{(pid=73078) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-63383aba-096b-44ad-aaa2-97ed5b179971 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:30:17 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:30:17 user nova-compute[73078]:   <source dev="/dev/sde"/>
Aug 14 18:30:17 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:30:17 user nova-compute[73078]:   <serial>852567bc-a1b0-427c-b062-a625585069f5</serial>
Aug 14 18:30:17 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:30:17 user nova-compute[73078]: </disk>
Aug 14 18:30:17 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Received event <DeviceRemovedEvent: 1692037817.7769442, 2f960239-8deb-4d9f-9cab-eea0274aca38 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73078) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63383aba-096b-44ad-aaa2-97ed5b179971 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2f960239-8deb-4d9f-9cab-eea0274aca38 {{(pid=73078) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 18:30:17 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-63383aba-096b-44ad-aaa2-97ed5b179971 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Successfully detached device vdb from instance 2f960239-8deb-4d9f-9cab-eea0274aca38 from the live domain config.
Aug 14 18:30:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63383aba-096b-44ad-aaa2-97ed5b179971 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-63383aba-096b-44ad-aaa2-97ed5b179971 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pAKkYtEh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:30:17 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-63383aba-096b-44ad-aaa2-97ed5b179971 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:30:17 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-63383aba-096b-44ad-aaa2-97ed5b179971 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-63383aba-096b-44ad-aaa2-97ed5b179971 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-63383aba-096b-44ad-aaa2-97ed5b179971 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a2655b-13a5-4f63-ba5b-3c198f9bebb5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57cdbd4-c3e8-4833-891f-bdaef07de3c4]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-63383aba-096b-44ad-aaa2-97ed5b179971 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:30:17 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:30:17 user nova-compute[73078]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af (non-flash)
Aug 14 18:30:17 user nova-compute[73078]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 (non-flash)
Aug 14 18:30:17 user nova-compute[73078]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5 (non-flash)
Aug 14 18:30:17 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-63383aba-096b-44ad-aaa2-97ed5b179971 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:30:17 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:30:17 user nova-compute[73078]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af (non-flash)
Aug 14 18:30:17 user nova-compute[73078]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 (non-flash)
Aug 14 18:30:17 user nova-compute[73078]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5 (non-flash)
Aug 14 18:30:17 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-63383aba-096b-44ad-aaa2-97ed5b179971 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9880f69e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5'): ({'sde'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-63383aba-096b-44ad-aaa2-97ed5b179971 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Removing single pathed devices sde {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6a20e3-0670-41e5-9216-37d9fc35ab11]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db614cb-9e36-4777-8721-c288315eccc9]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-63383aba-096b-44ad-aaa2-97ed5b179971 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Flushing IO for device /dev/sde {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a88d21-bd64-458f-935f-288881803308]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-63383aba-096b-44ad-aaa2-97ed5b179971 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afa5aed-3b66-4d13-9175-d7f62e666ec6]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-63383aba-096b-44ad-aaa2-97ed5b179971 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-63383aba-096b-44ad-aaa2-97ed5b179971 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] SCSI volumes sde have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-63383aba-096b-44ad-aaa2-97ed5b179971 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9919175-2ddf-4d8b-a36a-eea53ea30040]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-63383aba-096b-44ad-aaa2-97ed5b179971 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:30:17 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:18 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[49649703-3966-40be-8ebc-315094a84bd9]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-63383aba-096b-44ad-aaa2-97ed5b179971 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5, portal: 172.16.0.220,3260]
Aug 14 18:30:18 user nova-compute[73078]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5, portal: 172.16.0.220,3260] successful.
Aug 14 18:30:18 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:30:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:852567bc-a1b0-427c-b062-a625585069f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:18 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8f8783-da3b-48d8-8134-33b08258e9b2]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-63383aba-096b-44ad-aaa2-97ed5b179971 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:30:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-63383aba-096b-44ad-aaa2-97ed5b179971 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:30:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-63383aba-096b-44ad-aaa2-97ed5b179971 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] <== disconnect_volume: return (307ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:30:18 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63383aba-096b-44ad-aaa2-97ed5b179971 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:30:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:30:19 user nova-compute[73078]: DEBUG nova.objects.instance [None req-63383aba-096b-44ad-aaa2-97ed5b179971 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lazy-loading 'flavor' on Instance uuid 2f960239-8deb-4d9f-9cab-eea0274aca38 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:30:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-63383aba-096b-44ad-aaa2-97ed5b179971 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.842s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:30:20 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:30:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:30:25 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:30:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b7e3c230-81b9-4400-b777-f62c92932472 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:30:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b7e3c230-81b9-4400-b777-f62c92932472 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:30:27 user nova-compute[73078]: INFO nova.compute.manager [None req-b7e3c230-81b9-4400-b777-f62c92932472 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Detaching volume 67eb75f4-db80-4665-9245-f840bf9ad6af
Aug 14 18:30:28 user nova-compute[73078]: INFO nova.virt.block_device [None req-b7e3c230-81b9-4400-b777-f62c92932472 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Attempting to driver detach volume 67eb75f4-db80-4665-9245-f840bf9ad6af from mountpoint /dev/vdb
Aug 14 18:30:28 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b7e3c230-81b9-4400-b777-f62c92932472 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Attempting to detach device vdb from instance 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21 from the persistent domain config. {{(pid=73078) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-b7e3c230-81b9-4400-b777-f62c92932472 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:30:28 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:30:28 user nova-compute[73078]:   <source dev="/dev/sdf"/>
Aug 14 18:30:28 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:30:28 user nova-compute[73078]:   <serial>67eb75f4-db80-4665-9245-f840bf9ad6af</serial>
Aug 14 18:30:28 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:30:28 user nova-compute[73078]: </disk>
Aug 14 18:30:28 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:30:28 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-b7e3c230-81b9-4400-b777-f62c92932472 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Successfully detached device vdb from instance 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21 from the persistent domain config.
Aug 14 18:30:28 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b7e3c230-81b9-4400-b777-f62c92932472 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21 from the live domain config. {{(pid=73078) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-b7e3c230-81b9-4400-b777-f62c92932472 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:30:28 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:30:28 user nova-compute[73078]:   <source dev="/dev/sdf"/>
Aug 14 18:30:28 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:30:28 user nova-compute[73078]:   <serial>67eb75f4-db80-4665-9245-f840bf9ad6af</serial>
Aug 14 18:30:28 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:30:28 user nova-compute[73078]: </disk>
Aug 14 18:30:28 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Received event <DeviceRemovedEvent: 1692037828.5067463, 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73078) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b7e3c230-81b9-4400-b777-f62c92932472 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21 {{(pid=73078) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 18:30:28 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-b7e3c230-81b9-4400-b777-f62c92932472 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Successfully detached device vdb from instance 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21 from the live domain config.
Aug 14 18:30:28 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7e3c230-81b9-4400-b777-f62c92932472 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e3c230-81b9-4400-b777-f62c92932472 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dtKgBNaM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:30:28 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-b7e3c230-81b9-4400-b777-f62c92932472 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:30:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-b7e3c230-81b9-4400-b777-f62c92932472 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-b7e3c230-81b9-4400-b777-f62c92932472 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e3c230-81b9-4400-b777-f62c92932472 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f91327d-f719-4888-bf4b-debf98f227f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[58648e60-46b9-476b-bd3e-bddedc8ed37e]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e3c230-81b9-4400-b777-f62c92932472 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:30:28 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:30:28 user nova-compute[73078]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af (non-flash)
Aug 14 18:30:28 user nova-compute[73078]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 (non-flash)
Aug 14 18:30:28 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e3c230-81b9-4400-b777-f62c92932472 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:30:28 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:30:28 user nova-compute[73078]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af (non-flash)
Aug 14 18:30:28 user nova-compute[73078]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 (non-flash)
Aug 14 18:30:28 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e3c230-81b9-4400-b777-f62c92932472 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9881a11b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af'): ({'sdf'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-b7e3c230-81b9-4400-b777-f62c92932472 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Removing single pathed devices sdf {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cefbffa-cbde-490d-b8ba-68e1625ab17f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efc400f-5efe-49cd-a331-493870c8cd59]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-b7e3c230-81b9-4400-b777-f62c92932472 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Flushing IO for device /dev/sdf {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1ccf09-3aac-4818-95d0-783266820b53]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-b7e3c230-81b9-4400-b777-f62c92932472 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37aec73-6654-412d-baf6-6be73efa94ef]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-b7e3c230-81b9-4400-b777-f62c92932472 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-b7e3c230-81b9-4400-b777-f62c92932472 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] SCSI volumes sdf have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e3c230-81b9-4400-b777-f62c92932472 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[203f889e-f9d9-4af8-b465-5d7fd72d4c07]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e3c230-81b9-4400-b777-f62c92932472 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af -p 172.16.0.220:3260 --logout" returned: 0 in 0.134s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde838f9-8f02-45ac-8c06-86253252a77e]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e3c230-81b9-4400-b777-f62c92932472 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af, portal: 172.16.0.220,3260]
Aug 14 18:30:28 user nova-compute[73078]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af, portal: 172.16.0.220,3260] successful.
Aug 14 18:30:28 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67eb75f4-db80-4665-9245-f840bf9ad6af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51bbb36-d4f3-47bf-8053-f72ab548ffdf]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e3c230-81b9-4400-b777-f62c92932472 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-b7e3c230-81b9-4400-b777-f62c92932472 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e3c230-81b9-4400-b777-f62c92932472 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] <== disconnect_volume: return (372ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:30:28 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7e3c230-81b9-4400-b777-f62c92932472 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:30:29 user nova-compute[73078]: DEBUG nova.objects.instance [None req-b7e3c230-81b9-4400-b777-f62c92932472 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lazy-loading 'flavor' on Instance uuid 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:30:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b7e3c230-81b9-4400-b777-f62c92932472 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.779s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:30:30 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692037815.2594042, 1f88cb97-4f22-439e-99f2-d7cb8d5aff36 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:30:30 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] VM Stopped (Lifecycle Event)
Aug 14 18:30:30 user nova-compute[73078]: DEBUG nova.compute.manager [None req-163628d7-8a48-491b-a6e9-391d98e87908 None None] [instance: 1f88cb97-4f22-439e-99f2-d7cb8d5aff36] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:30:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:30:32 user nova-compute[73078]: DEBUG nova.compute.manager [req-9ab90d4a-7c58-4d7c-9b56-04c025dc33d9 req-ccc6d44f-36f1-4e31-b09d-404a0ef543dc service nova] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Received event network-changed-33b84b58-09ca-49f0-a118-2870cd38d6d3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:30:32 user nova-compute[73078]: DEBUG nova.compute.manager [req-9ab90d4a-7c58-4d7c-9b56-04c025dc33d9 req-ccc6d44f-36f1-4e31-b09d-404a0ef543dc service nova] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Refreshing instance network info cache due to event network-changed-33b84b58-09ca-49f0-a118-2870cd38d6d3. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:30:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9ab90d4a-7c58-4d7c-9b56-04c025dc33d9 req-ccc6d44f-36f1-4e31-b09d-404a0ef543dc service nova] Acquiring lock "refresh_cache-5bf260cc-5c85-46e0-8326-7f23165065b7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:30:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9ab90d4a-7c58-4d7c-9b56-04c025dc33d9 req-ccc6d44f-36f1-4e31-b09d-404a0ef543dc service nova] Acquired lock "refresh_cache-5bf260cc-5c85-46e0-8326-7f23165065b7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:30:32 user nova-compute[73078]: DEBUG nova.network.neutron [req-9ab90d4a-7c58-4d7c-9b56-04c025dc33d9 req-ccc6d44f-36f1-4e31-b09d-404a0ef543dc service nova] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Refreshing network info cache for port 33b84b58-09ca-49f0-a118-2870cd38d6d3 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:30:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Acquiring lock "5bf260cc-5c85-46e0-8326-7f23165065b7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:30:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "5bf260cc-5c85-46e0-8326-7f23165065b7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:30:33 user nova-compute[73078]: DEBUG nova.objects.instance [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lazy-loading 'flavor' on Instance uuid 5bf260cc-5c85-46e0-8326-7f23165065b7 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:30:33 user nova-compute[73078]: DEBUG nova.network.neutron [req-9ab90d4a-7c58-4d7c-9b56-04c025dc33d9 req-ccc6d44f-36f1-4e31-b09d-404a0ef543dc service nova] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Updated VIF entry in instance network info cache for port 33b84b58-09ca-49f0-a118-2870cd38d6d3. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:30:33 user nova-compute[73078]: DEBUG nova.network.neutron [req-9ab90d4a-7c58-4d7c-9b56-04c025dc33d9 req-ccc6d44f-36f1-4e31-b09d-404a0ef543dc service nova] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Updating instance_info_cache with network_info: [{"id": "33b84b58-09ca-49f0-a118-2870cd38d6d3", "address": "fa:16:3e:66:a1:dc", "network": {"id": "21c76d99-2d0a-42b9-b7a0-b068f0cb938f", "bridge": "br-int", "label": "tempest-TestStampPattern-1682035048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce3bd6c6a784ee3a395c368d667c1b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b84b58-09", "ovs_interfaceid": "33b84b58-09ca-49f0-a118-2870cd38d6d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:30:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9ab90d4a-7c58-4d7c-9b56-04c025dc33d9 req-ccc6d44f-36f1-4e31-b09d-404a0ef543dc service nova] Releasing lock "refresh_cache-5bf260cc-5c85-46e0-8326-7f23165065b7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:30:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "5bf260cc-5c85-46e0-8326-7f23165065b7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:30:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:30:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Acquiring lock "5bf260cc-5c85-46e0-8326-7f23165065b7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:30:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "5bf260cc-5c85-46e0-8326-7f23165065b7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:30:33 user nova-compute[73078]: INFO nova.compute.manager [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Attaching volume 8dc6b28a-d669-49d0-b310-55b3c325bab0 to /dev/vdb
Aug 14 18:30:33 user nova-compute[73078]: DEBUG os_brick.utils [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:30:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:33 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2751c53b-befe-4d4b-9404-3342e380b75f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:33 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[25acb997-d806-4b0d-9f14-f9dd6f16e66e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:33 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[86833aa6-f0f0-452d-a142-2b018d93e4c3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:33 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88e7e08-6fa9-48df-a6d0-3f4ad7d3d575]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:30:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:30:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:30:33 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:30:33 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4847aafe-71da-484f-89a7-9b39d8888008]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:30:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:30:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:30:33 user nova-compute[73078]: DEBUG os_brick.utils [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:30:33 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Updating existing volume attachment record: af4f677e-6e71-43cc-ad3a-1623d5a9d0b2 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:30:35 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:30:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:30:40 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:30:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:30:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RWIVQDoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:30:42 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:30:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:30:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:30:42 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:30:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:30:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:30:42 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:30:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9064ef32-d331-4b9b-b38d-46d7e5cb16c4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:30:42 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:30:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eaff608-7d1d-4f2c-bab7-665d5bcbf37f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0] added
Aug 14 18:30:42 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:30:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9301a52-892f-471d-9005-295a5e3833dc]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:30:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd99a2d-c748-4f43-8cd1-1b3a5ca8f778]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:30:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RWIVQDoP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RWIVQDoP" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fdd255-20cd-4c65-9f9d-66dbb6c2f7c5]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RWIVQDoP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:30:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ffcf9c-2695-4b00-9db5-c1c3dce560f3]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:30:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2862999f-c16b-4711-96c6-edabc5cc4b22]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:30:42 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:30:42 user nova-compute[73078]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 (non-flash)
Aug 14 18:30:42 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:30:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:30:42 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:30:42 user nova-compute[73078]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 (non-flash)
Aug 14 18:30:42 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:30:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e7b56a-6cf3-4333-b830-101d50044c11]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0, portal: 172.16.0.220,3260]
Aug 14 18:30:42 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0, portal: 172.16.0.220,3260] successful.
Aug 14 18:30:42 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:30:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:43 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56765de-3b75-49ee-876e-7a316af16ac4]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:30:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:43 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[009df5d2-f519-4aab-8585-55a98b2c7e58]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:30:43 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:30:43 user nova-compute[73078]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 (non-flash)
Aug 14 18:30:43 user nova-compute[73078]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0 (non-flash)
Aug 14 18:30:43 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:30:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:30:43 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:30:43 user nova-compute[73078]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 (non-flash)
Aug 14 18:30:43 user nova-compute[73078]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0 (non-flash)
Aug 14 18:30:43 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:30:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:30:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:30:43 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] HCTL ('36', '-', '-', 0) found on session 47 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:30:43 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:30:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:43 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ecbaf2-5c10-4801-8dd6-b228db2638c0]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:43 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Searching for a device in session 47 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:30:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RWIVQDoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:30:43 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:30:43 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:30:44 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:30:44 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '26463616131663637', 'path': '/dev/sde'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:30:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463616131663637', 'path': '/dev/sde'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:30:44 user nova-compute[73078]: DEBUG nova.objects.instance [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lazy-loading 'flavor' on Instance uuid 5bf260cc-5c85-46e0-8326-7f23165065b7 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:30:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 18:30:44 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:30:44 user nova-compute[73078]:   <source dev="/dev/sde"/>
Aug 14 18:30:44 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:30:44 user nova-compute[73078]:   <serial>8dc6b28a-d669-49d0-b310-55b3c325bab0</serial>
Aug 14 18:30:44 user nova-compute[73078]: </disk>
Aug 14 18:30:44 user nova-compute[73078]:  {{(pid=73078) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 18:30:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:30:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:30:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] No VIF found with MAC fa:16:3e:66:a1:dc, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:30:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-38214185-0c3a-40f6-a711-6faa76af9ada tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "5bf260cc-5c85-46e0-8326-7f23165065b7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.270s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:30:45 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:30:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-bddefb3a-9d61-42b2-8dcc-c4a7f7ab5e4f tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Acquiring lock "5bf260cc-5c85-46e0-8326-7f23165065b7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:30:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-bddefb3a-9d61-42b2-8dcc-c4a7f7ab5e4f tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "5bf260cc-5c85-46e0-8326-7f23165065b7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:30:46 user nova-compute[73078]: INFO nova.compute.manager [None req-bddefb3a-9d61-42b2-8dcc-c4a7f7ab5e4f tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Detaching volume 8dc6b28a-d669-49d0-b310-55b3c325bab0
Aug 14 18:30:46 user nova-compute[73078]: INFO nova.virt.block_device [None req-bddefb3a-9d61-42b2-8dcc-c4a7f7ab5e4f tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Attempting to driver detach volume 8dc6b28a-d669-49d0-b310-55b3c325bab0 from mountpoint /dev/vdb
Aug 14 18:30:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-bddefb3a-9d61-42b2-8dcc-c4a7f7ab5e4f tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Attempting to detach device vdb from instance 5bf260cc-5c85-46e0-8326-7f23165065b7 from the persistent domain config. {{(pid=73078) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 18:30:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-bddefb3a-9d61-42b2-8dcc-c4a7f7ab5e4f tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:30:46 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:30:46 user nova-compute[73078]:   <source dev="/dev/sde"/>
Aug 14 18:30:46 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:30:46 user nova-compute[73078]:   <serial>8dc6b28a-d669-49d0-b310-55b3c325bab0</serial>
Aug 14 18:30:46 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:30:46 user nova-compute[73078]: </disk>
Aug 14 18:30:46 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:30:46 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-bddefb3a-9d61-42b2-8dcc-c4a7f7ab5e4f tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Successfully detached device vdb from instance 5bf260cc-5c85-46e0-8326-7f23165065b7 from the persistent domain config.
Aug 14 18:30:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-bddefb3a-9d61-42b2-8dcc-c4a7f7ab5e4f tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5bf260cc-5c85-46e0-8326-7f23165065b7 from the live domain config. {{(pid=73078) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 18:30:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-bddefb3a-9d61-42b2-8dcc-c4a7f7ab5e4f tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:30:46 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:30:46 user nova-compute[73078]:   <source dev="/dev/sde"/>
Aug 14 18:30:46 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:30:46 user nova-compute[73078]:   <serial>8dc6b28a-d669-49d0-b310-55b3c325bab0</serial>
Aug 14 18:30:46 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:30:46 user nova-compute[73078]: </disk>
Aug 14 18:30:46 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:30:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:30:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Received event <DeviceRemovedEvent: 1692037846.9257789, 5bf260cc-5c85-46e0-8326-7f23165065b7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73078) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 18:30:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-bddefb3a-9d61-42b2-8dcc-c4a7f7ab5e4f tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5bf260cc-5c85-46e0-8326-7f23165065b7 {{(pid=73078) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 18:30:46 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-bddefb3a-9d61-42b2-8dcc-c4a7f7ab5e4f tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Successfully detached device vdb from instance 5bf260cc-5c85-46e0-8326-7f23165065b7 from the live domain config.
Aug 14 18:30:46 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bddefb3a-9d61-42b2-8dcc-c4a7f7ab5e4f tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:30:46 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddefb3a-9d61-42b2-8dcc-c4a7f7ab5e4f tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RWIVQDoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:30:46 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-bddefb3a-9d61-42b2-8dcc-c4a7f7ab5e4f tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:30:46 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-bddefb3a-9d61-42b2-8dcc-c4a7f7ab5e4f tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:30:46 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-bddefb3a-9d61-42b2-8dcc-c4a7f7ab5e4f tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:30:46 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddefb3a-9d61-42b2-8dcc-c4a7f7ab5e4f tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:30:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:46 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfff26c-9a56-4c44-9904-c93207646a34]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:46 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:46 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f28da5-5da7-4ac6-a4c3-881fe36c6289]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:46 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddefb3a-9d61-42b2-8dcc-c4a7f7ab5e4f tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:30:46 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:30:46 user nova-compute[73078]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 (non-flash)
Aug 14 18:30:46 user nova-compute[73078]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0 (non-flash)
Aug 14 18:30:46 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:30:46 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddefb3a-9d61-42b2-8dcc-c4a7f7ab5e4f tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:30:46 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:30:46 user nova-compute[73078]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 (non-flash)
Aug 14 18:30:46 user nova-compute[73078]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0 (non-flash)
Aug 14 18:30:46 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddefb3a-9d61-42b2-8dcc-c4a7f7ab5e4f tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9882800d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0'): ({'sde'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-bddefb3a-9d61-42b2-8dcc-c4a7f7ab5e4f tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Removing single pathed devices sde {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fb7747-8520-4ac5-9e87-e4e769614d18]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df06b30-0f57-46a2-8dd0-1759aa507712]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-bddefb3a-9d61-42b2-8dcc-c4a7f7ab5e4f tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Flushing IO for device /dev/sde {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d92963a-b94f-41e6-8b9e-6694292b3a2e]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-bddefb3a-9d61-42b2-8dcc-c4a7f7ab5e4f tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cb78cc-4381-4a23-98b3-d7105551b446]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-bddefb3a-9d61-42b2-8dcc-c4a7f7ab5e4f tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-bddefb3a-9d61-42b2-8dcc-c4a7f7ab5e4f tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] SCSI volumes sde have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddefb3a-9d61-42b2-8dcc-c4a7f7ab5e4f tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d54548-b079-4e30-9319-8ace594577aa]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddefb3a-9d61-42b2-8dcc-c4a7f7ab5e4f tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[483b0996-2d20-447f-b4ef-02c51754d686]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddefb3a-9d61-42b2-8dcc-c4a7f7ab5e4f tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0, portal: 172.16.0.220,3260]
Aug 14 18:30:47 user nova-compute[73078]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0, portal: 172.16.0.220,3260] successful.
Aug 14 18:30:47 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc6b28a-d669-49d0-b310-55b3c325bab0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8fe2f3-1ff2-4565-8c85-3be9aaada6d9]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddefb3a-9d61-42b2-8dcc-c4a7f7ab5e4f tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-bddefb3a-9d61-42b2-8dcc-c4a7f7ab5e4f tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddefb3a-9d61-42b2-8dcc-c4a7f7ab5e4f tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] <== disconnect_volume: return (296ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bddefb3a-9d61-42b2-8dcc-c4a7f7ab5e4f tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG nova.compute.manager [req-623a03c3-5b32-47c5-b7d9-696637df3ccf req-242fc3a9-5330-47eb-a186-27fd3ff3a27e service nova] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Received event network-changed-674a05ec-043f-429c-9dee-7d77ade5ec7b {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG nova.compute.manager [req-623a03c3-5b32-47c5-b7d9-696637df3ccf req-242fc3a9-5330-47eb-a186-27fd3ff3a27e service nova] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Refreshing instance network info cache due to event network-changed-674a05ec-043f-429c-9dee-7d77ade5ec7b. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-623a03c3-5b32-47c5-b7d9-696637df3ccf req-242fc3a9-5330-47eb-a186-27fd3ff3a27e service nova] Acquiring lock "refresh_cache-f6c3a593-c42a-497e-8470-f87be7828a56" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-623a03c3-5b32-47c5-b7d9-696637df3ccf req-242fc3a9-5330-47eb-a186-27fd3ff3a27e service nova] Acquired lock "refresh_cache-f6c3a593-c42a-497e-8470-f87be7828a56" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:30:47 user nova-compute[73078]: DEBUG nova.network.neutron [req-623a03c3-5b32-47c5-b7d9-696637df3ccf req-242fc3a9-5330-47eb-a186-27fd3ff3a27e service nova] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Refreshing network info cache for port 674a05ec-043f-429c-9dee-7d77ade5ec7b {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:30:48 user nova-compute[73078]: DEBUG nova.objects.instance [None req-bddefb3a-9d61-42b2-8dcc-c4a7f7ab5e4f tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lazy-loading 'flavor' on Instance uuid 5bf260cc-5c85-46e0-8326-7f23165065b7 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:30:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-bddefb3a-9d61-42b2-8dcc-c4a7f7ab5e4f tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "5bf260cc-5c85-46e0-8326-7f23165065b7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.674s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:30:48 user nova-compute[73078]: DEBUG nova.network.neutron [req-623a03c3-5b32-47c5-b7d9-696637df3ccf req-242fc3a9-5330-47eb-a186-27fd3ff3a27e service nova] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Updated VIF entry in instance network info cache for port 674a05ec-043f-429c-9dee-7d77ade5ec7b. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:30:48 user nova-compute[73078]: DEBUG nova.network.neutron [req-623a03c3-5b32-47c5-b7d9-696637df3ccf req-242fc3a9-5330-47eb-a186-27fd3ff3a27e service nova] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Updating instance_info_cache with network_info: [{"id": "674a05ec-043f-429c-9dee-7d77ade5ec7b", "address": "fa:16:3e:2a:09:93", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap674a05ec-04", "ovs_interfaceid": "674a05ec-043f-429c-9dee-7d77ade5ec7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:30:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-623a03c3-5b32-47c5-b7d9-696637df3ccf req-242fc3a9-5330-47eb-a186-27fd3ff3a27e service nova] Releasing lock "refresh_cache-f6c3a593-c42a-497e-8470-f87be7828a56" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:30:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "f6c3a593-c42a-497e-8470-f87be7828a56" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:30:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "f6c3a593-c42a-497e-8470-f87be7828a56" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:30:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "f6c3a593-c42a-497e-8470-f87be7828a56-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:30:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "f6c3a593-c42a-497e-8470-f87be7828a56-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:30:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "f6c3a593-c42a-497e-8470-f87be7828a56-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:30:48 user nova-compute[73078]: INFO nova.compute.manager [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Terminating instance
Aug 14 18:30:48 user nova-compute[73078]: DEBUG nova.compute.manager [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:30:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:30:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:30:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:30:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:30:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:30:48 user nova-compute[73078]: DEBUG nova.compute.manager [req-74e253e9-687a-408b-96f3-6db2051a1051 req-ebaa426b-95eb-4175-8000-94ce1dea1e64 service nova] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Received event network-vif-unplugged-674a05ec-043f-429c-9dee-7d77ade5ec7b {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:30:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-74e253e9-687a-408b-96f3-6db2051a1051 req-ebaa426b-95eb-4175-8000-94ce1dea1e64 service nova] Acquiring lock "f6c3a593-c42a-497e-8470-f87be7828a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:30:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-74e253e9-687a-408b-96f3-6db2051a1051 req-ebaa426b-95eb-4175-8000-94ce1dea1e64 service nova] Lock "f6c3a593-c42a-497e-8470-f87be7828a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:30:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-74e253e9-687a-408b-96f3-6db2051a1051 req-ebaa426b-95eb-4175-8000-94ce1dea1e64 service nova] Lock "f6c3a593-c42a-497e-8470-f87be7828a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:30:48 user nova-compute[73078]: DEBUG nova.compute.manager [req-74e253e9-687a-408b-96f3-6db2051a1051 req-ebaa426b-95eb-4175-8000-94ce1dea1e64 service nova] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] No waiting events found dispatching network-vif-unplugged-674a05ec-043f-429c-9dee-7d77ade5ec7b {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:30:48 user nova-compute[73078]: DEBUG nova.compute.manager [req-74e253e9-687a-408b-96f3-6db2051a1051 req-ebaa426b-95eb-4175-8000-94ce1dea1e64 service nova] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Received event network-vif-unplugged-674a05ec-043f-429c-9dee-7d77ade5ec7b for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:30:49 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Instance destroyed successfully.
Aug 14 18:30:49 user nova-compute[73078]: DEBUG nova.objects.instance [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lazy-loading 'resources' on Instance uuid f6c3a593-c42a-497e-8470-f87be7828a56 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:28:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2094980478',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2094980478',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2094980478',id=39,image_ref='2146a8cf-70f0-4b53-93b4-c60a69daf9ca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOclhEanEuGVmBktXH02lpjr6vdTrXMLdHVbOibcfQB+lrMAremSipx9f9aiQqwrOhN4NmtnIBabiGWzcrdP+7ulXyPlWOpUtLRo5W6XTqSpVbNsu5PibQkmwWqr3IJY2A==',key_name='tempest-keypair-357822921',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:29:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7142101014c4defa7261a34fb9f28e4',ramdisk_id='',reservation_id='r-lyvxhb9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1889877750',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1889877750-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1889877750',owner_user_name='tempest-TestVolumeBootPattern-1889877750-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:29:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe79455616584e0fb80e6007edf0b706',uuid=f6c3a593-c42a-497e-8470-f87be7828a56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "674a05ec-043f-429c-9dee-7d77ade5ec7b", "address": "fa:16:3e:2a:09:93", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap674a05ec-04", "ovs_interfaceid": "674a05ec-043f-429c-9dee-7d77ade5ec7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Converting VIF {"id": "674a05ec-043f-429c-9dee-7d77ade5ec7b", "address": "fa:16:3e:2a:09:93", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap674a05ec-04", "ovs_interfaceid": "674a05ec-043f-429c-9dee-7d77ade5ec7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:09:93,bridge_name='br-int',has_traffic_filtering=True,id=674a05ec-043f-429c-9dee-7d77ade5ec7b,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap674a05ec-04') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG os_vif [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:09:93,bridge_name='br-int',has_traffic_filtering=True,id=674a05ec-043f-429c-9dee-7d77ade5ec7b,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap674a05ec-04') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap674a05ec-04, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:30:49 user nova-compute[73078]: INFO os_vif [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:09:93,bridge_name='br-int',has_traffic_filtering=True,id=674a05ec-043f-429c-9dee-7d77ade5ec7b,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap674a05ec-04')
Aug 14 18:30:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xnUKaigj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:30:49 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:30:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d614457-a31c-4c99-ba7e-07873bd13e4a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6afd65-b5ce-4fc3-8d25-88d25de4ecb6]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:30:49 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:30:49 user nova-compute[73078]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 (non-flash)
Aug 14 18:30:49 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:30:49 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:30:49 user nova-compute[73078]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 (non-flash)
Aug 14 18:30:49 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe98820f7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7'): ({'sdc'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Removing single pathed devices sdc {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0880140f-dc2e-4b83-a067-220a7528356e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e906b6-ef75-4320-9a3e-00d488beb260]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Flushing IO for device /dev/sdc {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[477fb412-bee6-4ac5-b2b7-dc2b4899e4cf]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[600e8746-5c04-4c3f-b4da-3d4481ebc3a9]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] SCSI volumes sdc have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbfc230-4940-477a-98d8-ac1a37380c80]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[86162954-e69e-4a88-a5d6-885460b412b1]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7, portal: 172.16.0.220,3260]
Aug 14 18:30:49 user nova-compute[73078]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7, portal: 172.16.0.220,3260] successful.
Aug 14 18:30:49 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[612407b2-56b5-4a65-a926-217e900ea53c]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] <== disconnect_volume: return (282ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:30:49 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Deleting instance files /opt/stack/data/nova/instances/f6c3a593-c42a-497e-8470-f87be7828a56_del
Aug 14 18:30:49 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Deletion of /opt/stack/data/nova/instances/f6c3a593-c42a-497e-8470-f87be7828a56_del complete
Aug 14 18:30:49 user nova-compute[73078]: INFO nova.compute.manager [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 14 18:30:49 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:30:49 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:30:50 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:30:50 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Took 0.85 seconds to deallocate network for instance.
Aug 14 18:30:50 user nova-compute[73078]: DEBUG nova.compute.manager [req-7324fcb5-1dcc-4a8f-86d8-2c226fc68ab0 req-d59faaba-5b8c-4ee0-8d2f-b3a7cda967e7 service nova] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Received event network-vif-deleted-674a05ec-043f-429c-9dee-7d77ade5ec7b {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:30:50 user nova-compute[73078]: DEBUG nova.compute.manager [req-3a080d53-41d8-4491-88a8-0fd81566e7d9 req-492684e0-889d-4e25-aa54-39bbe8a70bdf service nova] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Received event network-vif-plugged-674a05ec-043f-429c-9dee-7d77ade5ec7b {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:30:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3a080d53-41d8-4491-88a8-0fd81566e7d9 req-492684e0-889d-4e25-aa54-39bbe8a70bdf service nova] Acquiring lock "f6c3a593-c42a-497e-8470-f87be7828a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:30:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3a080d53-41d8-4491-88a8-0fd81566e7d9 req-492684e0-889d-4e25-aa54-39bbe8a70bdf service nova] Lock "f6c3a593-c42a-497e-8470-f87be7828a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:30:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3a080d53-41d8-4491-88a8-0fd81566e7d9 req-492684e0-889d-4e25-aa54-39bbe8a70bdf service nova] Lock "f6c3a593-c42a-497e-8470-f87be7828a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:30:50 user nova-compute[73078]: DEBUG nova.compute.manager [req-3a080d53-41d8-4491-88a8-0fd81566e7d9 req-492684e0-889d-4e25-aa54-39bbe8a70bdf service nova] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] No waiting events found dispatching network-vif-plugged-674a05ec-043f-429c-9dee-7d77ade5ec7b {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:30:50 user nova-compute[73078]: WARNING nova.compute.manager [req-3a080d53-41d8-4491-88a8-0fd81566e7d9 req-492684e0-889d-4e25-aa54-39bbe8a70bdf service nova] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Received unexpected event network-vif-plugged-674a05ec-043f-429c-9dee-7d77ade5ec7b for instance with vm_state active and task_state deleting.
Aug 14 18:30:51 user nova-compute[73078]: INFO nova.compute.manager [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Took 0.72 seconds to detach 1 volumes for instance.
Aug 14 18:30:51 user nova-compute[73078]: DEBUG nova.compute.manager [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Deleting volume: a5e8f1bb-56c5-4426-9db8-4c839f2f7ce7 {{(pid=73078) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 18:30:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:30:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:30:51 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:30:51 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:30:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:30:51 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Deleted allocations for instance f6c3a593-c42a-497e-8470-f87be7828a56
Aug 14 18:30:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-64efaa91-5a15-474c-92c8-86935ead5cda tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "f6c3a593-c42a-497e-8470-f87be7828a56" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.244s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:30:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:30:58 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:30:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:30:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:30:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:30:58 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:30:58 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:30:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:30:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:30:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:30:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:00 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:31:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bf260cc-5c85-46e0-8326-7f23165065b7/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bf260cc-5c85-46e0-8326-7f23165065b7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bf260cc-5c85-46e0-8326-7f23165065b7/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bf260cc-5c85-46e0-8326-7f23165065b7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:01 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:31:01 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:31:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=7804MB free_disk=24.90792465209961GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:31:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:31:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:31:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 61dfe42b-c943-4617-bf8e-745eaf1a1bb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:31:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 3088da30-65b7-4801-b425-93df4fca6ad8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:31:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance ef083dd3-67d6-48a8-846a-7fe6c6b32d5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:31:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:31:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:31:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 2f960239-8deb-4d9f-9cab-eea0274aca38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:31:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 5bf260cc-5c85-46e0-8326-7f23165065b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:31:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance ebbaec07-9843-4cc0-bcb6-f993e62d88c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:31:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:31:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:31:01 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:31:01 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:31:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:31:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.406s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:31:02 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:31:02 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:31:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:31:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Didn't find any instances for network info cache update. {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 18:31:02 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:31:02 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:31:02 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:31:02 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:31:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:31:03 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:31:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:04 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:31:04 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692037849.0916579, f6c3a593-c42a-497e-8470-f87be7828a56 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:31:04 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] VM Stopped (Lifecycle Event)
Aug 14 18:31:04 user nova-compute[73078]: DEBUG nova.compute.manager [None req-3c4d479d-7669-428e-8e99-a61d493b78e6 None None] [instance: f6c3a593-c42a-497e-8470-f87be7828a56] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:31:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:08 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:31:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Acquiring lock "2f960239-8deb-4d9f-9cab-eea0274aca38" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:31:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:31:11 user nova-compute[73078]: DEBUG nova.objects.instance [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lazy-loading 'flavor' on Instance uuid 2f960239-8deb-4d9f-9cab-eea0274aca38 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:31:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:31:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Acquiring lock "2f960239-8deb-4d9f-9cab-eea0274aca38" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:31:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:31:11 user nova-compute[73078]: INFO nova.compute.manager [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Attaching volume 301c2066-2031-4c67-85ff-e480bb2333a2 to /dev/vdb
Aug 14 18:31:11 user nova-compute[73078]: DEBUG os_brick.utils [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:31:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7a4e7f-218a-4a9e-b58f-d5c81b36d6cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:31:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac202ffb-643b-4ecc-aaa6-a4b730aad722]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:31:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2228d6a5-fbee-4876-b730-a3e26b8d497f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:31:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7375ad41-88ba-41a3-889e-c71c30cb4d52]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:31:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:31:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:31:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:12 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:31:12 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:31:12 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad6a75c-bbc0-406d-9387-1c8f100b04e7]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:31:12 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:31:12 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:31:12 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:31:12 user nova-compute[73078]: DEBUG os_brick.utils [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:31:12 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Updating existing volume attachment record: a72ca6b9-3d78-486d-839f-5e6aaa489198 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:31:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e3d6f31c-aeb1-491c-bf59-6a1098402aa7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:31:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e3d6f31c-aeb1-491c-bf59-6a1098402aa7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:31:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e3d6f31c-aeb1-491c-bf59-6a1098402aa7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:31:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e3d6f31c-aeb1-491c-bf59-6a1098402aa7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:31:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e3d6f31c-aeb1-491c-bf59-6a1098402aa7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:31:18 user nova-compute[73078]: INFO nova.compute.manager [None req-e3d6f31c-aeb1-491c-bf59-6a1098402aa7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Terminating instance
Aug 14 18:31:18 user nova-compute[73078]: DEBUG nova.compute.manager [None req-e3d6f31c-aeb1-491c-bf59-6a1098402aa7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:31:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:18 user nova-compute[73078]: DEBUG nova.compute.manager [req-ad8f2fd4-edf6-444c-8e1f-6f0b62c2679a req-99f7908b-b5f0-4ac6-a9e4-919c1c352213 service nova] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Received event network-vif-unplugged-3a7aa5b0-e16a-41c5-90e6-2065778d0dfd {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:31:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ad8f2fd4-edf6-444c-8e1f-6f0b62c2679a req-99f7908b-b5f0-4ac6-a9e4-919c1c352213 service nova] Acquiring lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:31:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ad8f2fd4-edf6-444c-8e1f-6f0b62c2679a req-99f7908b-b5f0-4ac6-a9e4-919c1c352213 service nova] Lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:31:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ad8f2fd4-edf6-444c-8e1f-6f0b62c2679a req-99f7908b-b5f0-4ac6-a9e4-919c1c352213 service nova] Lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:31:18 user nova-compute[73078]: DEBUG nova.compute.manager [req-ad8f2fd4-edf6-444c-8e1f-6f0b62c2679a req-99f7908b-b5f0-4ac6-a9e4-919c1c352213 service nova] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] No waiting events found dispatching network-vif-unplugged-3a7aa5b0-e16a-41c5-90e6-2065778d0dfd {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:31:18 user nova-compute[73078]: DEBUG nova.compute.manager [req-ad8f2fd4-edf6-444c-8e1f-6f0b62c2679a req-99f7908b-b5f0-4ac6-a9e4-919c1c352213 service nova] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Received event network-vif-unplugged-3a7aa5b0-e16a-41c5-90e6-2065778d0dfd for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:31:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:19 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Instance destroyed successfully.
Aug 14 18:31:19 user nova-compute[73078]: DEBUG nova.objects.instance [None req-e3d6f31c-aeb1-491c-bf59-6a1098402aa7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lazy-loading 'resources' on Instance uuid 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:31:19 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-e3d6f31c-aeb1-491c-bf59-6a1098402aa7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:25:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-199092222',display_name='tempest-AttachVolumeNegativeTest-server-199092222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-199092222',id=34,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYiVauuk7EHbBA4bwswOlC6bhf4ZmAG3SG96mGYOBdLWu/bCu8ZPkXoRCGLpW7RwV0XXfsmLvJD6JNUowmOJtcjB0DepDnl+RL7c2A9zcsd5CkwWetrMPor0dGVOj+zYw==',key_name='tempest-keypair-961068103',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:25:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1391a0a2167745348384e5890e6c22db',ramdisk_id='',reservation_id='r-tk1satb6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1671295372',owner_user_name='tempest-AttachVolumeNegativeTest-1671295372-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:25:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3c5d292e9594e4aadad9ac72b9455ed',uuid=9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a7aa5b0-e16a-41c5-90e6-2065778d0dfd", "address": "fa:16:3e:e3:20:8e", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7aa5b0-e1", "ovs_interfaceid": "3a7aa5b0-e16a-41c5-90e6-2065778d0dfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:31:19 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-e3d6f31c-aeb1-491c-bf59-6a1098402aa7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Converting VIF {"id": "3a7aa5b0-e16a-41c5-90e6-2065778d0dfd", "address": "fa:16:3e:e3:20:8e", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7aa5b0-e1", "ovs_interfaceid": "3a7aa5b0-e16a-41c5-90e6-2065778d0dfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:31:19 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-e3d6f31c-aeb1-491c-bf59-6a1098402aa7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:20:8e,bridge_name='br-int',has_traffic_filtering=True,id=3a7aa5b0-e16a-41c5-90e6-2065778d0dfd,network=Network(88e922e4-ec89-460a-954d-aff20a41293c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a7aa5b0-e1') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:31:19 user nova-compute[73078]: DEBUG os_vif [None req-e3d6f31c-aeb1-491c-bf59-6a1098402aa7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:20:8e,bridge_name='br-int',has_traffic_filtering=True,id=3a7aa5b0-e16a-41c5-90e6-2065778d0dfd,network=Network(88e922e4-ec89-460a-954d-aff20a41293c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a7aa5b0-e1') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:31:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a7aa5b0-e1, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:31:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:31:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:19 user nova-compute[73078]: INFO os_vif [None req-e3d6f31c-aeb1-491c-bf59-6a1098402aa7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:20:8e,bridge_name='br-int',has_traffic_filtering=True,id=3a7aa5b0-e16a-41c5-90e6-2065778d0dfd,network=Network(88e922e4-ec89-460a-954d-aff20a41293c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a7aa5b0-e1')
Aug 14 18:31:19 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-e3d6f31c-aeb1-491c-bf59-6a1098402aa7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Deleting instance files /opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21_del
Aug 14 18:31:19 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-e3d6f31c-aeb1-491c-bf59-6a1098402aa7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Deletion of /opt/stack/data/nova/instances/9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21_del complete
Aug 14 18:31:19 user nova-compute[73078]: INFO nova.compute.manager [None req-e3d6f31c-aeb1-491c-bf59-6a1098402aa7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 14 18:31:19 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-e3d6f31c-aeb1-491c-bf59-6a1098402aa7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:31:19 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:31:19 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:31:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "16a18fae-165b-487b-bfd5-20097eac0a8e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:31:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:31:20 user nova-compute[73078]: DEBUG nova.compute.manager [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:31:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:31:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:31:20 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:31:20 user nova-compute[73078]: INFO nova.compute.claims [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Claim successful on node user
Aug 14 18:31:20 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:31:20 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:31:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:31:20 user nova-compute[73078]: DEBUG nova.compute.manager [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:31:20 user nova-compute[73078]: DEBUG nova.compute.manager [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:31:20 user nova-compute[73078]: DEBUG nova.network.neutron [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:31:20 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:31:20 user nova-compute[73078]: DEBUG nova.compute.manager [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:31:20 user nova-compute[73078]: DEBUG nova.policy [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cc0adf66a66f4f4fb698706b5d3294cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c717b7be2814591a20db3c81bc5ba89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:31:20 user nova-compute[73078]: DEBUG nova.compute.manager [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:31:20 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:31:20 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Creating image(s)
Aug 14 18:31:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "/opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:31:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "/opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:31:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "/opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:31:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG nova.compute.manager [req-edfa4703-8625-442c-a000-5e99d5566dc1 req-6e18249d-780d-4254-9fbb-c285dc3f0d95 service nova] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Received event network-vif-plugged-3a7aa5b0-e16a-41c5-90e6-2065778d0dfd {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-edfa4703-8625-442c-a000-5e99d5566dc1 req-6e18249d-780d-4254-9fbb-c285dc3f0d95 service nova] Acquiring lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-edfa4703-8625-442c-a000-5e99d5566dc1 req-6e18249d-780d-4254-9fbb-c285dc3f0d95 service nova] Lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-edfa4703-8625-442c-a000-5e99d5566dc1 req-6e18249d-780d-4254-9fbb-c285dc3f0d95 service nova] Lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG nova.compute.manager [req-edfa4703-8625-442c-a000-5e99d5566dc1 req-6e18249d-780d-4254-9fbb-c285dc3f0d95 service nova] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] No waiting events found dispatching network-vif-plugged-3a7aa5b0-e16a-41c5-90e6-2065778d0dfd {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:31:21 user nova-compute[73078]: WARNING nova.compute.manager [req-edfa4703-8625-442c-a000-5e99d5566dc1 req-6e18249d-780d-4254-9fbb-c285dc3f0d95 service nova] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Received unexpected event network-vif-plugged-3a7aa5b0-e16a-41c5-90e6-2065778d0dfd for instance with vm_state active and task_state deleting.
Aug 14 18:31:21 user nova-compute[73078]: DEBUG nova.compute.manager [req-edfa4703-8625-442c-a000-5e99d5566dc1 req-6e18249d-780d-4254-9fbb-c285dc3f0d95 service nova] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Received event network-vif-plugged-3a7aa5b0-e16a-41c5-90e6-2065778d0dfd {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-edfa4703-8625-442c-a000-5e99d5566dc1 req-6e18249d-780d-4254-9fbb-c285dc3f0d95 service nova] Acquiring lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-edfa4703-8625-442c-a000-5e99d5566dc1 req-6e18249d-780d-4254-9fbb-c285dc3f0d95 service nova] Lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-edfa4703-8625-442c-a000-5e99d5566dc1 req-6e18249d-780d-4254-9fbb-c285dc3f0d95 service nova] Lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG nova.compute.manager [req-edfa4703-8625-442c-a000-5e99d5566dc1 req-6e18249d-780d-4254-9fbb-c285dc3f0d95 service nova] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] No waiting events found dispatching network-vif-plugged-3a7aa5b0-e16a-41c5-90e6-2065778d0dfd {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:31:21 user nova-compute[73078]: WARNING nova.compute.manager [req-edfa4703-8625-442c-a000-5e99d5566dc1 req-6e18249d-780d-4254-9fbb-c285dc3f0d95 service nova] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Received unexpected event network-vif-plugged-3a7aa5b0-e16a-41c5-90e6-2065778d0dfd for instance with vm_state active and task_state deleting.
Aug 14 18:31:21 user nova-compute[73078]: DEBUG nova.compute.manager [req-edfa4703-8625-442c-a000-5e99d5566dc1 req-6e18249d-780d-4254-9fbb-c285dc3f0d95 service nova] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Received event network-vif-plugged-3a7aa5b0-e16a-41c5-90e6-2065778d0dfd {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-edfa4703-8625-442c-a000-5e99d5566dc1 req-6e18249d-780d-4254-9fbb-c285dc3f0d95 service nova] Acquiring lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-edfa4703-8625-442c-a000-5e99d5566dc1 req-6e18249d-780d-4254-9fbb-c285dc3f0d95 service nova] Lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-edfa4703-8625-442c-a000-5e99d5566dc1 req-6e18249d-780d-4254-9fbb-c285dc3f0d95 service nova] Lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG nova.compute.manager [req-edfa4703-8625-442c-a000-5e99d5566dc1 req-6e18249d-780d-4254-9fbb-c285dc3f0d95 service nova] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] No waiting events found dispatching network-vif-plugged-3a7aa5b0-e16a-41c5-90e6-2065778d0dfd {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:31:21 user nova-compute[73078]: WARNING nova.compute.manager [req-edfa4703-8625-442c-a000-5e99d5566dc1 req-6e18249d-780d-4254-9fbb-c285dc3f0d95 service nova] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Received unexpected event network-vif-plugged-3a7aa5b0-e16a-41c5-90e6-2065778d0dfd for instance with vm_state active and task_state deleting.
Aug 14 18:31:21 user nova-compute[73078]: DEBUG nova.compute.manager [req-edfa4703-8625-442c-a000-5e99d5566dc1 req-6e18249d-780d-4254-9fbb-c285dc3f0d95 service nova] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Received event network-vif-unplugged-3a7aa5b0-e16a-41c5-90e6-2065778d0dfd {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-edfa4703-8625-442c-a000-5e99d5566dc1 req-6e18249d-780d-4254-9fbb-c285dc3f0d95 service nova] Acquiring lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-edfa4703-8625-442c-a000-5e99d5566dc1 req-6e18249d-780d-4254-9fbb-c285dc3f0d95 service nova] Lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-edfa4703-8625-442c-a000-5e99d5566dc1 req-6e18249d-780d-4254-9fbb-c285dc3f0d95 service nova] Lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG nova.compute.manager [req-edfa4703-8625-442c-a000-5e99d5566dc1 req-6e18249d-780d-4254-9fbb-c285dc3f0d95 service nova] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] No waiting events found dispatching network-vif-unplugged-3a7aa5b0-e16a-41c5-90e6-2065778d0dfd {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG nova.compute.manager [req-edfa4703-8625-442c-a000-5e99d5566dc1 req-6e18249d-780d-4254-9fbb-c285dc3f0d95 service nova] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Received event network-vif-unplugged-3a7aa5b0-e16a-41c5-90e6-2065778d0dfd for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.196s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HznYjREs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:31:21 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:31:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:31:21 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:31:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:31:21 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:31:21 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:21 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Took 1.82 seconds to deallocate network for instance.
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8165fbd2-a19e-4b6d-9c3b-90923e31c293]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:31:21 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf4c14a-6af1-434f-a814-227f6bbfdd3f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2] added
Aug 14 18:31:21 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.196s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e3221b-0dd4-499c-acb5-ec7907938016]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e3d6f31c-aeb1-491c-bf59-6a1098402aa7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e3d6f31c-aeb1-491c-bf59-6a1098402aa7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk 1073741824" returned: 0 in 0.051s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ec778a-d876-46ad-8d7d-bf1908cc21dc]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HznYjREs {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HznYjREs" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[72db80f2-b8d5-4d7e-8425-c5317fcd71e1]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HznYjREs'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc9e543-e800-452a-b775-2fadb25a5158]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b0e6a0-fcd2-4f2b-adef-4b3232f495dc]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:31:21 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:31:21 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:31:21 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:31:21 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a78cf72-2d52-4b66-b831-814ec7487e35]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2, portal: 172.16.0.220,3260]
Aug 14 18:31:21 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2, portal: 172.16.0.220,3260] successful.
Aug 14 18:31:21 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.215s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c9e3e0-6928-43d5-84d7-a8e8e780df81]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG nova.network.neutron [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Successfully created port: 2dd60866-9ed8-4840-a797-893d81ab2b65 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9227ecc2-06d3-4e12-9c2c-5a022f25d0e6]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:31:21 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:31:21 user nova-compute[73078]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2 (non-flash)
Aug 14 18:31:21 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:31:21 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:31:21 user nova-compute[73078]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2 (non-flash)
Aug 14 18:31:21 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.425s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[611a023c-d350-488e-af37-db44a56af203]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HznYjREs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Cannot resize image /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG nova.objects.instance [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lazy-loading 'migration_context' on Instance uuid 16a18fae-165b-487b-bfd5-20097eac0a8e {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Ensure instance console log exists: /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-e3d6f31c-aeb1-491c-bf59-6a1098402aa7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-e3d6f31c-aeb1-491c-bf59-6a1098402aa7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e3d6f31c-aeb1-491c-bf59-6a1098402aa7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.540s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:31:21 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-e3d6f31c-aeb1-491c-bf59-6a1098402aa7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Deleted allocations for instance 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21
Aug 14 18:31:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e3d6f31c-aeb1-491c-bf59-6a1098402aa7 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.552s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG nova.network.neutron [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Successfully updated port: 2dd60866-9ed8-4840-a797-893d81ab2b65 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "refresh_cache-16a18fae-165b-487b-bfd5-20097eac0a8e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquired lock "refresh_cache-16a18fae-165b-487b-bfd5-20097eac0a8e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG nova.network.neutron [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG nova.compute.manager [req-4ca230dd-a220-438e-bea9-2f4e9e304034 req-18326a1b-b34e-4b34-bc50-3a0dfb6e3718 service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Received event network-changed-2dd60866-9ed8-4840-a797-893d81ab2b65 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG nova.compute.manager [req-4ca230dd-a220-438e-bea9-2f4e9e304034 req-18326a1b-b34e-4b34-bc50-3a0dfb6e3718 service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Refreshing instance network info cache due to event network-changed-2dd60866-9ed8-4840-a797-893d81ab2b65. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4ca230dd-a220-438e-bea9-2f4e9e304034 req-18326a1b-b34e-4b34-bc50-3a0dfb6e3718 service nova] Acquiring lock "refresh_cache-16a18fae-165b-487b-bfd5-20097eac0a8e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG nova.network.neutron [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.466s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] <== connect_volume: return (1470ms) {'type': 'block', 'scsi_wwn': '23433316233366161', 'path': '/dev/sdc'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433316233366161', 'path': '/dev/sdc'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG nova.objects.instance [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lazy-loading 'flavor' on Instance uuid 2f960239-8deb-4d9f-9cab-eea0274aca38 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 18:31:22 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:31:22 user nova-compute[73078]:   <source dev="/dev/sdc"/>
Aug 14 18:31:22 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:31:22 user nova-compute[73078]:   <serial>301c2066-2031-4c67-85ff-e480bb2333a2</serial>
Aug 14 18:31:22 user nova-compute[73078]: </disk>
Aug 14 18:31:22 user nova-compute[73078]:  {{(pid=73078) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG nova.network.neutron [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Updating instance_info_cache with network_info: [{"id": "2dd60866-9ed8-4840-a797-893d81ab2b65", "address": "fa:16:3e:62:78:e2", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd60866-9e", "ovs_interfaceid": "2dd60866-9ed8-4840-a797-893d81ab2b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Releasing lock "refresh_cache-16a18fae-165b-487b-bfd5-20097eac0a8e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG nova.compute.manager [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Instance network_info: |[{"id": "2dd60866-9ed8-4840-a797-893d81ab2b65", "address": "fa:16:3e:62:78:e2", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd60866-9e", "ovs_interfaceid": "2dd60866-9ed8-4840-a797-893d81ab2b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4ca230dd-a220-438e-bea9-2f4e9e304034 req-18326a1b-b34e-4b34-bc50-3a0dfb6e3718 service nova] Acquired lock "refresh_cache-16a18fae-165b-487b-bfd5-20097eac0a8e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG nova.network.neutron [req-4ca230dd-a220-438e-bea9-2f4e9e304034 req-18326a1b-b34e-4b34-bc50-3a0dfb6e3718 service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Refreshing network info cache for port 2dd60866-9ed8-4840-a797-893d81ab2b65 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Start _get_guest_xml network_info=[{"id": "2dd60866-9ed8-4840-a797-893d81ab2b65", "address": "fa:16:3e:62:78:e2", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd60866-9e", "ovs_interfaceid": "2dd60866-9ed8-4840-a797-893d81ab2b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:31:22 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:31:22 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:31:22 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:31:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1523618791',display_name='tempest-AttachVolumeTestJSON-server-1523618791',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1523618791',id=41,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGt0IZUR45BoJPTktrLR+OSUIGX16DeSC3GRnxH2CMKh+NvhLefmy7aiMx94bvaYe2eBuYWP6rvvpzTkrEkuFVyTl4uoHzIOYqmCyqn8E4fpKgZ5Lep2EZjGHAoZGcIfQ==',key_name='tempest-keypair-1506094444',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c717b7be2814591a20db3c81bc5ba89',ramdisk_id='',reservation_id='r-j7btfmht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-120525527',owner_user_name='tempest-AttachVolumeTestJSON-120525527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:31:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc0adf66a66f4f4fb698706b5d3294cd',uuid=16a18fae-165b-487b-bfd5-20097eac0a8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dd60866-9ed8-4840-a797-893d81ab2b65", "address": "fa:16:3e:62:78:e2", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd60866-9e", "ovs_interfaceid": "2dd60866-9ed8-4840-a797-893d81ab2b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Converting VIF {"id": "2dd60866-9ed8-4840-a797-893d81ab2b65", "address": "fa:16:3e:62:78:e2", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd60866-9e", "ovs_interfaceid": "2dd60866-9ed8-4840-a797-893d81ab2b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:78:e2,bridge_name='br-int',has_traffic_filtering=True,id=2dd60866-9ed8-4840-a797-893d81ab2b65,network=Network(0e58d249-c00c-45c4-bc46-9d975b128a0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd60866-9e') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG nova.objects.instance [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lazy-loading 'pci_devices' on Instance uuid 16a18fae-165b-487b-bfd5-20097eac0a8e {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:31:22 user nova-compute[73078]:   <uuid>16a18fae-165b-487b-bfd5-20097eac0a8e</uuid>
Aug 14 18:31:22 user nova-compute[73078]:   <name>instance-00000029</name>
Aug 14 18:31:22 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:31:22 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:31:22 user nova-compute[73078]:   <metadata>
Aug 14 18:31:22 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:31:22 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:31:22 user nova-compute[73078]:       <nova:name>tempest-AttachVolumeTestJSON-server-1523618791</nova:name>
Aug 14 18:31:22 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:31:22</nova:creationTime>
Aug 14 18:31:22 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:31:22 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:31:22 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:31:22 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:31:22 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:31:22 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:31:22 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:31:22 user nova-compute[73078]:       <nova:owner>
Aug 14 18:31:22 user nova-compute[73078]:         <nova:user uuid="cc0adf66a66f4f4fb698706b5d3294cd">tempest-AttachVolumeTestJSON-120525527-project-member</nova:user>
Aug 14 18:31:22 user nova-compute[73078]:         <nova:project uuid="8c717b7be2814591a20db3c81bc5ba89">tempest-AttachVolumeTestJSON-120525527</nova:project>
Aug 14 18:31:22 user nova-compute[73078]:       </nova:owner>
Aug 14 18:31:22 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:31:22 user nova-compute[73078]:       <nova:ports>
Aug 14 18:31:22 user nova-compute[73078]:         <nova:port uuid="2dd60866-9ed8-4840-a797-893d81ab2b65">
Aug 14 18:31:22 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 18:31:22 user nova-compute[73078]:         </nova:port>
Aug 14 18:31:22 user nova-compute[73078]:       </nova:ports>
Aug 14 18:31:22 user nova-compute[73078]:     </nova:instance>
Aug 14 18:31:22 user nova-compute[73078]:   </metadata>
Aug 14 18:31:22 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:31:22 user nova-compute[73078]:     <system>
Aug 14 18:31:22 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:31:22 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:31:22 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:31:22 user nova-compute[73078]:       <entry name="serial">16a18fae-165b-487b-bfd5-20097eac0a8e</entry>
Aug 14 18:31:22 user nova-compute[73078]:       <entry name="uuid">16a18fae-165b-487b-bfd5-20097eac0a8e</entry>
Aug 14 18:31:22 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:31:22 user nova-compute[73078]:     </system>
Aug 14 18:31:22 user nova-compute[73078]:   </sysinfo>
Aug 14 18:31:22 user nova-compute[73078]:   <os>
Aug 14 18:31:22 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:31:22 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:31:22 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:31:22 user nova-compute[73078]:   </os>
Aug 14 18:31:22 user nova-compute[73078]:   <features>
Aug 14 18:31:22 user nova-compute[73078]:     <acpi/>
Aug 14 18:31:22 user nova-compute[73078]:     <apic/>
Aug 14 18:31:22 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:31:22 user nova-compute[73078]:   </features>
Aug 14 18:31:22 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:31:22 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:31:22 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:31:22 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:31:22 user nova-compute[73078]:   </clock>
Aug 14 18:31:22 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:31:22 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:31:22 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:31:22 user nova-compute[73078]:   </cpu>
Aug 14 18:31:22 user nova-compute[73078]:   <devices>
Aug 14 18:31:22 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:31:22 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:31:22 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk"/>
Aug 14 18:31:22 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:31:22 user nova-compute[73078]:     </disk>
Aug 14 18:31:22 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:31:22 user nova-compute[73078]:       <mac address="fa:16:3e:62:78:e2"/>
Aug 14 18:31:22 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:31:22 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:31:22 user nova-compute[73078]:       <target dev="tap2dd60866-9e"/>
Aug 14 18:31:22 user nova-compute[73078]:     </interface>
Aug 14 18:31:22 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:31:22 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/console.log" append="off"/>
Aug 14 18:31:22 user nova-compute[73078]:     </serial>
Aug 14 18:31:22 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:31:22 user nova-compute[73078]:     <video>
Aug 14 18:31:22 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:31:22 user nova-compute[73078]:     </video>
Aug 14 18:31:22 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:31:22 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:31:22 user nova-compute[73078]:     </rng>
Aug 14 18:31:22 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:31:22 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:31:22 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:31:22 user nova-compute[73078]:     </memballoon>
Aug 14 18:31:22 user nova-compute[73078]:   </devices>
Aug 14 18:31:22 user nova-compute[73078]: </domain>
Aug 14 18:31:22 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:31:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1523618791',display_name='tempest-AttachVolumeTestJSON-server-1523618791',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1523618791',id=41,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGt0IZUR45BoJPTktrLR+OSUIGX16DeSC3GRnxH2CMKh+NvhLefmy7aiMx94bvaYe2eBuYWP6rvvpzTkrEkuFVyTl4uoHzIOYqmCyqn8E4fpKgZ5Lep2EZjGHAoZGcIfQ==',key_name='tempest-keypair-1506094444',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c717b7be2814591a20db3c81bc5ba89',ramdisk_id='',reservation_id='r-j7btfmht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-120525527',owner_user_name='tempest-AttachVolumeTestJSON-120525527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:31:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc0adf66a66f4f4fb698706b5d3294cd',uuid=16a18fae-165b-487b-bfd5-20097eac0a8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dd60866-9ed8-4840-a797-893d81ab2b65", "address": "fa:16:3e:62:78:e2", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd60866-9e", "ovs_interfaceid": "2dd60866-9ed8-4840-a797-893d81ab2b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Converting VIF {"id": "2dd60866-9ed8-4840-a797-893d81ab2b65", "address": "fa:16:3e:62:78:e2", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd60866-9e", "ovs_interfaceid": "2dd60866-9ed8-4840-a797-893d81ab2b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:78:e2,bridge_name='br-int',has_traffic_filtering=True,id=2dd60866-9ed8-4840-a797-893d81ab2b65,network=Network(0e58d249-c00c-45c4-bc46-9d975b128a0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd60866-9e') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG os_vif [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:78:e2,bridge_name='br-int',has_traffic_filtering=True,id=2dd60866-9ed8-4840-a797-893d81ab2b65,network=Network(0e58d249-c00c-45c4-bc46-9d975b128a0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd60866-9e') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2dd60866-9e, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2dd60866-9e, col_values=(('external_ids', {'iface-id': '2dd60866-9ed8-4840-a797-893d81ab2b65', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:78:e2', 'vm-uuid': '16a18fae-165b-487b-bfd5-20097eac0a8e'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:31:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:22 user nova-compute[73078]: INFO os_vif [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:78:e2,bridge_name='br-int',has_traffic_filtering=True,id=2dd60866-9ed8-4840-a797-893d81ab2b65,network=Network(0e58d249-c00c-45c4-bc46-9d975b128a0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd60866-9e')
Aug 14 18:31:23 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:31:23 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] No VIF found with MAC fa:16:3e:62:78:e2, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:31:23 user nova-compute[73078]: DEBUG nova.compute.manager [req-56f9e887-f2b8-406d-bb3f-ffb205851741 req-7bab4d4b-62a3-42d6-b7ff-34a544321855 service nova] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Received event network-vif-deleted-3a7aa5b0-e16a-41c5-90e6-2065778d0dfd {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:31:23 user nova-compute[73078]: DEBUG nova.compute.manager [req-56f9e887-f2b8-406d-bb3f-ffb205851741 req-7bab4d4b-62a3-42d6-b7ff-34a544321855 service nova] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Received event network-vif-plugged-3a7aa5b0-e16a-41c5-90e6-2065778d0dfd {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:31:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-56f9e887-f2b8-406d-bb3f-ffb205851741 req-7bab4d4b-62a3-42d6-b7ff-34a544321855 service nova] Acquiring lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:31:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-56f9e887-f2b8-406d-bb3f-ffb205851741 req-7bab4d4b-62a3-42d6-b7ff-34a544321855 service nova] Lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:31:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-56f9e887-f2b8-406d-bb3f-ffb205851741 req-7bab4d4b-62a3-42d6-b7ff-34a544321855 service nova] Lock "9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:31:23 user nova-compute[73078]: DEBUG nova.compute.manager [req-56f9e887-f2b8-406d-bb3f-ffb205851741 req-7bab4d4b-62a3-42d6-b7ff-34a544321855 service nova] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] No waiting events found dispatching network-vif-plugged-3a7aa5b0-e16a-41c5-90e6-2065778d0dfd {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:31:23 user nova-compute[73078]: WARNING nova.compute.manager [req-56f9e887-f2b8-406d-bb3f-ffb205851741 req-7bab4d4b-62a3-42d6-b7ff-34a544321855 service nova] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Received unexpected event network-vif-plugged-3a7aa5b0-e16a-41c5-90e6-2065778d0dfd for instance with vm_state deleted and task_state None.
Aug 14 18:31:23 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:31:23 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:31:23 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] No VIF found with MAC fa:16:3e:38:ed:9c, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:31:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-fd15c9f2-8484-41fc-a205-e23fa561a865 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.639s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:31:23 user nova-compute[73078]: DEBUG nova.network.neutron [req-4ca230dd-a220-438e-bea9-2f4e9e304034 req-18326a1b-b34e-4b34-bc50-3a0dfb6e3718 service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Updated VIF entry in instance network info cache for port 2dd60866-9ed8-4840-a797-893d81ab2b65. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:31:23 user nova-compute[73078]: DEBUG nova.network.neutron [req-4ca230dd-a220-438e-bea9-2f4e9e304034 req-18326a1b-b34e-4b34-bc50-3a0dfb6e3718 service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Updating instance_info_cache with network_info: [{"id": "2dd60866-9ed8-4840-a797-893d81ab2b65", "address": "fa:16:3e:62:78:e2", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd60866-9e", "ovs_interfaceid": "2dd60866-9ed8-4840-a797-893d81ab2b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:31:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4ca230dd-a220-438e-bea9-2f4e9e304034 req-18326a1b-b34e-4b34-bc50-3a0dfb6e3718 service nova] Releasing lock "refresh_cache-16a18fae-165b-487b-bfd5-20097eac0a8e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:31:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c9bdf020-f64e-4342-ad84-a7f5b6d3c14c tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Acquiring lock "2f960239-8deb-4d9f-9cab-eea0274aca38" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:31:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c9bdf020-f64e-4342-ad84-a7f5b6d3c14c tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:31:24 user nova-compute[73078]: INFO nova.compute.manager [None req-c9bdf020-f64e-4342-ad84-a7f5b6d3c14c tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Detaching volume 301c2066-2031-4c67-85ff-e480bb2333a2
Aug 14 18:31:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:25 user nova-compute[73078]: INFO nova.virt.block_device [None req-c9bdf020-f64e-4342-ad84-a7f5b6d3c14c tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Attempting to driver detach volume 301c2066-2031-4c67-85ff-e480bb2333a2 from mountpoint /dev/vdb
Aug 14 18:31:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c9bdf020-f64e-4342-ad84-a7f5b6d3c14c tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Attempting to detach device vdb from instance 2f960239-8deb-4d9f-9cab-eea0274aca38 from the persistent domain config. {{(pid=73078) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-c9bdf020-f64e-4342-ad84-a7f5b6d3c14c tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:31:25 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:31:25 user nova-compute[73078]:   <source dev="/dev/sdc"/>
Aug 14 18:31:25 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:31:25 user nova-compute[73078]:   <serial>301c2066-2031-4c67-85ff-e480bb2333a2</serial>
Aug 14 18:31:25 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:31:25 user nova-compute[73078]: </disk>
Aug 14 18:31:25 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:31:25 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-c9bdf020-f64e-4342-ad84-a7f5b6d3c14c tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Successfully detached device vdb from instance 2f960239-8deb-4d9f-9cab-eea0274aca38 from the persistent domain config.
Aug 14 18:31:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c9bdf020-f64e-4342-ad84-a7f5b6d3c14c tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2f960239-8deb-4d9f-9cab-eea0274aca38 from the live domain config. {{(pid=73078) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-c9bdf020-f64e-4342-ad84-a7f5b6d3c14c tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:31:25 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:31:25 user nova-compute[73078]:   <source dev="/dev/sdc"/>
Aug 14 18:31:25 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:31:25 user nova-compute[73078]:   <serial>301c2066-2031-4c67-85ff-e480bb2333a2</serial>
Aug 14 18:31:25 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:31:25 user nova-compute[73078]: </disk>
Aug 14 18:31:25 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG nova.compute.manager [req-cb3dadd1-8e07-4498-a3c8-49e6d22dcf3f req-73aca780-3e8b-4f23-a82a-4d6f7fb456f3 service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Received event network-vif-plugged-2dd60866-9ed8-4840-a797-893d81ab2b65 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-cb3dadd1-8e07-4498-a3c8-49e6d22dcf3f req-73aca780-3e8b-4f23-a82a-4d6f7fb456f3 service nova] Acquiring lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-cb3dadd1-8e07-4498-a3c8-49e6d22dcf3f req-73aca780-3e8b-4f23-a82a-4d6f7fb456f3 service nova] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-cb3dadd1-8e07-4498-a3c8-49e6d22dcf3f req-73aca780-3e8b-4f23-a82a-4d6f7fb456f3 service nova] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG nova.compute.manager [req-cb3dadd1-8e07-4498-a3c8-49e6d22dcf3f req-73aca780-3e8b-4f23-a82a-4d6f7fb456f3 service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] No waiting events found dispatching network-vif-plugged-2dd60866-9ed8-4840-a797-893d81ab2b65 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:31:25 user nova-compute[73078]: WARNING nova.compute.manager [req-cb3dadd1-8e07-4498-a3c8-49e6d22dcf3f req-73aca780-3e8b-4f23-a82a-4d6f7fb456f3 service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Received unexpected event network-vif-plugged-2dd60866-9ed8-4840-a797-893d81ab2b65 for instance with vm_state building and task_state spawning.
Aug 14 18:31:25 user nova-compute[73078]: DEBUG nova.compute.manager [req-cb3dadd1-8e07-4498-a3c8-49e6d22dcf3f req-73aca780-3e8b-4f23-a82a-4d6f7fb456f3 service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Received event network-vif-plugged-2dd60866-9ed8-4840-a797-893d81ab2b65 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-cb3dadd1-8e07-4498-a3c8-49e6d22dcf3f req-73aca780-3e8b-4f23-a82a-4d6f7fb456f3 service nova] Acquiring lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-cb3dadd1-8e07-4498-a3c8-49e6d22dcf3f req-73aca780-3e8b-4f23-a82a-4d6f7fb456f3 service nova] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-cb3dadd1-8e07-4498-a3c8-49e6d22dcf3f req-73aca780-3e8b-4f23-a82a-4d6f7fb456f3 service nova] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG nova.compute.manager [req-cb3dadd1-8e07-4498-a3c8-49e6d22dcf3f req-73aca780-3e8b-4f23-a82a-4d6f7fb456f3 service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] No waiting events found dispatching network-vif-plugged-2dd60866-9ed8-4840-a797-893d81ab2b65 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:31:25 user nova-compute[73078]: WARNING nova.compute.manager [req-cb3dadd1-8e07-4498-a3c8-49e6d22dcf3f req-73aca780-3e8b-4f23-a82a-4d6f7fb456f3 service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Received unexpected event network-vif-plugged-2dd60866-9ed8-4840-a797-893d81ab2b65 for instance with vm_state building and task_state spawning.
Aug 14 18:31:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Received event <DeviceRemovedEvent: 1692037885.521126, 2f960239-8deb-4d9f-9cab-eea0274aca38 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73078) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-c9bdf020-f64e-4342-ad84-a7f5b6d3c14c tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2f960239-8deb-4d9f-9cab-eea0274aca38 {{(pid=73078) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 18:31:25 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-c9bdf020-f64e-4342-ad84-a7f5b6d3c14c tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Successfully detached device vdb from instance 2f960239-8deb-4d9f-9cab-eea0274aca38 from the live domain config.
Aug 14 18:31:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9bdf020-f64e-4342-ad84-a7f5b6d3c14c tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bdf020-f64e-4342-ad84-a7f5b6d3c14c tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HznYjREs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:31:25 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-c9bdf020-f64e-4342-ad84-a7f5b6d3c14c tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:31:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-c9bdf020-f64e-4342-ad84-a7f5b6d3c14c tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-c9bdf020-f64e-4342-ad84-a7f5b6d3c14c tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bdf020-f64e-4342-ad84-a7f5b6d3c14c tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0620158-2214-494c-b480-6d5bf68e9b61]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df26c1e-1b52-4c0c-9e09-733032e12ded]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bdf020-f64e-4342-ad84-a7f5b6d3c14c tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:31:25 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:31:25 user nova-compute[73078]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2 (non-flash)
Aug 14 18:31:25 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bdf020-f64e-4342-ad84-a7f5b6d3c14c tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:31:25 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:31:25 user nova-compute[73078]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2 (non-flash)
Aug 14 18:31:25 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bdf020-f64e-4342-ad84-a7f5b6d3c14c tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9782f4820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2'): ({'sdc'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-c9bdf020-f64e-4342-ad84-a7f5b6d3c14c tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Removing single pathed devices sdc {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0e9eeb-c8c4-4b81-bc60-a11ae7195d54]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[81458aad-2a60-42d9-afe2-0b321525d0f7]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-c9bdf020-f64e-4342-ad84-a7f5b6d3c14c tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Flushing IO for device /dev/sdc {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00002ea-e763-40a5-b85b-1be0dec6ce90]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-c9bdf020-f64e-4342-ad84-a7f5b6d3c14c tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[16584961-3ad0-497e-85c1-62be57f6cd5f]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-c9bdf020-f64e-4342-ad84-a7f5b6d3c14c tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-c9bdf020-f64e-4342-ad84-a7f5b6d3c14c tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] SCSI volumes sdc have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bdf020-f64e-4342-ad84-a7f5b6d3c14c tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.049s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ec6a48-0f99-4e1d-bc35-6edcaadf4de2]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bdf020-f64e-4342-ad84-a7f5b6d3c14c tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bb6bb8-a3e6-4894-a7c8-f3b7d309ffbd]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bdf020-f64e-4342-ad84-a7f5b6d3c14c tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2, portal: 172.16.0.220,3260]
Aug 14 18:31:25 user nova-compute[73078]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2, portal: 172.16.0.220,3260] successful.
Aug 14 18:31:25 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:301c2066-2031-4c67-85ff-e480bb2333a2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24cd1e3-10b0-4fc8-86fd-22200c05ab78]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bdf020-f64e-4342-ad84-a7f5b6d3c14c tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-c9bdf020-f64e-4342-ad84-a7f5b6d3c14c tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bdf020-f64e-4342-ad84-a7f5b6d3c14c tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] <== disconnect_volume: return (305ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:31:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9bdf020-f64e-4342-ad84-a7f5b6d3c14c tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:31:26 user nova-compute[73078]: DEBUG nova.compute.manager [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:31:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:31:26 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037886.5495389, 16a18fae-165b-487b-bfd5-20097eac0a8e => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:31:26 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] VM Resumed (Lifecycle Event)
Aug 14 18:31:26 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Instance spawned successfully.
Aug 14 18:31:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:31:26 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:31:26 user nova-compute[73078]: DEBUG nova.objects.instance [None req-c9bdf020-f64e-4342-ad84-a7f5b6d3c14c tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lazy-loading 'flavor' on Instance uuid 2f960239-8deb-4d9f-9cab-eea0274aca38 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:31:26 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:31:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:31:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:31:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:31:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:31:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:31:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:31:26 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:31:26 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037886.5507574, 16a18fae-165b-487b-bfd5-20097eac0a8e => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:31:26 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] VM Started (Lifecycle Event)
Aug 14 18:31:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c9bdf020-f64e-4342-ad84-a7f5b6d3c14c tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.657s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:31:26 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:31:26 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:31:26 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:31:26 user nova-compute[73078]: INFO nova.compute.manager [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Took 5.82 seconds to spawn the instance on the hypervisor.
Aug 14 18:31:26 user nova-compute[73078]: DEBUG nova.compute.manager [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:31:26 user nova-compute[73078]: INFO nova.compute.manager [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Took 6.58 seconds to build instance.
Aug 14 18:31:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-02553ced-58a6-4dc7-8574-d9b1df5561d9 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.672s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:31:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:34 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692037879.2287707, 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:31:34 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] VM Stopped (Lifecycle Event)
Aug 14 18:31:34 user nova-compute[73078]: DEBUG nova.compute.manager [None req-e29ab5f6-70dc-43b8-9aaa-90e6a96b50bc None None] [instance: 9552c2e2-1e52-4d4c-80c9-8cf13d4dcf21] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:31:37 user nova-compute[73078]: DEBUG nova.compute.manager [req-25914dee-0407-4851-852b-8565ec713fd9 req-0dc19164-2022-4a42-8042-156910ec66c6 service nova] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Received event network-changed-33b84b58-09ca-49f0-a118-2870cd38d6d3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:31:37 user nova-compute[73078]: DEBUG nova.compute.manager [req-25914dee-0407-4851-852b-8565ec713fd9 req-0dc19164-2022-4a42-8042-156910ec66c6 service nova] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Refreshing instance network info cache due to event network-changed-33b84b58-09ca-49f0-a118-2870cd38d6d3. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:31:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-25914dee-0407-4851-852b-8565ec713fd9 req-0dc19164-2022-4a42-8042-156910ec66c6 service nova] Acquiring lock "refresh_cache-5bf260cc-5c85-46e0-8326-7f23165065b7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:31:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-25914dee-0407-4851-852b-8565ec713fd9 req-0dc19164-2022-4a42-8042-156910ec66c6 service nova] Acquired lock "refresh_cache-5bf260cc-5c85-46e0-8326-7f23165065b7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:31:37 user nova-compute[73078]: DEBUG nova.network.neutron [req-25914dee-0407-4851-852b-8565ec713fd9 req-0dc19164-2022-4a42-8042-156910ec66c6 service nova] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Refreshing network info cache for port 33b84b58-09ca-49f0-a118-2870cd38d6d3 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:31:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e70a30b2-b9b7-4634-9641-0401a6706b22 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Acquiring lock "5bf260cc-5c85-46e0-8326-7f23165065b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:31:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e70a30b2-b9b7-4634-9641-0401a6706b22 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "5bf260cc-5c85-46e0-8326-7f23165065b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:31:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e70a30b2-b9b7-4634-9641-0401a6706b22 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Acquiring lock "5bf260cc-5c85-46e0-8326-7f23165065b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:31:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e70a30b2-b9b7-4634-9641-0401a6706b22 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "5bf260cc-5c85-46e0-8326-7f23165065b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:31:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e70a30b2-b9b7-4634-9641-0401a6706b22 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "5bf260cc-5c85-46e0-8326-7f23165065b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:31:37 user nova-compute[73078]: INFO nova.compute.manager [None req-e70a30b2-b9b7-4634-9641-0401a6706b22 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Terminating instance
Aug 14 18:31:37 user nova-compute[73078]: DEBUG nova.compute.manager [None req-e70a30b2-b9b7-4634-9641-0401a6706b22 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:31:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:37 user nova-compute[73078]: DEBUG nova.network.neutron [req-25914dee-0407-4851-852b-8565ec713fd9 req-0dc19164-2022-4a42-8042-156910ec66c6 service nova] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Updated VIF entry in instance network info cache for port 33b84b58-09ca-49f0-a118-2870cd38d6d3. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:31:37 user nova-compute[73078]: DEBUG nova.network.neutron [req-25914dee-0407-4851-852b-8565ec713fd9 req-0dc19164-2022-4a42-8042-156910ec66c6 service nova] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Updating instance_info_cache with network_info: [{"id": "33b84b58-09ca-49f0-a118-2870cd38d6d3", "address": "fa:16:3e:66:a1:dc", "network": {"id": "21c76d99-2d0a-42b9-b7a0-b068f0cb938f", "bridge": "br-int", "label": "tempest-TestStampPattern-1682035048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce3bd6c6a784ee3a395c368d667c1b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b84b58-09", "ovs_interfaceid": "33b84b58-09ca-49f0-a118-2870cd38d6d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:31:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-25914dee-0407-4851-852b-8565ec713fd9 req-0dc19164-2022-4a42-8042-156910ec66c6 service nova] Releasing lock "refresh_cache-5bf260cc-5c85-46e0-8326-7f23165065b7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:31:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:38 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Instance destroyed successfully.
Aug 14 18:31:38 user nova-compute[73078]: DEBUG nova.objects.instance [None req-e70a30b2-b9b7-4634-9641-0401a6706b22 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lazy-loading 'resources' on Instance uuid 5bf260cc-5c85-46e0-8326-7f23165065b7 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:31:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-e70a30b2-b9b7-4634-9641-0401a6706b22 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:28:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-535819277',display_name='tempest-TestStampPattern-server-535819277',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-535819277',id=38,image_ref='30756806-1030-4804-b5e8-82296f27a7fd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCcJMv1AV17ylcLliWNA6MPLR+aDJkzXeqhllF0bf2imCcrbw2X6UlhzsHI25lDDbRh7U/jFMtBw5eymdUYDpVK4u5ZUqAplS3uUj5rbwGNZVg+pHSh9eSszqkvnE3m/A==',key_name='tempest-TestStampPattern-762241101',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:28:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ce3bd6c6a784ee3a395c368d667c1b3',ramdisk_id='',reservation_id='r-gl0rxoa0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='ef083dd3-67d6-48a8-846a-7fe6c6b32d5c',image_min_disk='1',image_min_ram='0',image_owner_id='0ce3bd6c6a784ee3a395c368d667c1b3',image_owner_project_name='tempest-TestStampPattern-11663352',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-11663352-project-member',image_user_id='08f7cf7e532f46c8942157b99f9ccd77',owner_project_name='tempest-TestStampPattern-11663352',owner_user_name='tempest-TestStampPattern-11663352-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:28:48Z,user_data=None,user_id='08f7cf7e532f46c8942157b99f9ccd77',uuid=5bf260cc-5c85-46e0-8326-7f23165065b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33b84b58-09ca-49f0-a118-2870cd38d6d3", "address": "fa:16:3e:66:a1:dc", "network": {"id": "21c76d99-2d0a-42b9-b7a0-b068f0cb938f", "bridge": "br-int", "label": "tempest-TestStampPattern-1682035048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce3bd6c6a784ee3a395c368d667c1b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b84b58-09", "ovs_interfaceid": "33b84b58-09ca-49f0-a118-2870cd38d6d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:31:38 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-e70a30b2-b9b7-4634-9641-0401a6706b22 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Converting VIF {"id": "33b84b58-09ca-49f0-a118-2870cd38d6d3", "address": "fa:16:3e:66:a1:dc", "network": {"id": "21c76d99-2d0a-42b9-b7a0-b068f0cb938f", "bridge": "br-int", "label": "tempest-TestStampPattern-1682035048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce3bd6c6a784ee3a395c368d667c1b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b84b58-09", "ovs_interfaceid": "33b84b58-09ca-49f0-a118-2870cd38d6d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:31:38 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-e70a30b2-b9b7-4634-9641-0401a6706b22 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:a1:dc,bridge_name='br-int',has_traffic_filtering=True,id=33b84b58-09ca-49f0-a118-2870cd38d6d3,network=Network(21c76d99-2d0a-42b9-b7a0-b068f0cb938f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33b84b58-09') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:31:38 user nova-compute[73078]: DEBUG os_vif [None req-e70a30b2-b9b7-4634-9641-0401a6706b22 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:a1:dc,bridge_name='br-int',has_traffic_filtering=True,id=33b84b58-09ca-49f0-a118-2870cd38d6d3,network=Network(21c76d99-2d0a-42b9-b7a0-b068f0cb938f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33b84b58-09') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:31:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33b84b58-09, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:31:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:31:38 user nova-compute[73078]: INFO os_vif [None req-e70a30b2-b9b7-4634-9641-0401a6706b22 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:a1:dc,bridge_name='br-int',has_traffic_filtering=True,id=33b84b58-09ca-49f0-a118-2870cd38d6d3,network=Network(21c76d99-2d0a-42b9-b7a0-b068f0cb938f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33b84b58-09')
Aug 14 18:31:38 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-e70a30b2-b9b7-4634-9641-0401a6706b22 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Deleting instance files /opt/stack/data/nova/instances/5bf260cc-5c85-46e0-8326-7f23165065b7_del
Aug 14 18:31:38 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-e70a30b2-b9b7-4634-9641-0401a6706b22 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Deletion of /opt/stack/data/nova/instances/5bf260cc-5c85-46e0-8326-7f23165065b7_del complete
Aug 14 18:31:38 user nova-compute[73078]: INFO nova.compute.manager [None req-e70a30b2-b9b7-4634-9641-0401a6706b22 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Took 0.83 seconds to destroy the instance on the hypervisor.
Aug 14 18:31:38 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-e70a30b2-b9b7-4634-9641-0401a6706b22 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:31:38 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:31:38 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:31:38 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:31:38 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Took 0.51 seconds to deallocate network for instance.
Aug 14 18:31:38 user nova-compute[73078]: DEBUG nova.compute.manager [req-34cc1ef1-72ca-4962-9031-b6098fe8c7d7 req-7edb8352-ac73-464c-8ab2-ef1259d61a23 service nova] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Received event network-vif-deleted-33b84b58-09ca-49f0-a118-2870cd38d6d3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:31:38 user nova-compute[73078]: INFO nova.compute.manager [req-34cc1ef1-72ca-4962-9031-b6098fe8c7d7 req-7edb8352-ac73-464c-8ab2-ef1259d61a23 service nova] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Neutron deleted interface 33b84b58-09ca-49f0-a118-2870cd38d6d3; detaching it from the instance and deleting it from the info cache
Aug 14 18:31:38 user nova-compute[73078]: DEBUG nova.network.neutron [req-34cc1ef1-72ca-4962-9031-b6098fe8c7d7 req-7edb8352-ac73-464c-8ab2-ef1259d61a23 service nova] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:31:38 user nova-compute[73078]: DEBUG nova.compute.manager [req-34cc1ef1-72ca-4962-9031-b6098fe8c7d7 req-7edb8352-ac73-464c-8ab2-ef1259d61a23 service nova] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Detach interface failed, port_id=33b84b58-09ca-49f0-a118-2870cd38d6d3, reason: Instance 5bf260cc-5c85-46e0-8326-7f23165065b7 could not be found. {{(pid=73078) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 18:31:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e70a30b2-b9b7-4634-9641-0401a6706b22 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:31:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e70a30b2-b9b7-4634-9641-0401a6706b22 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:31:38 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-e70a30b2-b9b7-4634-9641-0401a6706b22 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:31:38 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-e70a30b2-b9b7-4634-9641-0401a6706b22 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:31:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e70a30b2-b9b7-4634-9641-0401a6706b22 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:31:39 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-e70a30b2-b9b7-4634-9641-0401a6706b22 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Deleted allocations for instance 5bf260cc-5c85-46e0-8326-7f23165065b7
Aug 14 18:31:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e70a30b2-b9b7-4634-9641-0401a6706b22 tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "5bf260cc-5c85-46e0-8326-7f23165065b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.879s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:31:39 user nova-compute[73078]: DEBUG nova.compute.manager [req-20182420-9511-4cd1-93fb-3522dec2ae36 req-2ee71184-4a2f-44dd-bcf7-48e193c71211 service nova] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Received event network-vif-unplugged-33b84b58-09ca-49f0-a118-2870cd38d6d3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:31:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-20182420-9511-4cd1-93fb-3522dec2ae36 req-2ee71184-4a2f-44dd-bcf7-48e193c71211 service nova] Acquiring lock "5bf260cc-5c85-46e0-8326-7f23165065b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:31:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-20182420-9511-4cd1-93fb-3522dec2ae36 req-2ee71184-4a2f-44dd-bcf7-48e193c71211 service nova] Lock "5bf260cc-5c85-46e0-8326-7f23165065b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:31:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-20182420-9511-4cd1-93fb-3522dec2ae36 req-2ee71184-4a2f-44dd-bcf7-48e193c71211 service nova] Lock "5bf260cc-5c85-46e0-8326-7f23165065b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:31:39 user nova-compute[73078]: DEBUG nova.compute.manager [req-20182420-9511-4cd1-93fb-3522dec2ae36 req-2ee71184-4a2f-44dd-bcf7-48e193c71211 service nova] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] No waiting events found dispatching network-vif-unplugged-33b84b58-09ca-49f0-a118-2870cd38d6d3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:31:39 user nova-compute[73078]: WARNING nova.compute.manager [req-20182420-9511-4cd1-93fb-3522dec2ae36 req-2ee71184-4a2f-44dd-bcf7-48e193c71211 service nova] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Received unexpected event network-vif-unplugged-33b84b58-09ca-49f0-a118-2870cd38d6d3 for instance with vm_state deleted and task_state None.
Aug 14 18:31:39 user nova-compute[73078]: DEBUG nova.compute.manager [req-20182420-9511-4cd1-93fb-3522dec2ae36 req-2ee71184-4a2f-44dd-bcf7-48e193c71211 service nova] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Received event network-vif-plugged-33b84b58-09ca-49f0-a118-2870cd38d6d3 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:31:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-20182420-9511-4cd1-93fb-3522dec2ae36 req-2ee71184-4a2f-44dd-bcf7-48e193c71211 service nova] Acquiring lock "5bf260cc-5c85-46e0-8326-7f23165065b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:31:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-20182420-9511-4cd1-93fb-3522dec2ae36 req-2ee71184-4a2f-44dd-bcf7-48e193c71211 service nova] Lock "5bf260cc-5c85-46e0-8326-7f23165065b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:31:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-20182420-9511-4cd1-93fb-3522dec2ae36 req-2ee71184-4a2f-44dd-bcf7-48e193c71211 service nova] Lock "5bf260cc-5c85-46e0-8326-7f23165065b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:31:39 user nova-compute[73078]: DEBUG nova.compute.manager [req-20182420-9511-4cd1-93fb-3522dec2ae36 req-2ee71184-4a2f-44dd-bcf7-48e193c71211 service nova] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] No waiting events found dispatching network-vif-plugged-33b84b58-09ca-49f0-a118-2870cd38d6d3 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:31:39 user nova-compute[73078]: WARNING nova.compute.manager [req-20182420-9511-4cd1-93fb-3522dec2ae36 req-2ee71184-4a2f-44dd-bcf7-48e193c71211 service nova] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Received unexpected event network-vif-plugged-33b84b58-09ca-49f0-a118-2870cd38d6d3 for instance with vm_state deleted and task_state None.
Aug 14 18:31:42 user nova-compute[73078]: DEBUG nova.compute.manager [None req-14855650-9255-4444-9a30-123f928b8dbf tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:31:42 user nova-compute[73078]: INFO nova.compute.manager [None req-14855650-9255-4444-9a30-123f928b8dbf tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] instance snapshotting
Aug 14 18:31:42 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-14855650-9255-4444-9a30-123f928b8dbf tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Beginning live snapshot process
Aug 14 18:31:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-14855650-9255-4444-9a30-123f928b8dbf tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json -f qcow2 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-14855650-9255-4444-9a30-123f928b8dbf tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-14855650-9255-4444-9a30-123f928b8dbf tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json -f qcow2 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-14855650-9255-4444-9a30-123f928b8dbf tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-14855650-9255-4444-9a30-123f928b8dbf tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:43 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-14855650-9255-4444-9a30-123f928b8dbf tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.173s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-14855650-9255-4444-9a30-123f928b8dbf tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp347vzl3j/e9ab0b4f2d0c4246ba4932a2327fc18b.delta 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-14855650-9255-4444-9a30-123f928b8dbf tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp347vzl3j/e9ab0b4f2d0c4246ba4932a2327fc18b.delta 1073741824" returned: 0 in 0.047s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:43 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-14855650-9255-4444-9a30-123f928b8dbf tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 14 18:31:43 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:43 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-14855650-9255-4444-9a30-123f928b8dbf tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73078) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 18:31:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "7ad61d3c-db7d-407f-b2ee-f2f9d9256ced" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:31:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "7ad61d3c-db7d-407f-b2ee-f2f9d9256ced" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:31:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "7ad61d3c-db7d-407f-b2ee-f2f9d9256ced-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:31:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "7ad61d3c-db7d-407f-b2ee-f2f9d9256ced-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:31:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "7ad61d3c-db7d-407f-b2ee-f2f9d9256ced-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:31:44 user nova-compute[73078]: INFO nova.compute.manager [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Terminating instance
Aug 14 18:31:44 user nova-compute[73078]: DEBUG nova.compute.manager [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:31:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-14855650-9255-4444-9a30-123f928b8dbf tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73078) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 18:31:44 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-14855650-9255-4444-9a30-123f928b8dbf tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 18:31:44 user nova-compute[73078]: DEBUG nova.privsep.utils [None req-14855650-9255-4444-9a30-123f928b8dbf tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73078) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 18:31:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-14855650-9255-4444-9a30-123f928b8dbf tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp347vzl3j/e9ab0b4f2d0c4246ba4932a2327fc18b.delta /opt/stack/data/nova/instances/snapshots/tmp347vzl3j/e9ab0b4f2d0c4246ba4932a2327fc18b {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:44 user nova-compute[73078]: DEBUG nova.compute.manager [req-5cc40da9-0134-4990-83a1-c60cf44285c7 req-8c973721-409b-4e4e-bbf6-56d6419d049c service nova] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Received event network-vif-unplugged-02c80090-d3ca-47eb-882f-9f29edc28895 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:31:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5cc40da9-0134-4990-83a1-c60cf44285c7 req-8c973721-409b-4e4e-bbf6-56d6419d049c service nova] Acquiring lock "7ad61d3c-db7d-407f-b2ee-f2f9d9256ced-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:31:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5cc40da9-0134-4990-83a1-c60cf44285c7 req-8c973721-409b-4e4e-bbf6-56d6419d049c service nova] Lock "7ad61d3c-db7d-407f-b2ee-f2f9d9256ced-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:31:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5cc40da9-0134-4990-83a1-c60cf44285c7 req-8c973721-409b-4e4e-bbf6-56d6419d049c service nova] Lock "7ad61d3c-db7d-407f-b2ee-f2f9d9256ced-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:31:44 user nova-compute[73078]: DEBUG nova.compute.manager [req-5cc40da9-0134-4990-83a1-c60cf44285c7 req-8c973721-409b-4e4e-bbf6-56d6419d049c service nova] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] No waiting events found dispatching network-vif-unplugged-02c80090-d3ca-47eb-882f-9f29edc28895 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:31:44 user nova-compute[73078]: DEBUG nova.compute.manager [req-5cc40da9-0134-4990-83a1-c60cf44285c7 req-8c973721-409b-4e4e-bbf6-56d6419d049c service nova] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Received event network-vif-unplugged-02c80090-d3ca-47eb-882f-9f29edc28895 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-14855650-9255-4444-9a30-123f928b8dbf tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp347vzl3j/e9ab0b4f2d0c4246ba4932a2327fc18b.delta /opt/stack/data/nova/instances/snapshots/tmp347vzl3j/e9ab0b4f2d0c4246ba4932a2327fc18b" returned: 0 in 0.578s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:45 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-14855650-9255-4444-9a30-123f928b8dbf tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Snapshot extracted, beginning image upload
Aug 14 18:31:45 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:45 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Instance destroyed successfully.
Aug 14 18:31:45 user nova-compute[73078]: DEBUG nova.objects.instance [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lazy-loading 'resources' on Instance uuid 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:26:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-665190295',display_name='tempest-TestVolumeBootPattern-volume-backed-server-665190295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-665190295',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdjALq6jgdUasVS8cCpbY3Tky1JoTa4XvqUmUb8zF9c44T3u/n0nGq4ODdg8P+dk5papPi8jrciuBQDC9CBEziFLv2B7o4s+XmJOKYxY5ZmdctUjb2QCex614dLMWhh3A==',key_name='tempest-keypair-127012515',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:27:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7142101014c4defa7261a34fb9f28e4',ramdisk_id='',reservation_id='r-yizm06hu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1889877750',owner_user_name='tempest-TestVolumeBootPattern-1889877750-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:27:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe79455616584e0fb80e6007edf0b706',uuid=7ad61d3c-db7d-407f-b2ee-f2f9d9256ced,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02c80090-d3ca-47eb-882f-9f29edc28895", "address": "fa:16:3e:c3:46:2f", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c80090-d3", "ovs_interfaceid": "02c80090-d3ca-47eb-882f-9f29edc28895", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Converting VIF {"id": "02c80090-d3ca-47eb-882f-9f29edc28895", "address": "fa:16:3e:c3:46:2f", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c80090-d3", "ovs_interfaceid": "02c80090-d3ca-47eb-882f-9f29edc28895", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:46:2f,bridge_name='br-int',has_traffic_filtering=True,id=02c80090-d3ca-47eb-882f-9f29edc28895,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02c80090-d3') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG os_vif [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:46:2f,bridge_name='br-int',has_traffic_filtering=True,id=02c80090-d3ca-47eb-882f-9f29edc28895,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02c80090-d3') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02c80090-d3, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:31:45 user nova-compute[73078]: INFO os_vif [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:46:2f,bridge_name='br-int',has_traffic_filtering=True,id=02c80090-d3ca-47eb-882f-9f29edc28895,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02c80090-d3')
Aug 14 18:31:45 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kphFTRWa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:31:45 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:31:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17703c1-2c1b-4520-91f0-a23bf018d09e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d14358c-a43d-44bf-97d9-7a227fda6ef7]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:31:45 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:31:45 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:31:45 user nova-compute[73078]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d (non-flash)
Aug 14 18:31:45 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe97828eb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d'): ({'sdd'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Removing single pathed devices sdd {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd6889f-3cbb-485d-8702-3160ddd4b1ba]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4942f23-ab1b-41d4-96aa-247ef9b26c58]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Flushing IO for device /dev/sdd {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6903bbda-4b98-4957-9e92-c288ec5a0421]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[64294056-1160-45c2-ace4-c5c0fe4c319c]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] SCSI volumes sdd have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_3df80d94', '/dev/disk/by-id/scsi-1SCST_BIO3df80d94-b22fe490256b2cd0', '/dev/disk/by-id/scsi-26232326665343930') {{(pid=84732) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca362ae4-ca1d-4a11-8725-b6c0454d24a0]: (4, None) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[997e0814-9490-4fa2-b300-3215c2c9bac7]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9afd07-98e6-4f9b-9348-88178dc086d1]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d, portal: 172.16.0.220,3260]
Aug 14 18:31:45 user nova-compute[73078]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d, portal: 172.16.0.220,3260] successful.
Aug 14 18:31:45 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85d7066-f778-4709-8a4b-b6e865a56df3]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] <== disconnect_volume: return (288ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:31:45 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Deleting instance files /opt/stack/data/nova/instances/7ad61d3c-db7d-407f-b2ee-f2f9d9256ced_del
Aug 14 18:31:45 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Deletion of /opt/stack/data/nova/instances/7ad61d3c-db7d-407f-b2ee-f2f9d9256ced_del complete
Aug 14 18:31:45 user nova-compute[73078]: INFO nova.compute.manager [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Took 1.38 seconds to destroy the instance on the hypervisor.
Aug 14 18:31:45 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:31:45 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:31:46 user nova-compute[73078]: DEBUG nova.compute.manager [req-60aac450-6e2e-4706-a5c6-6ab1abcbec54 req-99ec3771-b986-4c83-9130-348f7483d8a0 service nova] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Received event network-vif-plugged-02c80090-d3ca-47eb-882f-9f29edc28895 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:31:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-60aac450-6e2e-4706-a5c6-6ab1abcbec54 req-99ec3771-b986-4c83-9130-348f7483d8a0 service nova] Acquiring lock "7ad61d3c-db7d-407f-b2ee-f2f9d9256ced-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:31:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-60aac450-6e2e-4706-a5c6-6ab1abcbec54 req-99ec3771-b986-4c83-9130-348f7483d8a0 service nova] Lock "7ad61d3c-db7d-407f-b2ee-f2f9d9256ced-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:31:46 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-60aac450-6e2e-4706-a5c6-6ab1abcbec54 req-99ec3771-b986-4c83-9130-348f7483d8a0 service nova] Lock "7ad61d3c-db7d-407f-b2ee-f2f9d9256ced-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:31:46 user nova-compute[73078]: DEBUG nova.compute.manager [req-60aac450-6e2e-4706-a5c6-6ab1abcbec54 req-99ec3771-b986-4c83-9130-348f7483d8a0 service nova] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] No waiting events found dispatching network-vif-plugged-02c80090-d3ca-47eb-882f-9f29edc28895 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:31:46 user nova-compute[73078]: WARNING nova.compute.manager [req-60aac450-6e2e-4706-a5c6-6ab1abcbec54 req-99ec3771-b986-4c83-9130-348f7483d8a0 service nova] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Received unexpected event network-vif-plugged-02c80090-d3ca-47eb-882f-9f29edc28895 for instance with vm_state active and task_state deleting.
Aug 14 18:31:46 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:31:46 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Took 1.08 seconds to deallocate network for instance.
Aug 14 18:31:47 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-14855650-9255-4444-9a30-123f928b8dbf tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Snapshot image upload complete
Aug 14 18:31:47 user nova-compute[73078]: INFO nova.compute.manager [None req-14855650-9255-4444-9a30-123f928b8dbf tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Took 4.98 seconds to snapshot the instance on the hypervisor.
Aug 14 18:31:47 user nova-compute[73078]: INFO nova.compute.manager [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Took 0.80 seconds to detach 1 volumes for instance.
Aug 14 18:31:47 user nova-compute[73078]: DEBUG nova.compute.manager [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Deleting volume: d7ea71c3-c447-4c35-8d92-bfcd84b3aa8d {{(pid=73078) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 18:31:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:31:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:31:48 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:31:48 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:31:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.255s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:31:48 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Deleted allocations for instance 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced
Aug 14 18:31:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-a1b71a4d-c1cb-432f-93bf-e4d3f485d76c tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "7ad61d3c-db7d-407f-b2ee-f2f9d9256ced" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.948s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:31:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:48 user nova-compute[73078]: DEBUG nova.compute.manager [req-30fe0531-0f90-40db-b2a7-8950732f98bc req-dd5a2fe2-f542-4cb5-8166-a7f1990bdeca service nova] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Received event network-vif-deleted-02c80090-d3ca-47eb-882f-9f29edc28895 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:31:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:53 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692037898.0280678, 5bf260cc-5c85-46e0-8326-7f23165065b7 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:31:53 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] VM Stopped (Lifecycle Event)
Aug 14 18:31:53 user nova-compute[73078]: DEBUG nova.compute.manager [None req-9a140cbb-edbb-4ec8-9ee8-34a81d665052 None None] [instance: 5bf260cc-5c85-46e0-8326-7f23165065b7] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:31:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:31:59 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:31:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:31:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:31:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:31:59 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:31:59 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:31:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:31:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:31:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:00 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692037905.2668865, 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:32:00 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] VM Stopped (Lifecycle Event)
Aug 14 18:32:00 user nova-compute[73078]: DEBUG nova.compute.manager [None req-980bf6f4-c41b-4963-9b57-f6b1bc84645f None None] [instance: 7ad61d3c-db7d-407f-b2ee-f2f9d9256ced] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:32:00 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:01 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:32:01 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:32:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=7966MB free_disk=24.856685638427734GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:32:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:32:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:32:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 61dfe42b-c943-4617-bf8e-745eaf1a1bb8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:32:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 3088da30-65b7-4801-b425-93df4fca6ad8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:32:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance ef083dd3-67d6-48a8-846a-7fe6c6b32d5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:32:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 2f960239-8deb-4d9f-9cab-eea0274aca38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:32:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance ebbaec07-9843-4cc0-bcb6-f993e62d88c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:32:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 16a18fae-165b-487b-bfd5-20097eac0a8e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:32:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:32:01 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:32:01 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Refreshing inventories for resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 18:32:01 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Updating ProviderTree inventory for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 18:32:01 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Updating inventory in ProviderTree for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 18:32:01 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Refreshing aggregate associations for resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b, aggregates: None {{(pid=73078) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 18:32:01 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Refreshing trait associations for resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV {{(pid=73078) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 18:32:02 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:32:02 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:32:02 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:32:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.540s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:32:02 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:32:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:32:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Rebuilding the list of instances to heal {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 18:32:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-61dfe42b-c943-4617-bf8e-745eaf1a1bb8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:32:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-61dfe42b-c943-4617-bf8e-745eaf1a1bb8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:32:02 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:32:02 user nova-compute[73078]: DEBUG nova.objects.instance [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lazy-loading 'info_cache' on Instance uuid 61dfe42b-c943-4617-bf8e-745eaf1a1bb8 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:32:02 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Updating instance_info_cache with network_info: [{"id": "d801cd85-be91-4f26-9750-c2ce847cb33c", "address": "fa:16:3e:87:55:89", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd801cd85-be", "ovs_interfaceid": "d801cd85-be91-4f26-9750-c2ce847cb33c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:32:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-61dfe42b-c943-4617-bf8e-745eaf1a1bb8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:32:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:32:02 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:32:02 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:32:02 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:32:02 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:32:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:32:02 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:32:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Cleaning up deleted instances {{(pid=73078) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 18:32:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] There are 0 instances to clean {{(pid=73078) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 18:32:03 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:32:05 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:32:05 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:32:05 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:32:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "8bb1bc98-12ee-4a5b-91db-6e66966c482f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:32:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "8bb1bc98-12ee-4a5b-91db-6e66966c482f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:32:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:32:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:32:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:32:12 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:32:12 user nova-compute[73078]: INFO nova.compute.claims [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Claim successful on node user
Aug 14 18:32:12 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:32:12 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:32:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:32:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:32:13 user nova-compute[73078]: DEBUG nova.compute.manager [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:32:13 user nova-compute[73078]: DEBUG nova.network.neutron [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:32:13 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:32:13 user nova-compute[73078]: DEBUG nova.compute.manager [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:32:13 user nova-compute[73078]: DEBUG nova.compute.manager [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:32:13 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:32:13 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Creating image(s)
Aug 14 18:32:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "/opt/stack/data/nova/instances/8bb1bc98-12ee-4a5b-91db-6e66966c482f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:32:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "/opt/stack/data/nova/instances/8bb1bc98-12ee-4a5b-91db-6e66966c482f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:32:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "/opt/stack/data/nova/instances/8bb1bc98-12ee-4a5b-91db-6e66966c482f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:32:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:13 user nova-compute[73078]: DEBUG nova.policy [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a3c5d292e9594e4aadad9ac72b9455ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1391a0a2167745348384e5890e6c22db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:32:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.173s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:32:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:32:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.175s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/8bb1bc98-12ee-4a5b-91db-6e66966c482f/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/8bb1bc98-12ee-4a5b-91db-6e66966c482f/disk 1073741824" returned: 0 in 0.048s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:32:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.169s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:13 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8bb1bc98-12ee-4a5b-91db-6e66966c482f/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:32:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bb1bc98-12ee-4a5b-91db-6e66966c482f/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bb1bc98-12ee-4a5b-91db-6e66966c482f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:13 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Cannot resize image /opt/stack/data/nova/instances/8bb1bc98-12ee-4a5b-91db-6e66966c482f/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:32:13 user nova-compute[73078]: DEBUG nova.objects.instance [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lazy-loading 'migration_context' on Instance uuid 8bb1bc98-12ee-4a5b-91db-6e66966c482f {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:32:13 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:32:13 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Ensure instance console log exists: /opt/stack/data/nova/instances/8bb1bc98-12ee-4a5b-91db-6e66966c482f/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:32:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:32:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:32:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:32:14 user nova-compute[73078]: DEBUG nova.network.neutron [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Successfully created port: 3e131470-acea-41bf-80c0-e2d7eaa98d3f {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:32:14 user nova-compute[73078]: DEBUG nova.network.neutron [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Successfully updated port: 3e131470-acea-41bf-80c0-e2d7eaa98d3f {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:32:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "refresh_cache-8bb1bc98-12ee-4a5b-91db-6e66966c482f" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:32:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquired lock "refresh_cache-8bb1bc98-12ee-4a5b-91db-6e66966c482f" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:32:14 user nova-compute[73078]: DEBUG nova.network.neutron [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:32:14 user nova-compute[73078]: DEBUG nova.compute.manager [req-70a0ca1f-1504-4c4b-9788-d039472141d5 req-d22555e4-80ea-4be5-b0d2-9a87ea58e90f service nova] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Received event network-changed-3e131470-acea-41bf-80c0-e2d7eaa98d3f {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:32:14 user nova-compute[73078]: DEBUG nova.compute.manager [req-70a0ca1f-1504-4c4b-9788-d039472141d5 req-d22555e4-80ea-4be5-b0d2-9a87ea58e90f service nova] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Refreshing instance network info cache due to event network-changed-3e131470-acea-41bf-80c0-e2d7eaa98d3f. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:32:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-70a0ca1f-1504-4c4b-9788-d039472141d5 req-d22555e4-80ea-4be5-b0d2-9a87ea58e90f service nova] Acquiring lock "refresh_cache-8bb1bc98-12ee-4a5b-91db-6e66966c482f" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:32:14 user nova-compute[73078]: DEBUG nova.network.neutron [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG nova.network.neutron [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Updating instance_info_cache with network_info: [{"id": "3e131470-acea-41bf-80c0-e2d7eaa98d3f", "address": "fa:16:3e:ff:7b:5b", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e131470-ac", "ovs_interfaceid": "3e131470-acea-41bf-80c0-e2d7eaa98d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Releasing lock "refresh_cache-8bb1bc98-12ee-4a5b-91db-6e66966c482f" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG nova.compute.manager [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Instance network_info: |[{"id": "3e131470-acea-41bf-80c0-e2d7eaa98d3f", "address": "fa:16:3e:ff:7b:5b", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e131470-ac", "ovs_interfaceid": "3e131470-acea-41bf-80c0-e2d7eaa98d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-70a0ca1f-1504-4c4b-9788-d039472141d5 req-d22555e4-80ea-4be5-b0d2-9a87ea58e90f service nova] Acquired lock "refresh_cache-8bb1bc98-12ee-4a5b-91db-6e66966c482f" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG nova.network.neutron [req-70a0ca1f-1504-4c4b-9788-d039472141d5 req-d22555e4-80ea-4be5-b0d2-9a87ea58e90f service nova] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Refreshing network info cache for port 3e131470-acea-41bf-80c0-e2d7eaa98d3f {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Start _get_guest_xml network_info=[{"id": "3e131470-acea-41bf-80c0-e2d7eaa98d3f", "address": "fa:16:3e:ff:7b:5b", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e131470-ac", "ovs_interfaceid": "3e131470-acea-41bf-80c0-e2d7eaa98d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:32:15 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:32:15 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:32:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:32:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1139913388',display_name='tempest-AttachVolumeNegativeTest-server-1139913388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1139913388',id=42,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTMoJCZGF58jKxpRGF+kp0D97klpJSBKJfXyPnDrxYBmnwq88FtqtQ8SHwLQpKr9zuiXwznl6cI2QI57BvwtzhpHqthF0elkaD2ABLL6tSaVQsc1HN63fgO689Srrpfvg==',key_name='tempest-keypair-1942474748',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1391a0a2167745348384e5890e6c22db',ramdisk_id='',reservation_id='r-kzvvbom1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1671295372',owner_user_name='tempest-AttachVolumeNegativeTest-1671295372-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:32:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3c5d292e9594e4aadad9ac72b9455ed',uuid=8bb1bc98-12ee-4a5b-91db-6e66966c482f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e131470-acea-41bf-80c0-e2d7eaa98d3f", "address": "fa:16:3e:ff:7b:5b", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e131470-ac", "ovs_interfaceid": "3e131470-acea-41bf-80c0-e2d7eaa98d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Converting VIF {"id": "3e131470-acea-41bf-80c0-e2d7eaa98d3f", "address": "fa:16:3e:ff:7b:5b", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e131470-ac", "ovs_interfaceid": "3e131470-acea-41bf-80c0-e2d7eaa98d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:7b:5b,bridge_name='br-int',has_traffic_filtering=True,id=3e131470-acea-41bf-80c0-e2d7eaa98d3f,network=Network(88e922e4-ec89-460a-954d-aff20a41293c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e131470-ac') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG nova.objects.instance [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lazy-loading 'pci_devices' on Instance uuid 8bb1bc98-12ee-4a5b-91db-6e66966c482f {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:32:15 user nova-compute[73078]:   <uuid>8bb1bc98-12ee-4a5b-91db-6e66966c482f</uuid>
Aug 14 18:32:15 user nova-compute[73078]:   <name>instance-0000002a</name>
Aug 14 18:32:15 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:32:15 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:32:15 user nova-compute[73078]:   <metadata>
Aug 14 18:32:15 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:32:15 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:32:15 user nova-compute[73078]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1139913388</nova:name>
Aug 14 18:32:15 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:32:15</nova:creationTime>
Aug 14 18:32:15 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:32:15 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:32:15 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:32:15 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:32:15 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:32:15 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:32:15 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:32:15 user nova-compute[73078]:       <nova:owner>
Aug 14 18:32:15 user nova-compute[73078]:         <nova:user uuid="a3c5d292e9594e4aadad9ac72b9455ed">tempest-AttachVolumeNegativeTest-1671295372-project-member</nova:user>
Aug 14 18:32:15 user nova-compute[73078]:         <nova:project uuid="1391a0a2167745348384e5890e6c22db">tempest-AttachVolumeNegativeTest-1671295372</nova:project>
Aug 14 18:32:15 user nova-compute[73078]:       </nova:owner>
Aug 14 18:32:15 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:32:15 user nova-compute[73078]:       <nova:ports>
Aug 14 18:32:15 user nova-compute[73078]:         <nova:port uuid="3e131470-acea-41bf-80c0-e2d7eaa98d3f">
Aug 14 18:32:15 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 18:32:15 user nova-compute[73078]:         </nova:port>
Aug 14 18:32:15 user nova-compute[73078]:       </nova:ports>
Aug 14 18:32:15 user nova-compute[73078]:     </nova:instance>
Aug 14 18:32:15 user nova-compute[73078]:   </metadata>
Aug 14 18:32:15 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:32:15 user nova-compute[73078]:     <system>
Aug 14 18:32:15 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:32:15 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:32:15 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:32:15 user nova-compute[73078]:       <entry name="serial">8bb1bc98-12ee-4a5b-91db-6e66966c482f</entry>
Aug 14 18:32:15 user nova-compute[73078]:       <entry name="uuid">8bb1bc98-12ee-4a5b-91db-6e66966c482f</entry>
Aug 14 18:32:15 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:32:15 user nova-compute[73078]:     </system>
Aug 14 18:32:15 user nova-compute[73078]:   </sysinfo>
Aug 14 18:32:15 user nova-compute[73078]:   <os>
Aug 14 18:32:15 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:32:15 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:32:15 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:32:15 user nova-compute[73078]:   </os>
Aug 14 18:32:15 user nova-compute[73078]:   <features>
Aug 14 18:32:15 user nova-compute[73078]:     <acpi/>
Aug 14 18:32:15 user nova-compute[73078]:     <apic/>
Aug 14 18:32:15 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:32:15 user nova-compute[73078]:   </features>
Aug 14 18:32:15 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:32:15 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:32:15 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:32:15 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:32:15 user nova-compute[73078]:   </clock>
Aug 14 18:32:15 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:32:15 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:32:15 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:32:15 user nova-compute[73078]:   </cpu>
Aug 14 18:32:15 user nova-compute[73078]:   <devices>
Aug 14 18:32:15 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:32:15 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:32:15 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/8bb1bc98-12ee-4a5b-91db-6e66966c482f/disk"/>
Aug 14 18:32:15 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:32:15 user nova-compute[73078]:     </disk>
Aug 14 18:32:15 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:32:15 user nova-compute[73078]:       <mac address="fa:16:3e:ff:7b:5b"/>
Aug 14 18:32:15 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:32:15 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:32:15 user nova-compute[73078]:       <target dev="tap3e131470-ac"/>
Aug 14 18:32:15 user nova-compute[73078]:     </interface>
Aug 14 18:32:15 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:32:15 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/8bb1bc98-12ee-4a5b-91db-6e66966c482f/console.log" append="off"/>
Aug 14 18:32:15 user nova-compute[73078]:     </serial>
Aug 14 18:32:15 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:32:15 user nova-compute[73078]:     <video>
Aug 14 18:32:15 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:32:15 user nova-compute[73078]:     </video>
Aug 14 18:32:15 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:32:15 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:32:15 user nova-compute[73078]:     </rng>
Aug 14 18:32:15 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:32:15 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:32:15 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:32:15 user nova-compute[73078]:     </memballoon>
Aug 14 18:32:15 user nova-compute[73078]:   </devices>
Aug 14 18:32:15 user nova-compute[73078]: </domain>
Aug 14 18:32:15 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:32:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1139913388',display_name='tempest-AttachVolumeNegativeTest-server-1139913388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1139913388',id=42,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTMoJCZGF58jKxpRGF+kp0D97klpJSBKJfXyPnDrxYBmnwq88FtqtQ8SHwLQpKr9zuiXwznl6cI2QI57BvwtzhpHqthF0elkaD2ABLL6tSaVQsc1HN63fgO689Srrpfvg==',key_name='tempest-keypair-1942474748',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1391a0a2167745348384e5890e6c22db',ramdisk_id='',reservation_id='r-kzvvbom1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1671295372',owner_user_name='tempest-AttachVolumeNegativeTest-1671295372-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:32:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3c5d292e9594e4aadad9ac72b9455ed',uuid=8bb1bc98-12ee-4a5b-91db-6e66966c482f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e131470-acea-41bf-80c0-e2d7eaa98d3f", "address": "fa:16:3e:ff:7b:5b", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e131470-ac", "ovs_interfaceid": "3e131470-acea-41bf-80c0-e2d7eaa98d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Converting VIF {"id": "3e131470-acea-41bf-80c0-e2d7eaa98d3f", "address": "fa:16:3e:ff:7b:5b", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e131470-ac", "ovs_interfaceid": "3e131470-acea-41bf-80c0-e2d7eaa98d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:7b:5b,bridge_name='br-int',has_traffic_filtering=True,id=3e131470-acea-41bf-80c0-e2d7eaa98d3f,network=Network(88e922e4-ec89-460a-954d-aff20a41293c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e131470-ac') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG os_vif [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:7b:5b,bridge_name='br-int',has_traffic_filtering=True,id=3e131470-acea-41bf-80c0-e2d7eaa98d3f,network=Network(88e922e4-ec89-460a-954d-aff20a41293c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e131470-ac') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e131470-ac, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3e131470-ac, col_values=(('external_ids', {'iface-id': '3e131470-acea-41bf-80c0-e2d7eaa98d3f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:7b:5b', 'vm-uuid': '8bb1bc98-12ee-4a5b-91db-6e66966c482f'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:15 user nova-compute[73078]: INFO os_vif [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:7b:5b,bridge_name='br-int',has_traffic_filtering=True,id=3e131470-acea-41bf-80c0-e2d7eaa98d3f,network=Network(88e922e4-ec89-460a-954d-aff20a41293c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e131470-ac')
Aug 14 18:32:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] No VIF found with MAC fa:16:3e:ff:7b:5b, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG nova.network.neutron [req-70a0ca1f-1504-4c4b-9788-d039472141d5 req-d22555e4-80ea-4be5-b0d2-9a87ea58e90f service nova] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Updated VIF entry in instance network info cache for port 3e131470-acea-41bf-80c0-e2d7eaa98d3f. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG nova.network.neutron [req-70a0ca1f-1504-4c4b-9788-d039472141d5 req-d22555e4-80ea-4be5-b0d2-9a87ea58e90f service nova] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Updating instance_info_cache with network_info: [{"id": "3e131470-acea-41bf-80c0-e2d7eaa98d3f", "address": "fa:16:3e:ff:7b:5b", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e131470-ac", "ovs_interfaceid": "3e131470-acea-41bf-80c0-e2d7eaa98d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:32:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-70a0ca1f-1504-4c4b-9788-d039472141d5 req-d22555e4-80ea-4be5-b0d2-9a87ea58e90f service nova] Releasing lock "refresh_cache-8bb1bc98-12ee-4a5b-91db-6e66966c482f" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:32:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:16 user nova-compute[73078]: DEBUG nova.compute.manager [req-c1fc57a8-caaa-4453-8a85-fb9a80ca22b0 req-343ca05e-f1a8-46a7-b232-200868523e85 service nova] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Received event network-vif-plugged-3e131470-acea-41bf-80c0-e2d7eaa98d3f {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:32:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-c1fc57a8-caaa-4453-8a85-fb9a80ca22b0 req-343ca05e-f1a8-46a7-b232-200868523e85 service nova] Acquiring lock "8bb1bc98-12ee-4a5b-91db-6e66966c482f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:32:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-c1fc57a8-caaa-4453-8a85-fb9a80ca22b0 req-343ca05e-f1a8-46a7-b232-200868523e85 service nova] Lock "8bb1bc98-12ee-4a5b-91db-6e66966c482f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:32:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-c1fc57a8-caaa-4453-8a85-fb9a80ca22b0 req-343ca05e-f1a8-46a7-b232-200868523e85 service nova] Lock "8bb1bc98-12ee-4a5b-91db-6e66966c482f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:32:16 user nova-compute[73078]: DEBUG nova.compute.manager [req-c1fc57a8-caaa-4453-8a85-fb9a80ca22b0 req-343ca05e-f1a8-46a7-b232-200868523e85 service nova] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] No waiting events found dispatching network-vif-plugged-3e131470-acea-41bf-80c0-e2d7eaa98d3f {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:32:16 user nova-compute[73078]: WARNING nova.compute.manager [req-c1fc57a8-caaa-4453-8a85-fb9a80ca22b0 req-343ca05e-f1a8-46a7-b232-200868523e85 service nova] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Received unexpected event network-vif-plugged-3e131470-acea-41bf-80c0-e2d7eaa98d3f for instance with vm_state building and task_state spawning.
Aug 14 18:32:17 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:32:17 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73078) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 18:32:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:18 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037938.8195956, 8bb1bc98-12ee-4a5b-91db-6e66966c482f => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:32:18 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] VM Resumed (Lifecycle Event)
Aug 14 18:32:18 user nova-compute[73078]: DEBUG nova.compute.manager [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:32:18 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:32:18 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Instance spawned successfully.
Aug 14 18:32:18 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:32:18 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:32:18 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:32:18 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:32:18 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:32:18 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:32:18 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:32:18 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:32:18 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:32:18 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:32:18 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037938.8219118, 8bb1bc98-12ee-4a5b-91db-6e66966c482f => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:32:18 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] VM Started (Lifecycle Event)
Aug 14 18:32:18 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:32:18 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:32:18 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:32:18 user nova-compute[73078]: INFO nova.compute.manager [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Took 5.77 seconds to spawn the instance on the hypervisor.
Aug 14 18:32:18 user nova-compute[73078]: DEBUG nova.compute.manager [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:32:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Acquiring lock "2f960239-8deb-4d9f-9cab-eea0274aca38" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:32:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:32:19 user nova-compute[73078]: DEBUG nova.objects.instance [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lazy-loading 'flavor' on Instance uuid 2f960239-8deb-4d9f-9cab-eea0274aca38 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:32:19 user nova-compute[73078]: INFO nova.compute.manager [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Took 6.39 seconds to build instance.
Aug 14 18:32:19 user nova-compute[73078]: DEBUG nova.compute.manager [req-70077535-b33f-4580-875f-2e99d84b6125 req-8688da9c-9c77-4171-b830-865f0ff55bf9 service nova] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Received event network-vif-plugged-3e131470-acea-41bf-80c0-e2d7eaa98d3f {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:32:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-70077535-b33f-4580-875f-2e99d84b6125 req-8688da9c-9c77-4171-b830-865f0ff55bf9 service nova] Acquiring lock "8bb1bc98-12ee-4a5b-91db-6e66966c482f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:32:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-70077535-b33f-4580-875f-2e99d84b6125 req-8688da9c-9c77-4171-b830-865f0ff55bf9 service nova] Lock "8bb1bc98-12ee-4a5b-91db-6e66966c482f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:32:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-70077535-b33f-4580-875f-2e99d84b6125 req-8688da9c-9c77-4171-b830-865f0ff55bf9 service nova] Lock "8bb1bc98-12ee-4a5b-91db-6e66966c482f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:32:19 user nova-compute[73078]: DEBUG nova.compute.manager [req-70077535-b33f-4580-875f-2e99d84b6125 req-8688da9c-9c77-4171-b830-865f0ff55bf9 service nova] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] No waiting events found dispatching network-vif-plugged-3e131470-acea-41bf-80c0-e2d7eaa98d3f {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:32:19 user nova-compute[73078]: WARNING nova.compute.manager [req-70077535-b33f-4580-875f-2e99d84b6125 req-8688da9c-9c77-4171-b830-865f0ff55bf9 service nova] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Received unexpected event network-vif-plugged-3e131470-acea-41bf-80c0-e2d7eaa98d3f for instance with vm_state active and task_state None.
Aug 14 18:32:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-6e8cf642-1bb9-4030-9db1-bea9385f5f2d tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "8bb1bc98-12ee-4a5b-91db-6e66966c482f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.492s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:32:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:32:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Acquiring lock "2f960239-8deb-4d9f-9cab-eea0274aca38" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:32:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:32:19 user nova-compute[73078]: INFO nova.compute.manager [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Attaching volume a5133c5b-9786-4f8a-905b-f2da0ccc66bf to /dev/vdb
Aug 14 18:32:19 user nova-compute[73078]: DEBUG os_brick.utils [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:32:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:19 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[833c2543-b61f-4d26-84eb-7dbfb9a32fd7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:19 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[98244710-991a-404a-b781-2e66f8e903af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:19 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c903302-636a-4c1f-8ffe-602e332a675d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:19 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e5b249-b1bb-41be-a50e-e44ff44e2911]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:32:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:32:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:32:19 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:32:19 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f54052-0ac1-4172-a9cf-2f3880df937b]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:32:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:32:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:32:19 user nova-compute[73078]: DEBUG os_brick.utils [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:32:19 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Updating existing volume attachment record: 89531a37-5bad-4f66-bceb-1f1306b4a522 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:32:20 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:25 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:27 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:32:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ivEZkFLc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:32:27 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:32:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:32:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:32:27 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:32:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:32:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:32:27 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:32:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:27 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd8cbe4-4b85-44b7-a0c3-7a75732fc991]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:32:27 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:32:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:27 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74260e5-2cbf-4456-aa80-01b5913e0025]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf] added
Aug 14 18:32:27 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:32:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:27 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e772d2db-b75a-4489-bc54-18f134da47d3]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:27 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:32:27 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6810fa77-26c7-46c6-8813-67f437996251]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ivEZkFLc {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ivEZkFLc" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[550afe9f-1f33-4473-b472-0933d594d898]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ivEZkFLc'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[48104597-f400-4e53-96ce-c2b90ad33b3f]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ae6562-7856-4ae2-9cf9-81a9d8c667c5]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:32:28 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:32:28 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa29ed3a-2e21-425b-85db-40101a3c2712]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf, portal: 172.16.0.220,3260]
Aug 14 18:32:28 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf, portal: 172.16.0.220,3260] successful.
Aug 14 18:32:28 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[13beb911-e953-4c7b-b5aa-704210a88214]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b999b4e7-cb8d-4542-a7e7-91592ca24a1d]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:32:28 user nova-compute[73078]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf (non-flash)
Aug 14 18:32:28 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:32:28 user nova-compute[73078]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf (non-flash)
Aug 14 18:32:28 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6fe8ca-5d36-49b1-b817-aa9292136580]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:32:28 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ivEZkFLc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:32:29 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:32:29 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26565366330366435', 'path': '/dev/sdc'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:32:29 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565366330366435', 'path': '/dev/sdc'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:32:29 user nova-compute[73078]: DEBUG nova.objects.instance [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lazy-loading 'flavor' on Instance uuid 2f960239-8deb-4d9f-9cab-eea0274aca38 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:32:29 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 18:32:29 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:32:29 user nova-compute[73078]:   <source dev="/dev/sdc"/>
Aug 14 18:32:29 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:32:29 user nova-compute[73078]:   <serial>a5133c5b-9786-4f8a-905b-f2da0ccc66bf</serial>
Aug 14 18:32:29 user nova-compute[73078]: </disk>
Aug 14 18:32:29 user nova-compute[73078]:  {{(pid=73078) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 18:32:29 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:32:29 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:32:29 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] No VIF found with MAC fa:16:3e:38:ed:9c, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:32:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-39e766a8-227b-490d-85fc-3b6de2e4f651 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.593s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:32:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:32:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-bfb8c22f-56e6-4c98-8b67-0c63388bf3bc tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Acquiring lock "2f960239-8deb-4d9f-9cab-eea0274aca38" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:32:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-bfb8c22f-56e6-4c98-8b67-0c63388bf3bc tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:32:31 user nova-compute[73078]: INFO nova.compute.manager [None req-bfb8c22f-56e6-4c98-8b67-0c63388bf3bc tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Detaching volume a5133c5b-9786-4f8a-905b-f2da0ccc66bf
Aug 14 18:32:31 user nova-compute[73078]: INFO nova.virt.block_device [None req-bfb8c22f-56e6-4c98-8b67-0c63388bf3bc tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Attempting to driver detach volume a5133c5b-9786-4f8a-905b-f2da0ccc66bf from mountpoint /dev/vdb
Aug 14 18:32:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-bfb8c22f-56e6-4c98-8b67-0c63388bf3bc tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Attempting to detach device vdb from instance 2f960239-8deb-4d9f-9cab-eea0274aca38 from the persistent domain config. {{(pid=73078) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 18:32:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-bfb8c22f-56e6-4c98-8b67-0c63388bf3bc tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:32:31 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:32:31 user nova-compute[73078]:   <source dev="/dev/sdc"/>
Aug 14 18:32:31 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:32:31 user nova-compute[73078]:   <serial>a5133c5b-9786-4f8a-905b-f2da0ccc66bf</serial>
Aug 14 18:32:31 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:32:31 user nova-compute[73078]: </disk>
Aug 14 18:32:31 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:32:31 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-bfb8c22f-56e6-4c98-8b67-0c63388bf3bc tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Successfully detached device vdb from instance 2f960239-8deb-4d9f-9cab-eea0274aca38 from the persistent domain config.
Aug 14 18:32:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-bfb8c22f-56e6-4c98-8b67-0c63388bf3bc tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2f960239-8deb-4d9f-9cab-eea0274aca38 from the live domain config. {{(pid=73078) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 18:32:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-bfb8c22f-56e6-4c98-8b67-0c63388bf3bc tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:32:31 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:32:31 user nova-compute[73078]:   <source dev="/dev/sdc"/>
Aug 14 18:32:31 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:32:31 user nova-compute[73078]:   <serial>a5133c5b-9786-4f8a-905b-f2da0ccc66bf</serial>
Aug 14 18:32:31 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:32:31 user nova-compute[73078]: </disk>
Aug 14 18:32:31 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:32:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Received event <DeviceRemovedEvent: 1692037951.9950595, 2f960239-8deb-4d9f-9cab-eea0274aca38 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73078) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-bfb8c22f-56e6-4c98-8b67-0c63388bf3bc tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2f960239-8deb-4d9f-9cab-eea0274aca38 {{(pid=73078) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 18:32:32 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-bfb8c22f-56e6-4c98-8b67-0c63388bf3bc tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Successfully detached device vdb from instance 2f960239-8deb-4d9f-9cab-eea0274aca38 from the live domain config.
Aug 14 18:32:32 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfb8c22f-56e6-4c98-8b67-0c63388bf3bc tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb8c22f-56e6-4c98-8b67-0c63388bf3bc tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ivEZkFLc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:32:32 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-bfb8c22f-56e6-4c98-8b67-0c63388bf3bc tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:32:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-bfb8c22f-56e6-4c98-8b67-0c63388bf3bc tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-bfb8c22f-56e6-4c98-8b67-0c63388bf3bc tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb8c22f-56e6-4c98-8b67-0c63388bf3bc tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5d057a-75d1-4359-9cf4-9418a1829a88]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a663473-e1d4-4ed1-ac61-022e97af8a56]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb8c22f-56e6-4c98-8b67-0c63388bf3bc tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:32:32 user nova-compute[73078]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf (non-flash)
Aug 14 18:32:32 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb8c22f-56e6-4c98-8b67-0c63388bf3bc tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:32:32 user nova-compute[73078]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf (non-flash)
Aug 14 18:32:32 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb8c22f-56e6-4c98-8b67-0c63388bf3bc tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe978258e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf'): ({'sdc'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-bfb8c22f-56e6-4c98-8b67-0c63388bf3bc tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Removing single pathed devices sdc {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7e9029-1353-4f36-8153-405cfd8a885a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c530eaf3-5884-4caf-8cff-3610a9d12a31]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-bfb8c22f-56e6-4c98-8b67-0c63388bf3bc tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Flushing IO for device /dev/sdc {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d19f41-1f3f-44ff-b5ce-e6f188d736a8]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-bfb8c22f-56e6-4c98-8b67-0c63388bf3bc tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec31b00e-2988-40cb-9545-18ceec34f527]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-bfb8c22f-56e6-4c98-8b67-0c63388bf3bc tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-bfb8c22f-56e6-4c98-8b67-0c63388bf3bc tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] SCSI volumes sdc have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb8c22f-56e6-4c98-8b67-0c63388bf3bc tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba27e5d-79c3-4403-ae98-6773a9347d89]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb8c22f-56e6-4c98-8b67-0c63388bf3bc tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e131c8e-7522-4457-8f8f-6ebf0804a86f]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb8c22f-56e6-4c98-8b67-0c63388bf3bc tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf, portal: 172.16.0.220,3260]
Aug 14 18:32:32 user nova-compute[73078]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf, portal: 172.16.0.220,3260] successful.
Aug 14 18:32:32 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5133c5b-9786-4f8a-905b-f2da0ccc66bf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a4ce3f-f28e-4e65-930a-29a96ec2e4a4]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb8c22f-56e6-4c98-8b67-0c63388bf3bc tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-bfb8c22f-56e6-4c98-8b67-0c63388bf3bc tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb8c22f-56e6-4c98-8b67-0c63388bf3bc tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] <== disconnect_volume: return (288ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:32:32 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfb8c22f-56e6-4c98-8b67-0c63388bf3bc tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:32:33 user nova-compute[73078]: DEBUG nova.objects.instance [None req-bfb8c22f-56e6-4c98-8b67-0c63388bf3bc tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lazy-loading 'flavor' on Instance uuid 2f960239-8deb-4d9f-9cab-eea0274aca38 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:32:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-bfb8c22f-56e6-4c98-8b67-0c63388bf3bc tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.648s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:32:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:35 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:40 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:40 user nova-compute[73078]: DEBUG nova.compute.manager [req-953f5323-6870-46c8-b8b3-49c4a650ac4d req-d09f0a7f-36bc-40e4-ac45-3aea9cbf90be service nova] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Received event network-changed-396a7d1c-7aec-4324-8722-adc2dc77db86 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:32:40 user nova-compute[73078]: DEBUG nova.compute.manager [req-953f5323-6870-46c8-b8b3-49c4a650ac4d req-d09f0a7f-36bc-40e4-ac45-3aea9cbf90be service nova] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Refreshing instance network info cache due to event network-changed-396a7d1c-7aec-4324-8722-adc2dc77db86. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:32:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-953f5323-6870-46c8-b8b3-49c4a650ac4d req-d09f0a7f-36bc-40e4-ac45-3aea9cbf90be service nova] Acquiring lock "refresh_cache-ef083dd3-67d6-48a8-846a-7fe6c6b32d5c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:32:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-953f5323-6870-46c8-b8b3-49c4a650ac4d req-d09f0a7f-36bc-40e4-ac45-3aea9cbf90be service nova] Acquired lock "refresh_cache-ef083dd3-67d6-48a8-846a-7fe6c6b32d5c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:32:40 user nova-compute[73078]: DEBUG nova.network.neutron [req-953f5323-6870-46c8-b8b3-49c4a650ac4d req-d09f0a7f-36bc-40e4-ac45-3aea9cbf90be service nova] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Refreshing network info cache for port 396a7d1c-7aec-4324-8722-adc2dc77db86 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:32:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8b42fb30-f66a-44d0-988e-7111d0d6005b tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Acquiring lock "ef083dd3-67d6-48a8-846a-7fe6c6b32d5c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:32:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8b42fb30-f66a-44d0-988e-7111d0d6005b tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "ef083dd3-67d6-48a8-846a-7fe6c6b32d5c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:32:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8b42fb30-f66a-44d0-988e-7111d0d6005b tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Acquiring lock "ef083dd3-67d6-48a8-846a-7fe6c6b32d5c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:32:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8b42fb30-f66a-44d0-988e-7111d0d6005b tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "ef083dd3-67d6-48a8-846a-7fe6c6b32d5c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:32:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8b42fb30-f66a-44d0-988e-7111d0d6005b tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "ef083dd3-67d6-48a8-846a-7fe6c6b32d5c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:32:40 user nova-compute[73078]: INFO nova.compute.manager [None req-8b42fb30-f66a-44d0-988e-7111d0d6005b tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Terminating instance
Aug 14 18:32:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-8b42fb30-f66a-44d0-988e-7111d0d6005b tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:32:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:41 user nova-compute[73078]: DEBUG nova.compute.manager [req-ff571ff2-07b9-4f65-be1b-f1d88459239a req-4bab13d5-3149-48ee-ba7f-9fb1e32890d7 service nova] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Received event network-vif-unplugged-396a7d1c-7aec-4324-8722-adc2dc77db86 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:32:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ff571ff2-07b9-4f65-be1b-f1d88459239a req-4bab13d5-3149-48ee-ba7f-9fb1e32890d7 service nova] Acquiring lock "ef083dd3-67d6-48a8-846a-7fe6c6b32d5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:32:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ff571ff2-07b9-4f65-be1b-f1d88459239a req-4bab13d5-3149-48ee-ba7f-9fb1e32890d7 service nova] Lock "ef083dd3-67d6-48a8-846a-7fe6c6b32d5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:32:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ff571ff2-07b9-4f65-be1b-f1d88459239a req-4bab13d5-3149-48ee-ba7f-9fb1e32890d7 service nova] Lock "ef083dd3-67d6-48a8-846a-7fe6c6b32d5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:32:41 user nova-compute[73078]: DEBUG nova.compute.manager [req-ff571ff2-07b9-4f65-be1b-f1d88459239a req-4bab13d5-3149-48ee-ba7f-9fb1e32890d7 service nova] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] No waiting events found dispatching network-vif-unplugged-396a7d1c-7aec-4324-8722-adc2dc77db86 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:32:41 user nova-compute[73078]: DEBUG nova.compute.manager [req-ff571ff2-07b9-4f65-be1b-f1d88459239a req-4bab13d5-3149-48ee-ba7f-9fb1e32890d7 service nova] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Received event network-vif-unplugged-396a7d1c-7aec-4324-8722-adc2dc77db86 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:32:41 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Instance destroyed successfully.
Aug 14 18:32:41 user nova-compute[73078]: DEBUG nova.objects.instance [None req-8b42fb30-f66a-44d0-988e-7111d0d6005b tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lazy-loading 'resources' on Instance uuid ef083dd3-67d6-48a8-846a-7fe6c6b32d5c {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:32:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-8b42fb30-f66a-44d0-988e-7111d0d6005b tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:25:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-243322462',display_name='tempest-TestStampPattern-server-243322462',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-243322462',id=33,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCcJMv1AV17ylcLliWNA6MPLR+aDJkzXeqhllF0bf2imCcrbw2X6UlhzsHI25lDDbRh7U/jFMtBw5eymdUYDpVK4u5ZUqAplS3uUj5rbwGNZVg+pHSh9eSszqkvnE3m/A==',key_name='tempest-TestStampPattern-762241101',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:25:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ce3bd6c6a784ee3a395c368d667c1b3',ramdisk_id='',reservation_id='r-xvq7nd6n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-11663352',owner_user_name='tempest-TestStampPattern-11663352-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:28:39Z,user_data=None,user_id='08f7cf7e532f46c8942157b99f9ccd77',uuid=ef083dd3-67d6-48a8-846a-7fe6c6b32d5c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "396a7d1c-7aec-4324-8722-adc2dc77db86", "address": "fa:16:3e:17:fe:f7", "network": {"id": "21c76d99-2d0a-42b9-b7a0-b068f0cb938f", "bridge": "br-int", "label": "tempest-TestStampPattern-1682035048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce3bd6c6a784ee3a395c368d667c1b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap396a7d1c-7a", "ovs_interfaceid": "396a7d1c-7aec-4324-8722-adc2dc77db86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:32:41 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-8b42fb30-f66a-44d0-988e-7111d0d6005b tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Converting VIF {"id": "396a7d1c-7aec-4324-8722-adc2dc77db86", "address": "fa:16:3e:17:fe:f7", "network": {"id": "21c76d99-2d0a-42b9-b7a0-b068f0cb938f", "bridge": "br-int", "label": "tempest-TestStampPattern-1682035048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce3bd6c6a784ee3a395c368d667c1b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap396a7d1c-7a", "ovs_interfaceid": "396a7d1c-7aec-4324-8722-adc2dc77db86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:32:41 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-8b42fb30-f66a-44d0-988e-7111d0d6005b tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:fe:f7,bridge_name='br-int',has_traffic_filtering=True,id=396a7d1c-7aec-4324-8722-adc2dc77db86,network=Network(21c76d99-2d0a-42b9-b7a0-b068f0cb938f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap396a7d1c-7a') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:32:41 user nova-compute[73078]: DEBUG os_vif [None req-8b42fb30-f66a-44d0-988e-7111d0d6005b tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:fe:f7,bridge_name='br-int',has_traffic_filtering=True,id=396a7d1c-7aec-4324-8722-adc2dc77db86,network=Network(21c76d99-2d0a-42b9-b7a0-b068f0cb938f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap396a7d1c-7a') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:32:41 user nova-compute[73078]: DEBUG nova.network.neutron [req-953f5323-6870-46c8-b8b3-49c4a650ac4d req-d09f0a7f-36bc-40e4-ac45-3aea9cbf90be service nova] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Updated VIF entry in instance network info cache for port 396a7d1c-7aec-4324-8722-adc2dc77db86. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:32:41 user nova-compute[73078]: DEBUG nova.network.neutron [req-953f5323-6870-46c8-b8b3-49c4a650ac4d req-d09f0a7f-36bc-40e4-ac45-3aea9cbf90be service nova] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Updating instance_info_cache with network_info: [{"id": "396a7d1c-7aec-4324-8722-adc2dc77db86", "address": "fa:16:3e:17:fe:f7", "network": {"id": "21c76d99-2d0a-42b9-b7a0-b068f0cb938f", "bridge": "br-int", "label": "tempest-TestStampPattern-1682035048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce3bd6c6a784ee3a395c368d667c1b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap396a7d1c-7a", "ovs_interfaceid": "396a7d1c-7aec-4324-8722-adc2dc77db86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:32:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap396a7d1c-7a, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:32:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:32:41 user nova-compute[73078]: INFO os_vif [None req-8b42fb30-f66a-44d0-988e-7111d0d6005b tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:fe:f7,bridge_name='br-int',has_traffic_filtering=True,id=396a7d1c-7aec-4324-8722-adc2dc77db86,network=Network(21c76d99-2d0a-42b9-b7a0-b068f0cb938f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap396a7d1c-7a')
Aug 14 18:32:41 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-8b42fb30-f66a-44d0-988e-7111d0d6005b tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Deleting instance files /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c_del
Aug 14 18:32:41 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-8b42fb30-f66a-44d0-988e-7111d0d6005b tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Deletion of /opt/stack/data/nova/instances/ef083dd3-67d6-48a8-846a-7fe6c6b32d5c_del complete
Aug 14 18:32:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-953f5323-6870-46c8-b8b3-49c4a650ac4d req-d09f0a7f-36bc-40e4-ac45-3aea9cbf90be service nova] Releasing lock "refresh_cache-ef083dd3-67d6-48a8-846a-7fe6c6b32d5c" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:32:41 user nova-compute[73078]: INFO nova.compute.manager [None req-8b42fb30-f66a-44d0-988e-7111d0d6005b tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 14 18:32:41 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-8b42fb30-f66a-44d0-988e-7111d0d6005b tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:32:41 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:32:41 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:32:42 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:32:42 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Took 0.50 seconds to deallocate network for instance.
Aug 14 18:32:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8b42fb30-f66a-44d0-988e-7111d0d6005b tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:32:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8b42fb30-f66a-44d0-988e-7111d0d6005b tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:32:42 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-8b42fb30-f66a-44d0-988e-7111d0d6005b tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:32:42 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-8b42fb30-f66a-44d0-988e-7111d0d6005b tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:32:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8b42fb30-f66a-44d0-988e-7111d0d6005b tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.268s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:32:42 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-8b42fb30-f66a-44d0-988e-7111d0d6005b tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Deleted allocations for instance ef083dd3-67d6-48a8-846a-7fe6c6b32d5c
Aug 14 18:32:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8b42fb30-f66a-44d0-988e-7111d0d6005b tempest-TestStampPattern-11663352 tempest-TestStampPattern-11663352-project-member] Lock "ef083dd3-67d6-48a8-846a-7fe6c6b32d5c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.834s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:32:42 user nova-compute[73078]: DEBUG nova.compute.manager [req-5a2b6755-e251-43c7-89cb-8f35789f5079 req-2fb962b7-daec-4574-bf4d-e3ee0aefc37b service nova] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Received event network-vif-deleted-396a7d1c-7aec-4324-8722-adc2dc77db86 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:32:43 user nova-compute[73078]: DEBUG nova.compute.manager [req-2e28ba81-20e0-4121-a5ed-698f35e41be7 req-22c4b616-b73b-48fd-9087-a1e773b27119 service nova] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Received event network-vif-plugged-396a7d1c-7aec-4324-8722-adc2dc77db86 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:32:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-2e28ba81-20e0-4121-a5ed-698f35e41be7 req-22c4b616-b73b-48fd-9087-a1e773b27119 service nova] Acquiring lock "ef083dd3-67d6-48a8-846a-7fe6c6b32d5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:32:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-2e28ba81-20e0-4121-a5ed-698f35e41be7 req-22c4b616-b73b-48fd-9087-a1e773b27119 service nova] Lock "ef083dd3-67d6-48a8-846a-7fe6c6b32d5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:32:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-2e28ba81-20e0-4121-a5ed-698f35e41be7 req-22c4b616-b73b-48fd-9087-a1e773b27119 service nova] Lock "ef083dd3-67d6-48a8-846a-7fe6c6b32d5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:32:43 user nova-compute[73078]: DEBUG nova.compute.manager [req-2e28ba81-20e0-4121-a5ed-698f35e41be7 req-22c4b616-b73b-48fd-9087-a1e773b27119 service nova] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] No waiting events found dispatching network-vif-plugged-396a7d1c-7aec-4324-8722-adc2dc77db86 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:32:43 user nova-compute[73078]: WARNING nova.compute.manager [req-2e28ba81-20e0-4121-a5ed-698f35e41be7 req-22c4b616-b73b-48fd-9087-a1e773b27119 service nova] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Received unexpected event network-vif-plugged-396a7d1c-7aec-4324-8722-adc2dc77db86 for instance with vm_state deleted and task_state None.
Aug 14 18:32:43 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "631dc4c9-0df2-480b-952c-c088007703df" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:32:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "631dc4c9-0df2-480b-952c-c088007703df" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:32:48 user nova-compute[73078]: DEBUG nova.compute.manager [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:32:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:32:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:32:48 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:32:48 user nova-compute[73078]: INFO nova.compute.claims [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Claim successful on node user
Aug 14 18:32:48 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:32:48 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:32:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.316s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:32:48 user nova-compute[73078]: DEBUG nova.compute.manager [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:32:48 user nova-compute[73078]: DEBUG nova.compute.manager [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:32:48 user nova-compute[73078]: DEBUG nova.network.neutron [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:32:48 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:32:48 user nova-compute[73078]: DEBUG nova.compute.manager [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:32:48 user nova-compute[73078]: INFO nova.virt.block_device [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Booting with volume 70705684-d58a-4b0f-82c9-6285bf674aa9 at /dev/vda
Aug 14 18:32:48 user nova-compute[73078]: DEBUG nova.policy [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe79455616584e0fb80e6007edf0b706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7142101014c4defa7261a34fb9f28e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:32:48 user nova-compute[73078]: DEBUG os_brick.utils [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:32:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:48 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06c24cb-3e8a-4f58-9338-8048bf7898e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:48 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e94380-2686-46a1-95ed-af262c5a5c6b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:48 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85652f2-54fe-444f-8932-29eff42c3996]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:48 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0189a275-16a5-48cf-ae29-48ff9c52a2fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:32:48 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:32:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:48 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:32:48 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:32:48 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[460b3ff9-71a5-4aac-b03b-41c3570ec0cc]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:48 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:32:48 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:32:48 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:32:48 user nova-compute[73078]: DEBUG os_brick.utils [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:32:48 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Updating existing volume attachment record: ef87d2bd-04d8-457f-a702-55095ae2baeb {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:32:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:32:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:32:49 user nova-compute[73078]: DEBUG nova.compute.manager [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:32:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:32:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:32:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:32:49 user nova-compute[73078]: INFO nova.compute.claims [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Claim successful on node user
Aug 14 18:32:49 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:32:49 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:32:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.396s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:32:49 user nova-compute[73078]: DEBUG nova.compute.manager [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:32:49 user nova-compute[73078]: DEBUG nova.network.neutron [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Successfully created port: f1a22a14-2365-4acb-8349-4fa3ec865bae {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:32:49 user nova-compute[73078]: DEBUG nova.compute.manager [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:32:49 user nova-compute[73078]: DEBUG nova.network.neutron [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:32:49 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:32:49 user nova-compute[73078]: DEBUG nova.compute.manager [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:32:49 user nova-compute[73078]: DEBUG nova.policy [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0bff079d90d942bb8ab3ba53fb007125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e938ed650845d0a64b49273c9f6287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:32:49 user nova-compute[73078]: INFO nova.virt.block_device [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Booting with volume-backed-image 2cbd52c4-773f-4d5a-bbb1-b6f1221c7774 at /dev/vda
Aug 14 18:32:50 user nova-compute[73078]: DEBUG nova.network.neutron [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Successfully created port: c9ff8bc1-a391-4c5f-826f-a533290f2a98 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:32:50 user nova-compute[73078]: DEBUG nova.network.neutron [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Successfully updated port: f1a22a14-2365-4acb-8349-4fa3ec865bae {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:32:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "refresh_cache-631dc4c9-0df2-480b-952c-c088007703df" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:32:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquired lock "refresh_cache-631dc4c9-0df2-480b-952c-c088007703df" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:32:50 user nova-compute[73078]: DEBUG nova.network.neutron [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:32:50 user nova-compute[73078]: DEBUG nova.compute.manager [req-1cc96ff1-3613-4104-bbd0-0956cfcb73ca req-a600a7a6-72f4-4cc3-8f2a-0c1236730a33 service nova] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Received event network-changed-f1a22a14-2365-4acb-8349-4fa3ec865bae {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:32:50 user nova-compute[73078]: DEBUG nova.compute.manager [req-1cc96ff1-3613-4104-bbd0-0956cfcb73ca req-a600a7a6-72f4-4cc3-8f2a-0c1236730a33 service nova] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Refreshing instance network info cache due to event network-changed-f1a22a14-2365-4acb-8349-4fa3ec865bae. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:32:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1cc96ff1-3613-4104-bbd0-0956cfcb73ca req-a600a7a6-72f4-4cc3-8f2a-0c1236730a33 service nova] Acquiring lock "refresh_cache-631dc4c9-0df2-480b-952c-c088007703df" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:32:50 user nova-compute[73078]: DEBUG nova.network.neutron [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:32:51 user nova-compute[73078]: DEBUG nova.network.neutron [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Updating instance_info_cache with network_info: [{"id": "f1a22a14-2365-4acb-8349-4fa3ec865bae", "address": "fa:16:3e:16:f2:61", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a22a14-23", "ovs_interfaceid": "f1a22a14-2365-4acb-8349-4fa3ec865bae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:32:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Releasing lock "refresh_cache-631dc4c9-0df2-480b-952c-c088007703df" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:32:51 user nova-compute[73078]: DEBUG nova.compute.manager [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Instance network_info: |[{"id": "f1a22a14-2365-4acb-8349-4fa3ec865bae", "address": "fa:16:3e:16:f2:61", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a22a14-23", "ovs_interfaceid": "f1a22a14-2365-4acb-8349-4fa3ec865bae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:32:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1cc96ff1-3613-4104-bbd0-0956cfcb73ca req-a600a7a6-72f4-4cc3-8f2a-0c1236730a33 service nova] Acquired lock "refresh_cache-631dc4c9-0df2-480b-952c-c088007703df" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:32:51 user nova-compute[73078]: DEBUG nova.network.neutron [req-1cc96ff1-3613-4104-bbd0-0956cfcb73ca req-a600a7a6-72f4-4cc3-8f2a-0c1236730a33 service nova] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Refreshing network info cache for port f1a22a14-2365-4acb-8349-4fa3ec865bae {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:32:51 user nova-compute[73078]: DEBUG nova.network.neutron [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Successfully updated port: c9ff8bc1-a391-4c5f-826f-a533290f2a98 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:32:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "refresh_cache-fc7d44f5-3616-4dba-a851-b6f7dddbad32" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:32:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquired lock "refresh_cache-fc7d44f5-3616-4dba-a851-b6f7dddbad32" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:32:51 user nova-compute[73078]: DEBUG nova.network.neutron [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:32:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-f4abadda-a665-425e-ae5c-7aaeef28697b req-2d83f20f-9e1c-49d4-b0d6-b4b70511c30a service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Received event network-changed-c9ff8bc1-a391-4c5f-826f-a533290f2a98 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:32:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-f4abadda-a665-425e-ae5c-7aaeef28697b req-2d83f20f-9e1c-49d4-b0d6-b4b70511c30a service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Refreshing instance network info cache due to event network-changed-c9ff8bc1-a391-4c5f-826f-a533290f2a98. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:32:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-f4abadda-a665-425e-ae5c-7aaeef28697b req-2d83f20f-9e1c-49d4-b0d6-b4b70511c30a service nova] Acquiring lock "refresh_cache-fc7d44f5-3616-4dba-a851-b6f7dddbad32" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:32:51 user nova-compute[73078]: DEBUG nova.network.neutron [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:32:51 user nova-compute[73078]: DEBUG nova.network.neutron [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Updating instance_info_cache with network_info: [{"id": "c9ff8bc1-a391-4c5f-826f-a533290f2a98", "address": "fa:16:3e:e7:4a:6c", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ff8bc1-a3", "ovs_interfaceid": "c9ff8bc1-a391-4c5f-826f-a533290f2a98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:32:51 user nova-compute[73078]: DEBUG nova.network.neutron [req-1cc96ff1-3613-4104-bbd0-0956cfcb73ca req-a600a7a6-72f4-4cc3-8f2a-0c1236730a33 service nova] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Updated VIF entry in instance network info cache for port f1a22a14-2365-4acb-8349-4fa3ec865bae. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:32:51 user nova-compute[73078]: DEBUG nova.network.neutron [req-1cc96ff1-3613-4104-bbd0-0956cfcb73ca req-a600a7a6-72f4-4cc3-8f2a-0c1236730a33 service nova] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Updating instance_info_cache with network_info: [{"id": "f1a22a14-2365-4acb-8349-4fa3ec865bae", "address": "fa:16:3e:16:f2:61", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a22a14-23", "ovs_interfaceid": "f1a22a14-2365-4acb-8349-4fa3ec865bae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:32:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Releasing lock "refresh_cache-fc7d44f5-3616-4dba-a851-b6f7dddbad32" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:32:51 user nova-compute[73078]: DEBUG nova.compute.manager [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Instance network_info: |[{"id": "c9ff8bc1-a391-4c5f-826f-a533290f2a98", "address": "fa:16:3e:e7:4a:6c", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ff8bc1-a3", "ovs_interfaceid": "c9ff8bc1-a391-4c5f-826f-a533290f2a98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:32:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-f4abadda-a665-425e-ae5c-7aaeef28697b req-2d83f20f-9e1c-49d4-b0d6-b4b70511c30a service nova] Acquired lock "refresh_cache-fc7d44f5-3616-4dba-a851-b6f7dddbad32" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:32:51 user nova-compute[73078]: DEBUG nova.network.neutron [req-f4abadda-a665-425e-ae5c-7aaeef28697b req-2d83f20f-9e1c-49d4-b0d6-b4b70511c30a service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Refreshing network info cache for port c9ff8bc1-a391-4c5f-826f-a533290f2a98 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:32:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1cc96ff1-3613-4104-bbd0-0956cfcb73ca req-a600a7a6-72f4-4cc3-8f2a-0c1236730a33 service nova] Releasing lock "refresh_cache-631dc4c9-0df2-480b-952c-c088007703df" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:32:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:52 user nova-compute[73078]: DEBUG nova.network.neutron [req-f4abadda-a665-425e-ae5c-7aaeef28697b req-2d83f20f-9e1c-49d4-b0d6-b4b70511c30a service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Updated VIF entry in instance network info cache for port c9ff8bc1-a391-4c5f-826f-a533290f2a98. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:32:52 user nova-compute[73078]: DEBUG nova.network.neutron [req-f4abadda-a665-425e-ae5c-7aaeef28697b req-2d83f20f-9e1c-49d4-b0d6-b4b70511c30a service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Updating instance_info_cache with network_info: [{"id": "c9ff8bc1-a391-4c5f-826f-a533290f2a98", "address": "fa:16:3e:e7:4a:6c", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ff8bc1-a3", "ovs_interfaceid": "c9ff8bc1-a391-4c5f-826f-a533290f2a98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:32:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-f4abadda-a665-425e-ae5c-7aaeef28697b req-2d83f20f-9e1c-49d4-b0d6-b4b70511c30a service nova] Releasing lock "refresh_cache-fc7d44f5-3616-4dba-a851-b6f7dddbad32" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:32:56 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692037961.661564, ef083dd3-67d6-48a8-846a-7fe6c6b32d5c => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:32:56 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] VM Stopped (Lifecycle Event)
Aug 14 18:32:56 user nova-compute[73078]: DEBUG nova.compute.manager [None req-8152e747-ae98-44f4-b1b2-a5b856a65de9 None None] [instance: ef083dd3-67d6-48a8-846a-7fe6c6b32d5c] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:32:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG nova.compute.manager [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:32:57 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Creating image(s)
Aug 14 18:32:57 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Did not create local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Ensure instance console log exists: /opt/stack/data/nova/instances/631dc4c9-0df2-480b-952c-c088007703df/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Start _get_guest_xml network_info=[{"id": "f1a22a14-2365-4acb-8349-4fa3ec865bae", "address": "fa:16:3e:16:f2:61", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a22a14-23", "ovs_interfaceid": "f1a22a14-2365-4acb-8349-4fa3ec865bae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'ef87d2bd-04d8-457f-a702-55095ae2baeb', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lEybjUpx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '631dc4c9-0df2-480b-952c-c088007703df', 'attached_at': '', 'detached_at': '', 'volume_id': '70705684-d58a-4b0f-82c9-6285bf674aa9', 'serial': '70705684-d58a-4b0f-82c9-6285bf674aa9'}, 'volume_type': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:32:57 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:32:57 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:32:57 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lEybjUpx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:32:57 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:32:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:32:57 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:32:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:32:57 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:32:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9dd1bf-d69a-4abe-b603-d573433aa8f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:32:57 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a03a5c9-d023-40bf-952e-86d32494e0ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9] added
Aug 14 18:32:57 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a6a059-dd74-41d2-b50d-92abdd434017]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[774423b8-20fe-44a1-be3f-8d00737a0f14]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lEybjUpx {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lEybjUpx" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae16e5d2-c10a-44aa-b728-833cbe34886a]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lEybjUpx'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec74ba56-3642-4c82-89eb-919cc811ac82]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1e4f0d-25ed-41a4-b0a2-f592576e57fe]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:32:57 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:32:57 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae91383c-a160-49bd-98e7-622c5e326aa9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9, portal: 172.16.0.220,3260]
Aug 14 18:32:57 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9, portal: 172.16.0.220,3260] successful.
Aug 14 18:32:57 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f30e97-cd66-4b0a-8ab7-8075a0d05ec9]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3604bb63-3ba9-4bfd-a499-8138eb493eef]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:32:57 user nova-compute[73078]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:32:57 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:32:57 user nova-compute[73078]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:32:57 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:32:57 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:32:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:32:58 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6aa2ae-0550-4d82-8ffa-cd65b2a92bbc]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:32:58 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:32:58 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lEybjUpx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:32:59 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:32:59 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23231393536303265', 'path': '/dev/sdc'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:32:59 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231393536303265', 'path': '/dev/sdc'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:32:59 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:32:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-850621936',display_name='tempest-TestVolumeBootPattern-server-850621936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-850621936',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU8q8wtxkW9pROl2j0NkoRwpKKcmziB/20QEkNRAKEXt/Sm0AgtPtqW4EQeZ9Nz+9SI3khJoGje9+NMiFY56dE76HSwv/RbWY1Ab2OSscMaXE4ftFHwz3mwUt13yK/iVg==',key_name='tempest-TestVolumeBootPattern-511986969',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7142101014c4defa7261a34fb9f28e4',ramdisk_id='',reservation_id='r-tbblo0qz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1889877750',owner_user_name='tempest-TestVolumeBootPattern-1889877750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:32:49Z,user_data=None,user_id='fe79455616584e0fb80e6007edf0b706',uuid=631dc4c9-0df2-480b-952c-c088007703df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1a22a14-2365-4acb-8349-4fa3ec865bae", "address": "fa:16:3e:16:f2:61", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a22a14-23", "ovs_interfaceid": "f1a22a14-2365-4acb-8349-4fa3ec865bae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:32:59 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Converting VIF {"id": "f1a22a14-2365-4acb-8349-4fa3ec865bae", "address": "fa:16:3e:16:f2:61", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a22a14-23", "ovs_interfaceid": "f1a22a14-2365-4acb-8349-4fa3ec865bae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:32:59 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:f2:61,bridge_name='br-int',has_traffic_filtering=True,id=f1a22a14-2365-4acb-8349-4fa3ec865bae,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1a22a14-23') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:32:59 user nova-compute[73078]: DEBUG nova.objects.instance [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lazy-loading 'pci_devices' on Instance uuid 631dc4c9-0df2-480b-952c-c088007703df {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:32:59 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:32:59 user nova-compute[73078]:   <uuid>631dc4c9-0df2-480b-952c-c088007703df</uuid>
Aug 14 18:32:59 user nova-compute[73078]:   <name>instance-0000002b</name>
Aug 14 18:32:59 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:32:59 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:32:59 user nova-compute[73078]:   <metadata>
Aug 14 18:32:59 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:32:59 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:32:59 user nova-compute[73078]:       <nova:name>tempest-TestVolumeBootPattern-server-850621936</nova:name>
Aug 14 18:32:59 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:32:57</nova:creationTime>
Aug 14 18:32:59 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:32:59 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:32:59 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:32:59 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:32:59 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:32:59 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:32:59 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:32:59 user nova-compute[73078]:       <nova:owner>
Aug 14 18:32:59 user nova-compute[73078]:         <nova:user uuid="fe79455616584e0fb80e6007edf0b706">tempest-TestVolumeBootPattern-1889877750-project-member</nova:user>
Aug 14 18:32:59 user nova-compute[73078]:         <nova:project uuid="e7142101014c4defa7261a34fb9f28e4">tempest-TestVolumeBootPattern-1889877750</nova:project>
Aug 14 18:32:59 user nova-compute[73078]:       </nova:owner>
Aug 14 18:32:59 user nova-compute[73078]:       <nova:ports>
Aug 14 18:32:59 user nova-compute[73078]:         <nova:port uuid="f1a22a14-2365-4acb-8349-4fa3ec865bae">
Aug 14 18:32:59 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 18:32:59 user nova-compute[73078]:         </nova:port>
Aug 14 18:32:59 user nova-compute[73078]:       </nova:ports>
Aug 14 18:32:59 user nova-compute[73078]:     </nova:instance>
Aug 14 18:32:59 user nova-compute[73078]:   </metadata>
Aug 14 18:32:59 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:32:59 user nova-compute[73078]:     <system>
Aug 14 18:32:59 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:32:59 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:32:59 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:32:59 user nova-compute[73078]:       <entry name="serial">631dc4c9-0df2-480b-952c-c088007703df</entry>
Aug 14 18:32:59 user nova-compute[73078]:       <entry name="uuid">631dc4c9-0df2-480b-952c-c088007703df</entry>
Aug 14 18:32:59 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:32:59 user nova-compute[73078]:     </system>
Aug 14 18:32:59 user nova-compute[73078]:   </sysinfo>
Aug 14 18:32:59 user nova-compute[73078]:   <os>
Aug 14 18:32:59 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:32:59 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:32:59 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:32:59 user nova-compute[73078]:   </os>
Aug 14 18:32:59 user nova-compute[73078]:   <features>
Aug 14 18:32:59 user nova-compute[73078]:     <acpi/>
Aug 14 18:32:59 user nova-compute[73078]:     <apic/>
Aug 14 18:32:59 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:32:59 user nova-compute[73078]:   </features>
Aug 14 18:32:59 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:32:59 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:32:59 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:32:59 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:32:59 user nova-compute[73078]:   </clock>
Aug 14 18:32:59 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:32:59 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:32:59 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:32:59 user nova-compute[73078]:   </cpu>
Aug 14 18:32:59 user nova-compute[73078]:   <devices>
Aug 14 18:32:59 user nova-compute[73078]:     <disk type="block" device="disk">
Aug 14 18:32:59 user nova-compute[73078]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:32:59 user nova-compute[73078]:       <source dev="/dev/sdc"/>
Aug 14 18:32:59 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:32:59 user nova-compute[73078]:       <serial>70705684-d58a-4b0f-82c9-6285bf674aa9</serial>
Aug 14 18:32:59 user nova-compute[73078]:     </disk>
Aug 14 18:32:59 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:32:59 user nova-compute[73078]:       <mac address="fa:16:3e:16:f2:61"/>
Aug 14 18:32:59 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:32:59 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:32:59 user nova-compute[73078]:       <target dev="tapf1a22a14-23"/>
Aug 14 18:32:59 user nova-compute[73078]:     </interface>
Aug 14 18:32:59 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:32:59 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/631dc4c9-0df2-480b-952c-c088007703df/console.log" append="off"/>
Aug 14 18:32:59 user nova-compute[73078]:     </serial>
Aug 14 18:32:59 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:32:59 user nova-compute[73078]:     <video>
Aug 14 18:32:59 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:32:59 user nova-compute[73078]:     </video>
Aug 14 18:32:59 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:32:59 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:32:59 user nova-compute[73078]:     </rng>
Aug 14 18:32:59 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:32:59 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:32:59 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:32:59 user nova-compute[73078]:     </memballoon>
Aug 14 18:32:59 user nova-compute[73078]:   </devices>
Aug 14 18:32:59 user nova-compute[73078]: </domain>
Aug 14 18:32:59 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:32:59 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:32:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-850621936',display_name='tempest-TestVolumeBootPattern-server-850621936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-850621936',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU8q8wtxkW9pROl2j0NkoRwpKKcmziB/20QEkNRAKEXt/Sm0AgtPtqW4EQeZ9Nz+9SI3khJoGje9+NMiFY56dE76HSwv/RbWY1Ab2OSscMaXE4ftFHwz3mwUt13yK/iVg==',key_name='tempest-TestVolumeBootPattern-511986969',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7142101014c4defa7261a34fb9f28e4',ramdisk_id='',reservation_id='r-tbblo0qz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1889877750',owner_user_name='tempest-TestVolumeBootPattern-1889877750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:32:49Z,user_data=None,user_id='fe79455616584e0fb80e6007edf0b706',uuid=631dc4c9-0df2-480b-952c-c088007703df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1a22a14-2365-4acb-8349-4fa3ec865bae", "address": "fa:16:3e:16:f2:61", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a22a14-23", "ovs_interfaceid": "f1a22a14-2365-4acb-8349-4fa3ec865bae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:32:59 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Converting VIF {"id": "f1a22a14-2365-4acb-8349-4fa3ec865bae", "address": "fa:16:3e:16:f2:61", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a22a14-23", "ovs_interfaceid": "f1a22a14-2365-4acb-8349-4fa3ec865bae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:32:59 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:f2:61,bridge_name='br-int',has_traffic_filtering=True,id=f1a22a14-2365-4acb-8349-4fa3ec865bae,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1a22a14-23') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:32:59 user nova-compute[73078]: DEBUG os_vif [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:f2:61,bridge_name='br-int',has_traffic_filtering=True,id=f1a22a14-2365-4acb-8349-4fa3ec865bae,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1a22a14-23') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:32:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:32:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:32:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf1a22a14-23, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:32:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf1a22a14-23, col_values=(('external_ids', {'iface-id': 'f1a22a14-2365-4acb-8349-4fa3ec865bae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:f2:61', 'vm-uuid': '631dc4c9-0df2-480b-952c-c088007703df'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:32:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:32:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:32:59 user nova-compute[73078]: INFO os_vif [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:f2:61,bridge_name='br-int',has_traffic_filtering=True,id=f1a22a14-2365-4acb-8349-4fa3ec865bae,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1a22a14-23')
Aug 14 18:32:59 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:32:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:32:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:32:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:32:59 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:32:59 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:32:59 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] No VIF found with MAC fa:16:3e:16:f2:61, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:33:00 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:00 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:00 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:00 user nova-compute[73078]: DEBUG nova.compute.manager [req-e4a66488-4450-4f4f-9c45-06a4a6851f84 req-b7d7ca6f-0c70-46e0-9976-fa4abf8aeeab service nova] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Received event network-vif-plugged-f1a22a14-2365-4acb-8349-4fa3ec865bae {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:33:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e4a66488-4450-4f4f-9c45-06a4a6851f84 req-b7d7ca6f-0c70-46e0-9976-fa4abf8aeeab service nova] Acquiring lock "631dc4c9-0df2-480b-952c-c088007703df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:33:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e4a66488-4450-4f4f-9c45-06a4a6851f84 req-b7d7ca6f-0c70-46e0-9976-fa4abf8aeeab service nova] Lock "631dc4c9-0df2-480b-952c-c088007703df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:33:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e4a66488-4450-4f4f-9c45-06a4a6851f84 req-b7d7ca6f-0c70-46e0-9976-fa4abf8aeeab service nova] Lock "631dc4c9-0df2-480b-952c-c088007703df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:33:00 user nova-compute[73078]: DEBUG nova.compute.manager [req-e4a66488-4450-4f4f-9c45-06a4a6851f84 req-b7d7ca6f-0c70-46e0-9976-fa4abf8aeeab service nova] [instance: 631dc4c9-0df2-480b-952c-c088007703df] No waiting events found dispatching network-vif-plugged-f1a22a14-2365-4acb-8349-4fa3ec865bae {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:33:00 user nova-compute[73078]: WARNING nova.compute.manager [req-e4a66488-4450-4f4f-9c45-06a4a6851f84 req-b7d7ca6f-0c70-46e0-9976-fa4abf8aeeab service nova] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Received unexpected event network-vif-plugged-f1a22a14-2365-4acb-8349-4fa3ec865bae for instance with vm_state building and task_state spawning.
Aug 14 18:33:00 user nova-compute[73078]: DEBUG os_brick.utils [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:33:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:00 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc8d1a1-3fe6-4820-bc54-b841e1a8a3d4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:00 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c86479f-048a-43f3-9d5e-4503b939ecc0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:00 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0946703d-508a-4f4b-8a83-240749804791]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:00 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a21525-bab1-4853-ba76-bc27cc225758]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:33:00 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:33:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:33:00 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:33:00 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a781be52-b18a-4ab8-8f08-84eb1eeb1084]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:00 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:33:00 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:33:00 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:33:00 user nova-compute[73078]: DEBUG os_brick.utils [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:33:00 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Updating existing volume attachment record: dc0b72a5-e4d9-4885-bfed-eab245914cc1 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:33:00 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:33:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:00 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bb1bc98-12ee-4a5b-91db-6e66966c482f/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:02 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037982.4542341, 631dc4c9-0df2-480b-952c-c088007703df => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:33:02 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 631dc4c9-0df2-480b-952c-c088007703df] VM Resumed (Lifecycle Event)
Aug 14 18:33:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:33:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:33:02 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Instance spawned successfully.
Aug 14 18:33:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:33:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:33:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:33:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:33:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:33:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:33:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:33:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:33:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:33:02 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 631dc4c9-0df2-480b-952c-c088007703df] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:33:02 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037982.4548779, 631dc4c9-0df2-480b-952c-c088007703df => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:33:02 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 631dc4c9-0df2-480b-952c-c088007703df] VM Started (Lifecycle Event)
Aug 14 18:33:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:33:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:33:02 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 631dc4c9-0df2-480b-952c-c088007703df] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:33:02 user nova-compute[73078]: INFO nova.compute.manager [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Took 4.93 seconds to spawn the instance on the hypervisor.
Aug 14 18:33:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:33:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bb1bc98-12ee-4a5b-91db-6e66966c482f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bb1bc98-12ee-4a5b-91db-6e66966c482f/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:02 user nova-compute[73078]: DEBUG nova.compute.manager [req-8be8897f-f84c-4d66-8622-c9a9bae21289 req-31b7589d-087b-484a-bdfb-a0ab6ed22095 service nova] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Received event network-vif-plugged-f1a22a14-2365-4acb-8349-4fa3ec865bae {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:33:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-8be8897f-f84c-4d66-8622-c9a9bae21289 req-31b7589d-087b-484a-bdfb-a0ab6ed22095 service nova] Acquiring lock "631dc4c9-0df2-480b-952c-c088007703df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:33:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-8be8897f-f84c-4d66-8622-c9a9bae21289 req-31b7589d-087b-484a-bdfb-a0ab6ed22095 service nova] Lock "631dc4c9-0df2-480b-952c-c088007703df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:33:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-8be8897f-f84c-4d66-8622-c9a9bae21289 req-31b7589d-087b-484a-bdfb-a0ab6ed22095 service nova] Lock "631dc4c9-0df2-480b-952c-c088007703df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:33:02 user nova-compute[73078]: DEBUG nova.compute.manager [req-8be8897f-f84c-4d66-8622-c9a9bae21289 req-31b7589d-087b-484a-bdfb-a0ab6ed22095 service nova] [instance: 631dc4c9-0df2-480b-952c-c088007703df] No waiting events found dispatching network-vif-plugged-f1a22a14-2365-4acb-8349-4fa3ec865bae {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:33:02 user nova-compute[73078]: WARNING nova.compute.manager [req-8be8897f-f84c-4d66-8622-c9a9bae21289 req-31b7589d-087b-484a-bdfb-a0ab6ed22095 service nova] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Received unexpected event network-vif-plugged-f1a22a14-2365-4acb-8349-4fa3ec865bae for instance with vm_state building and task_state spawning.
Aug 14 18:33:02 user nova-compute[73078]: INFO nova.compute.manager [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Took 14.56 seconds to build instance.
Aug 14 18:33:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-89053316-37dd-407b-9d3f-256afebbe357 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "631dc4c9-0df2-480b-952c-c088007703df" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.667s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:33:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bb1bc98-12ee-4a5b-91db-6e66966c482f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:33:03 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:33:03 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:33:03 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=8000MB free_disk=24.93451690673828GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:33:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:33:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:33:03 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 61dfe42b-c943-4617-bf8e-745eaf1a1bb8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:33:03 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 3088da30-65b7-4801-b425-93df4fca6ad8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:33:03 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 2f960239-8deb-4d9f-9cab-eea0274aca38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:33:03 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance ebbaec07-9843-4cc0-bcb6-f993e62d88c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:33:03 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 16a18fae-165b-487b-bfd5-20097eac0a8e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:33:03 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 8bb1bc98-12ee-4a5b-91db-6e66966c482f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:33:03 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 631dc4c9-0df2-480b-952c-c088007703df actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:33:03 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance fc7d44f5-3616-4dba-a851-b6f7dddbad32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:33:03 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:33:03 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:33:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:03 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:33:03 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:33:03 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:33:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.398s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:33:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:05 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:33:05 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:33:05 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:33:05 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-3088da30-65b7-4801-b425-93df4fca6ad8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:33:05 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-3088da30-65b7-4801-b425-93df4fca6ad8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:33:05 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:33:06 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Updating instance_info_cache with network_info: [{"id": "52e93284-9b32-4191-8f06-ab9c4497579c", "address": "fa:16:3e:ec:04:07", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e93284-9b", "ovs_interfaceid": "52e93284-9b32-4191-8f06-ab9c4497579c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:33:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-3088da30-65b7-4801-b425-93df4fca6ad8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:33:06 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:33:06 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:33:06 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:33:06 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:33:06 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:33:06 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:33:06 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:33:06 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:33:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:09 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG nova.compute.manager [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:33:10 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Creating image(s)
Aug 14 18:33:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Did not create local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Ensure instance console log exists: /opt/stack/data/nova/instances/fc7d44f5-3616-4dba-a851-b6f7dddbad32/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Start _get_guest_xml network_info=[{"id": "c9ff8bc1-a391-4c5f-826f-a533290f2a98", "address": "fa:16:3e:e7:4a:6c", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ff8bc1-a3", "ovs_interfaceid": "c9ff8bc1-a391-4c5f-826f-a533290f2a98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'dc0b72a5-e4d9-4885-bfed-eab245914cc1', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oMItkiKx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fc7d44f5-3616-4dba-a851-b6f7dddbad32', 'attached_at': '', 'detached_at': '', 'volume_id': '365d0bf8-ac18-49e0-a595-f9cda5d0c3dc', 'serial': '365d0bf8-ac18-49e0-a595-f9cda5d0c3dc'}, 'volume_type': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:33:10 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:33:10 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:33:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oMItkiKx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:33:10 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:33:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:33:10 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:33:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:33:10 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:33:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bea0ba-d489-49aa-8ede-ed5298cdb3db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:33:10 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8016f2fc-891a-4f8e-afbd-79d7a3023f08]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc] added
Aug 14 18:33:10 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5baf866b-33f7-43e9-a437-cb114238f454]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a3a82e-c7ba-4af2-8c4c-61e22c05599f]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oMItkiKx {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oMItkiKx" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb14ea0b-9011-4a8a-a36c-7b9dc7c55698]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oMItkiKx'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[158deda3-d94f-4246-937c-050c18ffea7b]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5869e01d-ca01-4064-b176-1f3ca62fb87e]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:33:10 user nova-compute[73078]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:33:10 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:33:10 user nova-compute[73078]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:33:10 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd5a240-cabd-41c8-9477-0c1722e43987]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc, portal: 172.16.0.220,3260]
Aug 14 18:33:10 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc, portal: 172.16.0.220,3260] successful.
Aug 14 18:33:10 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca98604-28aa-423d-a86e-680bf1af4eb1]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9940e67b-1c07-46ca-a901-e626c5306c01]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:33:10 user nova-compute[73078]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:33:10 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:33:10 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:33:10 user nova-compute[73078]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:33:10 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:33:10 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] HCTL ('35', '-', '-', 0) found on session 51 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c399ad8b-c97d-439d-9a8b-cc341da987ca]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:33:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oMItkiKx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:33:11 user nova-compute[73078]: DEBUG nova.compute.manager [req-aa53db36-a4a1-40e1-b55b-f53c459f1ad6 req-7a934fa5-78ff-4d34-90f8-1c825cabcfcf service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Received event network-changed-2dd60866-9ed8-4840-a797-893d81ab2b65 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:33:11 user nova-compute[73078]: DEBUG nova.compute.manager [req-aa53db36-a4a1-40e1-b55b-f53c459f1ad6 req-7a934fa5-78ff-4d34-90f8-1c825cabcfcf service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Refreshing instance network info cache due to event network-changed-2dd60866-9ed8-4840-a797-893d81ab2b65. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:33:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-aa53db36-a4a1-40e1-b55b-f53c459f1ad6 req-7a934fa5-78ff-4d34-90f8-1c825cabcfcf service nova] Acquiring lock "refresh_cache-16a18fae-165b-487b-bfd5-20097eac0a8e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:33:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-aa53db36-a4a1-40e1-b55b-f53c459f1ad6 req-7a934fa5-78ff-4d34-90f8-1c825cabcfcf service nova] Acquired lock "refresh_cache-16a18fae-165b-487b-bfd5-20097eac0a8e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:33:11 user nova-compute[73078]: DEBUG nova.network.neutron [req-aa53db36-a4a1-40e1-b55b-f53c459f1ad6 req-7a934fa5-78ff-4d34-90f8-1c825cabcfcf service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Refreshing network info cache for port 2dd60866-9ed8-4840-a797-893d81ab2b65 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:33:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:33:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23164376234353463', 'path': '/dev/sdd'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:33:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164376234353463', 'path': '/dev/sdd'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:33:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:32:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-502950209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-502950209',id=44,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16e938ed650845d0a64b49273c9f6287',ramdisk_id='',reservation_id='r-p6wrvd40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1267883434',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:32:50Z,user_data=None,user_id='0bff079d90d942bb8ab3ba53fb007125',uuid=fc7d44f5-3616-4dba-a851-b6f7dddbad32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9ff8bc1-a391-4c5f-826f-a533290f2a98", "address": "fa:16:3e:e7:4a:6c", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ff8bc1-a3", "ovs_interfaceid": "c9ff8bc1-a391-4c5f-826f-a533290f2a98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:33:11 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Converting VIF {"id": "c9ff8bc1-a391-4c5f-826f-a533290f2a98", "address": "fa:16:3e:e7:4a:6c", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ff8bc1-a3", "ovs_interfaceid": "c9ff8bc1-a391-4c5f-826f-a533290f2a98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:33:11 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:4a:6c,bridge_name='br-int',has_traffic_filtering=True,id=c9ff8bc1-a391-4c5f-826f-a533290f2a98,network=Network(98a29135-c5de-46a6-a2bf-46c90b4e255b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9ff8bc1-a3') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:33:11 user nova-compute[73078]: DEBUG nova.objects.instance [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lazy-loading 'pci_devices' on Instance uuid fc7d44f5-3616-4dba-a851-b6f7dddbad32 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:33:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:33:11 user nova-compute[73078]:   <uuid>fc7d44f5-3616-4dba-a851-b6f7dddbad32</uuid>
Aug 14 18:33:11 user nova-compute[73078]:   <name>instance-0000002c</name>
Aug 14 18:33:11 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:33:11 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:33:11 user nova-compute[73078]:   <metadata>
Aug 14 18:33:11 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:33:11 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:33:11 user nova-compute[73078]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-502950209</nova:name>
Aug 14 18:33:11 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:33:10</nova:creationTime>
Aug 14 18:33:11 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:33:11 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:33:11 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:33:11 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:33:11 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:33:11 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:33:11 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:33:11 user nova-compute[73078]:       <nova:owner>
Aug 14 18:33:11 user nova-compute[73078]:         <nova:user uuid="0bff079d90d942bb8ab3ba53fb007125">tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member</nova:user>
Aug 14 18:33:11 user nova-compute[73078]:         <nova:project uuid="16e938ed650845d0a64b49273c9f6287">tempest-ServerBootFromVolumeStableRescueTest-1267883434</nova:project>
Aug 14 18:33:11 user nova-compute[73078]:       </nova:owner>
Aug 14 18:33:11 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:33:11 user nova-compute[73078]:       <nova:ports>
Aug 14 18:33:11 user nova-compute[73078]:         <nova:port uuid="c9ff8bc1-a391-4c5f-826f-a533290f2a98">
Aug 14 18:33:11 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 18:33:11 user nova-compute[73078]:         </nova:port>
Aug 14 18:33:11 user nova-compute[73078]:       </nova:ports>
Aug 14 18:33:11 user nova-compute[73078]:     </nova:instance>
Aug 14 18:33:11 user nova-compute[73078]:   </metadata>
Aug 14 18:33:11 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:33:11 user nova-compute[73078]:     <system>
Aug 14 18:33:11 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:33:11 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:33:11 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:33:11 user nova-compute[73078]:       <entry name="serial">fc7d44f5-3616-4dba-a851-b6f7dddbad32</entry>
Aug 14 18:33:11 user nova-compute[73078]:       <entry name="uuid">fc7d44f5-3616-4dba-a851-b6f7dddbad32</entry>
Aug 14 18:33:11 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:33:11 user nova-compute[73078]:     </system>
Aug 14 18:33:11 user nova-compute[73078]:   </sysinfo>
Aug 14 18:33:11 user nova-compute[73078]:   <os>
Aug 14 18:33:11 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:33:11 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:33:11 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:33:11 user nova-compute[73078]:   </os>
Aug 14 18:33:11 user nova-compute[73078]:   <features>
Aug 14 18:33:11 user nova-compute[73078]:     <acpi/>
Aug 14 18:33:11 user nova-compute[73078]:     <apic/>
Aug 14 18:33:11 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:33:11 user nova-compute[73078]:   </features>
Aug 14 18:33:11 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:33:11 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:33:11 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:33:11 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:33:11 user nova-compute[73078]:   </clock>
Aug 14 18:33:11 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:33:11 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:33:11 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:33:11 user nova-compute[73078]:   </cpu>
Aug 14 18:33:11 user nova-compute[73078]:   <devices>
Aug 14 18:33:11 user nova-compute[73078]:     <disk type="block" device="disk">
Aug 14 18:33:11 user nova-compute[73078]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:33:11 user nova-compute[73078]:       <source dev="/dev/sdd"/>
Aug 14 18:33:11 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:33:11 user nova-compute[73078]:       <serial>365d0bf8-ac18-49e0-a595-f9cda5d0c3dc</serial>
Aug 14 18:33:11 user nova-compute[73078]:     </disk>
Aug 14 18:33:11 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:33:11 user nova-compute[73078]:       <mac address="fa:16:3e:e7:4a:6c"/>
Aug 14 18:33:11 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:33:11 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:33:11 user nova-compute[73078]:       <target dev="tapc9ff8bc1-a3"/>
Aug 14 18:33:11 user nova-compute[73078]:     </interface>
Aug 14 18:33:11 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:33:11 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/fc7d44f5-3616-4dba-a851-b6f7dddbad32/console.log" append="off"/>
Aug 14 18:33:11 user nova-compute[73078]:     </serial>
Aug 14 18:33:11 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:33:11 user nova-compute[73078]:     <video>
Aug 14 18:33:11 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:33:11 user nova-compute[73078]:     </video>
Aug 14 18:33:11 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:33:11 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:33:11 user nova-compute[73078]:     </rng>
Aug 14 18:33:11 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:33:11 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:33:11 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:33:11 user nova-compute[73078]:     </memballoon>
Aug 14 18:33:11 user nova-compute[73078]:   </devices>
Aug 14 18:33:11 user nova-compute[73078]: </domain>
Aug 14 18:33:11 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:33:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:32:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-502950209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-502950209',id=44,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16e938ed650845d0a64b49273c9f6287',ramdisk_id='',reservation_id='r-p6wrvd40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1267883434',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:32:50Z,user_data=None,user_id='0bff079d90d942bb8ab3ba53fb007125',uuid=fc7d44f5-3616-4dba-a851-b6f7dddbad32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9ff8bc1-a391-4c5f-826f-a533290f2a98", "address": "fa:16:3e:e7:4a:6c", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ff8bc1-a3", "ovs_interfaceid": "c9ff8bc1-a391-4c5f-826f-a533290f2a98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:33:11 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Converting VIF {"id": "c9ff8bc1-a391-4c5f-826f-a533290f2a98", "address": "fa:16:3e:e7:4a:6c", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ff8bc1-a3", "ovs_interfaceid": "c9ff8bc1-a391-4c5f-826f-a533290f2a98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:33:11 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:4a:6c,bridge_name='br-int',has_traffic_filtering=True,id=c9ff8bc1-a391-4c5f-826f-a533290f2a98,network=Network(98a29135-c5de-46a6-a2bf-46c90b4e255b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9ff8bc1-a3') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:33:11 user nova-compute[73078]: DEBUG os_vif [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:4a:6c,bridge_name='br-int',has_traffic_filtering=True,id=c9ff8bc1-a391-4c5f-826f-a533290f2a98,network=Network(98a29135-c5de-46a6-a2bf-46c90b4e255b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9ff8bc1-a3') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:33:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:33:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:33:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9ff8bc1-a3, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:33:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc9ff8bc1-a3, col_values=(('external_ids', {'iface-id': 'c9ff8bc1-a391-4c5f-826f-a533290f2a98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:4a:6c', 'vm-uuid': 'fc7d44f5-3616-4dba-a851-b6f7dddbad32'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:33:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:33:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:11 user nova-compute[73078]: INFO os_vif [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:4a:6c,bridge_name='br-int',has_traffic_filtering=True,id=c9ff8bc1-a391-4c5f-826f-a533290f2a98,network=Network(98a29135-c5de-46a6-a2bf-46c90b4e255b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9ff8bc1-a3')
Aug 14 18:33:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:33:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] No VIF found with MAC fa:16:3e:e7:4a:6c, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:33:12 user nova-compute[73078]: DEBUG nova.network.neutron [req-aa53db36-a4a1-40e1-b55b-f53c459f1ad6 req-7a934fa5-78ff-4d34-90f8-1c825cabcfcf service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Updated VIF entry in instance network info cache for port 2dd60866-9ed8-4840-a797-893d81ab2b65. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:33:12 user nova-compute[73078]: DEBUG nova.network.neutron [req-aa53db36-a4a1-40e1-b55b-f53c459f1ad6 req-7a934fa5-78ff-4d34-90f8-1c825cabcfcf service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Updating instance_info_cache with network_info: [{"id": "2dd60866-9ed8-4840-a797-893d81ab2b65", "address": "fa:16:3e:62:78:e2", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd60866-9e", "ovs_interfaceid": "2dd60866-9ed8-4840-a797-893d81ab2b65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:33:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-aa53db36-a4a1-40e1-b55b-f53c459f1ad6 req-7a934fa5-78ff-4d34-90f8-1c825cabcfcf service nova] Releasing lock "refresh_cache-16a18fae-165b-487b-bfd5-20097eac0a8e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:33:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:13 user nova-compute[73078]: DEBUG nova.compute.manager [req-662f8d43-7f40-4d24-87d3-6b4be5fb86bc req-0892e1f9-5845-4d31-b160-69355c682033 service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Received event network-vif-plugged-c9ff8bc1-a391-4c5f-826f-a533290f2a98 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:33:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-662f8d43-7f40-4d24-87d3-6b4be5fb86bc req-0892e1f9-5845-4d31-b160-69355c682033 service nova] Acquiring lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:33:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-662f8d43-7f40-4d24-87d3-6b4be5fb86bc req-0892e1f9-5845-4d31-b160-69355c682033 service nova] Lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:33:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-662f8d43-7f40-4d24-87d3-6b4be5fb86bc req-0892e1f9-5845-4d31-b160-69355c682033 service nova] Lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:33:13 user nova-compute[73078]: DEBUG nova.compute.manager [req-662f8d43-7f40-4d24-87d3-6b4be5fb86bc req-0892e1f9-5845-4d31-b160-69355c682033 service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] No waiting events found dispatching network-vif-plugged-c9ff8bc1-a391-4c5f-826f-a533290f2a98 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:33:13 user nova-compute[73078]: WARNING nova.compute.manager [req-662f8d43-7f40-4d24-87d3-6b4be5fb86bc req-0892e1f9-5845-4d31-b160-69355c682033 service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Received unexpected event network-vif-plugged-c9ff8bc1-a391-4c5f-826f-a533290f2a98 for instance with vm_state building and task_state spawning.
Aug 14 18:33:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:15 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037995.0495996, fc7d44f5-3616-4dba-a851-b6f7dddbad32 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:33:15 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] VM Resumed (Lifecycle Event)
Aug 14 18:33:15 user nova-compute[73078]: DEBUG nova.compute.manager [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:33:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:33:15 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Instance spawned successfully.
Aug 14 18:33:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:33:15 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:33:15 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:33:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:33:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:33:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:33:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:33:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:33:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:33:15 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:33:15 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692037995.0509493, fc7d44f5-3616-4dba-a851-b6f7dddbad32 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:33:15 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] VM Started (Lifecycle Event)
Aug 14 18:33:15 user nova-compute[73078]: DEBUG nova.compute.manager [req-68a63a40-29c1-490c-b302-4520c2d78184 req-9d8f3a5f-64a7-4b9a-bec5-6e092c8f8bb3 service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Received event network-vif-plugged-c9ff8bc1-a391-4c5f-826f-a533290f2a98 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:33:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-68a63a40-29c1-490c-b302-4520c2d78184 req-9d8f3a5f-64a7-4b9a-bec5-6e092c8f8bb3 service nova] Acquiring lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:33:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-68a63a40-29c1-490c-b302-4520c2d78184 req-9d8f3a5f-64a7-4b9a-bec5-6e092c8f8bb3 service nova] Lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:33:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-68a63a40-29c1-490c-b302-4520c2d78184 req-9d8f3a5f-64a7-4b9a-bec5-6e092c8f8bb3 service nova] Lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:33:15 user nova-compute[73078]: DEBUG nova.compute.manager [req-68a63a40-29c1-490c-b302-4520c2d78184 req-9d8f3a5f-64a7-4b9a-bec5-6e092c8f8bb3 service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] No waiting events found dispatching network-vif-plugged-c9ff8bc1-a391-4c5f-826f-a533290f2a98 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:33:15 user nova-compute[73078]: WARNING nova.compute.manager [req-68a63a40-29c1-490c-b302-4520c2d78184 req-9d8f3a5f-64a7-4b9a-bec5-6e092c8f8bb3 service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Received unexpected event network-vif-plugged-c9ff8bc1-a391-4c5f-826f-a533290f2a98 for instance with vm_state building and task_state spawning.
Aug 14 18:33:15 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:33:15 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:33:15 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:33:15 user nova-compute[73078]: INFO nova.compute.manager [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Took 5.07 seconds to spawn the instance on the hypervisor.
Aug 14 18:33:15 user nova-compute[73078]: DEBUG nova.compute.manager [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:33:15 user nova-compute[73078]: INFO nova.compute.manager [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Took 26.06 seconds to build instance.
Aug 14 18:33:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-24832ccc-9e1c-490e-8044-841e9405960f tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.165s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:33:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "16a18fae-165b-487b-bfd5-20097eac0a8e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:33:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:33:15 user nova-compute[73078]: DEBUG nova.objects.instance [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lazy-loading 'flavor' on Instance uuid 16a18fae-165b-487b-bfd5-20097eac0a8e {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:33:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:33:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "16a18fae-165b-487b-bfd5-20097eac0a8e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:33:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:33:15 user nova-compute[73078]: INFO nova.compute.manager [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Attaching volume 27eae141-3fe8-455c-9697-6bcfe0fefb99 to /dev/vdb
Aug 14 18:33:16 user nova-compute[73078]: DEBUG os_brick.utils [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:33:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:16 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a81d2a7-9afd-48d8-9e6c-2cea2bea2c44]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.154s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:16 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada88dff-8c54-4577-a4df-c76593f4a59a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:16 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4962a80-fa98-49c5-a663-25e65aed448d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:16 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf8c962-57b2-4325-ac85-d5652237f7fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:33:16 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:33:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:33:16 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:33:16 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e108543-f4d6-4a5c-998b-8de03f680b50]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:16 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:33:16 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:33:16 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:33:16 user nova-compute[73078]: DEBUG os_brick.utils [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] <== get_connector_properties: return (264ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:33:16 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Updating existing volume attachment record: 69329335-36df-4a74-8413-beb0da91601c {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:33:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uwHovVQj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:33:25 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:33:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:33:25 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:33:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:33:25 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[16be0078-026c-4727-b15a-1a23a0c2e160]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:33:25 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[00dbe75a-3e15-4809-8f1e-0a72d15acb2e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99] added
Aug 14 18:33:25 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53a6374-c192-4e7c-a312-423a449f7531]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6a6424-c038-46c3-b187-4e0a68351406]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uwHovVQj {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uwHovVQj" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7dd3be4-3985-4a19-8edd-9b62f355fd75]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uwHovVQj'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e7b21f-c3e2-49d1-ba5b-d5da57f0a014]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7299e3-78ae-4893-afae-4a699fd3af64]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:33:25 user nova-compute[73078]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:33:25 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:33:25 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:33:25 user nova-compute[73078]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:33:25 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:33:25 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e3cfe7-3440-430b-9eef-085500706deb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99, portal: 172.16.0.220,3260]
Aug 14 18:33:25 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99, portal: 172.16.0.220,3260] successful.
Aug 14 18:33:25 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bee863-2cb4-4520-ae84-a6b9136d8b6b]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb4e086-f1af-441f-8bc3-ce0e562698d5]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:33:25 user nova-compute[73078]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:33:25 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:33:25 user nova-compute[73078]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)
Aug 14 18:33:25 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:33:25 user nova-compute[73078]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:33:25 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:33:25 user nova-compute[73078]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)
Aug 14 18:33:25 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] HCTL ('36', '-', '-', 0) found on session 52 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Acquiring lock "2f960239-8deb-4d9f-9cab-eea0274aca38" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f859539-4886-4712-bdbf-2e282e1936d6]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Searching for a device in session 52 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uwHovVQj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG nova.objects.instance [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lazy-loading 'flavor' on Instance uuid 2f960239-8deb-4d9f-9cab-eea0274aca38 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Acquiring lock "2f960239-8deb-4d9f-9cab-eea0274aca38" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:33:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:33:25 user nova-compute[73078]: INFO nova.compute.manager [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Attaching volume ac4e081f-a0bb-4a75-85ce-3ebcfc69e980 to /dev/vdb
Aug 14 18:33:26 user nova-compute[73078]: DEBUG os_brick.utils [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:33:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:26 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[08215ce5-dd2e-458d-9a04-6a02b0e6403d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:26 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e39284-b23e-4dc7-837e-81b09ebe7bdf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:26 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a12156-cf67-4469-8c78-81b893f75b82]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:26 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc56411-f409-4fe3-82b7-f1bfbf966ff8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:33:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:33:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:33:26 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:33:26 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b45aaf6-bfb5-41aa-adff-10a2224339b7]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:33:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:33:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:33:26 user nova-compute[73078]: DEBUG os_brick.utils [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:33:26 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Updating existing volume attachment record: 9310ba62-076c-46a9-98e6-c069132fc018 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:33:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:33:26 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23765656565336333', 'path': '/dev/sde'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:33:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765656565336333', 'path': '/dev/sde'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:33:26 user nova-compute[73078]: DEBUG nova.objects.instance [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lazy-loading 'flavor' on Instance uuid 16a18fae-165b-487b-bfd5-20097eac0a8e {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:33:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 18:33:26 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:33:26 user nova-compute[73078]:   <source dev="/dev/sde"/>
Aug 14 18:33:26 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:33:26 user nova-compute[73078]:   <serial>27eae141-3fe8-455c-9697-6bcfe0fefb99</serial>
Aug 14 18:33:26 user nova-compute[73078]: </disk>
Aug 14 18:33:26 user nova-compute[73078]:  {{(pid=73078) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 18:33:27 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:33:27 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:33:27 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] No VIF found with MAC fa:16:3e:62:78:e2, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:33:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-22d81558-7ee4-4e21-bf20-adf51abbabb3 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.374s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:33:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8cfc5a79-8c78-4331-b169-f2e10178945b tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "16a18fae-165b-487b-bfd5-20097eac0a8e" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:33:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8cfc5a79-8c78-4331-b169-f2e10178945b tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:33:28 user nova-compute[73078]: DEBUG nova.compute.manager [None req-8cfc5a79-8c78-4331-b169-f2e10178945b tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:33:28 user nova-compute[73078]: DEBUG nova.compute.manager [None req-8cfc5a79-8c78-4331-b169-f2e10178945b tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73078) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 14 18:33:28 user nova-compute[73078]: DEBUG nova.objects.instance [None req-8cfc5a79-8c78-4331-b169-f2e10178945b tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lazy-loading 'flavor' on Instance uuid 16a18fae-165b-487b-bfd5-20097eac0a8e {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:33:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:28 user nova-compute[73078]: DEBUG nova.compute.manager [req-8abf394d-4029-4c86-92f5-23dfca252cc4 req-0253f617-6348-42ed-93bd-82c044586dad service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Received event network-vif-unplugged-2dd60866-9ed8-4840-a797-893d81ab2b65 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:33:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-8abf394d-4029-4c86-92f5-23dfca252cc4 req-0253f617-6348-42ed-93bd-82c044586dad service nova] Acquiring lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:33:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-8abf394d-4029-4c86-92f5-23dfca252cc4 req-0253f617-6348-42ed-93bd-82c044586dad service nova] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:33:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-8abf394d-4029-4c86-92f5-23dfca252cc4 req-0253f617-6348-42ed-93bd-82c044586dad service nova] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:33:28 user nova-compute[73078]: DEBUG nova.compute.manager [req-8abf394d-4029-4c86-92f5-23dfca252cc4 req-0253f617-6348-42ed-93bd-82c044586dad service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] No waiting events found dispatching network-vif-unplugged-2dd60866-9ed8-4840-a797-893d81ab2b65 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:33:28 user nova-compute[73078]: WARNING nova.compute.manager [req-8abf394d-4029-4c86-92f5-23dfca252cc4 req-0253f617-6348-42ed-93bd-82c044586dad service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Received unexpected event network-vif-unplugged-2dd60866-9ed8-4840-a797-893d81ab2b65 for instance with vm_state active and task_state powering-off.
Aug 14 18:33:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:28 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Instance destroyed successfully.
Aug 14 18:33:28 user nova-compute[73078]: DEBUG nova.compute.manager [None req-8cfc5a79-8c78-4331-b169-f2e10178945b tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:33:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8cfc5a79-8c78-4331-b169-f2e10178945b tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.883s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:33:30 user nova-compute[73078]: DEBUG nova.compute.manager [req-0e188183-6819-4722-a2d9-c103d2521791 req-1b37dd2b-afde-4bd6-af76-2aad32d41151 service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Received event network-vif-plugged-2dd60866-9ed8-4840-a797-893d81ab2b65 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:33:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0e188183-6819-4722-a2d9-c103d2521791 req-1b37dd2b-afde-4bd6-af76-2aad32d41151 service nova] Acquiring lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:33:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0e188183-6819-4722-a2d9-c103d2521791 req-1b37dd2b-afde-4bd6-af76-2aad32d41151 service nova] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:33:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0e188183-6819-4722-a2d9-c103d2521791 req-1b37dd2b-afde-4bd6-af76-2aad32d41151 service nova] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:33:30 user nova-compute[73078]: DEBUG nova.compute.manager [req-0e188183-6819-4722-a2d9-c103d2521791 req-1b37dd2b-afde-4bd6-af76-2aad32d41151 service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] No waiting events found dispatching network-vif-plugged-2dd60866-9ed8-4840-a797-893d81ab2b65 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:33:30 user nova-compute[73078]: WARNING nova.compute.manager [req-0e188183-6819-4722-a2d9-c103d2521791 req-1b37dd2b-afde-4bd6-af76-2aad32d41151 service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Received unexpected event network-vif-plugged-2dd60866-9ed8-4840-a797-893d81ab2b65 for instance with vm_state stopped and task_state None.
Aug 14 18:33:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LftJDGRB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:33:35 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:33:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:33:35 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:33:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:33:35 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:33:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d8d421-eefd-4f81-a199-a732bc0b6844]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:33:35 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[994ccef1-f551-40d0-a692-24c6ac855561]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980] added
Aug 14 18:33:35 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1451aff5-a363-4a5a-b174-6b6dde5f43d8]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[479d0bf7-ac6f-4380-b716-ddc7e11a59b8]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LftJDGRB {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LftJDGRB" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab1ed1f-894b-4dae-82ce-91a315d1d1e8]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LftJDGRB'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2db88f-99e6-4c57-a253-60a6011f1df5]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edb9b5d-c16b-4483-8237-3eeeaad14bf8]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:33:35 user nova-compute[73078]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:33:35 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:33:35 user nova-compute[73078]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)
Aug 14 18:33:35 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:33:35 user nova-compute[73078]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:33:35 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:33:35 user nova-compute[73078]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)
Aug 14 18:33:35 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf37467d-590c-4afb-a616-cae342fb3d0e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980, portal: 172.16.0.220,3260]
Aug 14 18:33:35 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980, portal: 172.16.0.220,3260] successful.
Aug 14 18:33:35 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a27a14-519b-4002-a7a2-890f35357711]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c306535-31ca-4409-b743-f3cc170aadff]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:33:35 user nova-compute[73078]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:33:35 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:33:35 user nova-compute[73078]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)
Aug 14 18:33:35 user nova-compute[73078]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980 (non-flash)
Aug 14 18:33:35 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:33:35 user nova-compute[73078]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:33:35 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:33:35 user nova-compute[73078]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)
Aug 14 18:33:35 user nova-compute[73078]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980 (non-flash)
Aug 14 18:33:35 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] HCTL ('37', '-', '-', 0) found on session 53 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a85d30-ae1c-4442-9299-99f2893b8e5d]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:35 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Searching for a device in session 53 and hctl ['37', '*', '*', 0] yield: None {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:33:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:36 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Searching for a device in session 53 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:33:36 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LftJDGRB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:33:36 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:33:36 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26438633434316632', 'path': '/dev/sdf'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:33:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438633434316632', 'path': '/dev/sdf'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:33:36 user nova-compute[73078]: DEBUG nova.objects.instance [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lazy-loading 'flavor' on Instance uuid 2f960239-8deb-4d9f-9cab-eea0274aca38 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:33:36 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 18:33:36 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:33:36 user nova-compute[73078]:   <source dev="/dev/sdf"/>
Aug 14 18:33:36 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:33:36 user nova-compute[73078]:   <serial>ac4e081f-a0bb-4a75-85ce-3ebcfc69e980</serial>
Aug 14 18:33:36 user nova-compute[73078]: </disk>
Aug 14 18:33:36 user nova-compute[73078]:  {{(pid=73078) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 18:33:37 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:33:37 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:33:37 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] No VIF found with MAC fa:16:3e:38:ed:9c, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:33:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-18b1a3e5-46c1-4333-9714-34a2c6a687f7 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.260s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:33:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b574cc43-2053-42f2-b6fe-f53c201775b2 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Acquiring lock "2f960239-8deb-4d9f-9cab-eea0274aca38" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:33:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b574cc43-2053-42f2-b6fe-f53c201775b2 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:33:39 user nova-compute[73078]: INFO nova.compute.manager [None req-b574cc43-2053-42f2-b6fe-f53c201775b2 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Detaching volume ac4e081f-a0bb-4a75-85ce-3ebcfc69e980
Aug 14 18:33:39 user nova-compute[73078]: INFO nova.virt.block_device [None req-b574cc43-2053-42f2-b6fe-f53c201775b2 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Attempting to driver detach volume ac4e081f-a0bb-4a75-85ce-3ebcfc69e980 from mountpoint /dev/vdb
Aug 14 18:33:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b574cc43-2053-42f2-b6fe-f53c201775b2 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Attempting to detach device vdb from instance 2f960239-8deb-4d9f-9cab-eea0274aca38 from the persistent domain config. {{(pid=73078) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 18:33:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-b574cc43-2053-42f2-b6fe-f53c201775b2 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:33:39 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:33:39 user nova-compute[73078]:   <source dev="/dev/sdf"/>
Aug 14 18:33:39 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:33:39 user nova-compute[73078]:   <serial>ac4e081f-a0bb-4a75-85ce-3ebcfc69e980</serial>
Aug 14 18:33:39 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:33:39 user nova-compute[73078]: </disk>
Aug 14 18:33:39 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:33:39 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-b574cc43-2053-42f2-b6fe-f53c201775b2 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Successfully detached device vdb from instance 2f960239-8deb-4d9f-9cab-eea0274aca38 from the persistent domain config.
Aug 14 18:33:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b574cc43-2053-42f2-b6fe-f53c201775b2 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2f960239-8deb-4d9f-9cab-eea0274aca38 from the live domain config. {{(pid=73078) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 18:33:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-b574cc43-2053-42f2-b6fe-f53c201775b2 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:33:39 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:33:39 user nova-compute[73078]:   <source dev="/dev/sdf"/>
Aug 14 18:33:39 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:33:39 user nova-compute[73078]:   <serial>ac4e081f-a0bb-4a75-85ce-3ebcfc69e980</serial>
Aug 14 18:33:39 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:33:39 user nova-compute[73078]: </disk>
Aug 14 18:33:39 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:33:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Received event <DeviceRemovedEvent: 1692038019.807848, 2f960239-8deb-4d9f-9cab-eea0274aca38 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73078) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 18:33:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-b574cc43-2053-42f2-b6fe-f53c201775b2 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2f960239-8deb-4d9f-9cab-eea0274aca38 {{(pid=73078) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 18:33:39 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-b574cc43-2053-42f2-b6fe-f53c201775b2 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Successfully detached device vdb from instance 2f960239-8deb-4d9f-9cab-eea0274aca38 from the live domain config.
Aug 14 18:33:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b574cc43-2053-42f2-b6fe-f53c201775b2 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:33:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b574cc43-2053-42f2-b6fe-f53c201775b2 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LftJDGRB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:33:39 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-b574cc43-2053-42f2-b6fe-f53c201775b2 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:33:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-b574cc43-2053-42f2-b6fe-f53c201775b2 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:33:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-b574cc43-2053-42f2-b6fe-f53c201775b2 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:33:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b574cc43-2053-42f2-b6fe-f53c201775b2 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:33:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5487cf6-237e-4669-b12e-08579b413594]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcfd517-edca-4cc9-b2ee-c2dfef6c72db]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b574cc43-2053-42f2-b6fe-f53c201775b2 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:33:39 user nova-compute[73078]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:33:39 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:33:39 user nova-compute[73078]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)
Aug 14 18:33:39 user nova-compute[73078]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980 (non-flash)
Aug 14 18:33:39 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:33:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b574cc43-2053-42f2-b6fe-f53c201775b2 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:33:39 user nova-compute[73078]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:33:39 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:33:39 user nova-compute[73078]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)
Aug 14 18:33:39 user nova-compute[73078]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980 (non-flash)
Aug 14 18:33:39 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:33:39 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b574cc43-2053-42f2-b6fe-f53c201775b2 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe97879c8b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980'): ({'sdf'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:33:39 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-b574cc43-2053-42f2-b6fe-f53c201775b2 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Removing single pathed devices sdf {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:33:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[377fcea2-5525-4a4e-94c4-53c1e0d5883f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1008de-876e-43a3-9171-8e3e5f92fb99]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:39 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-b574cc43-2053-42f2-b6fe-f53c201775b2 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Flushing IO for device /dev/sdf {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:33:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:39 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f172f31-7e19-4e36-a851-499f9c026af7]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:39 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-b574cc43-2053-42f2-b6fe-f53c201775b2 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:33:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39edd33-6358-4d7c-82a0-68da88f37c57]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:40 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-b574cc43-2053-42f2-b6fe-f53c201775b2 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:33:40 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-b574cc43-2053-42f2-b6fe-f53c201775b2 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] SCSI volumes sdf have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:33:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b574cc43-2053-42f2-b6fe-f53c201775b2 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:33:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[457295e6-7501-4fc1-ad9f-cfed230eb88c]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b574cc43-2053-42f2-b6fe-f53c201775b2 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:33:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[85119dee-ffb5-4976-a636-a49204fa9f09]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b574cc43-2053-42f2-b6fe-f53c201775b2 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980, portal: 172.16.0.220,3260]
Aug 14 18:33:40 user nova-compute[73078]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980, portal: 172.16.0.220,3260] successful.
Aug 14 18:33:40 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:33:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:33:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac4e081f-a0bb-4a75-85ce-3ebcfc69e980 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:33:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0e015f-fdb0-4f83-81e8-2affd34ef0dd]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:33:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b574cc43-2053-42f2-b6fe-f53c201775b2 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:33:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-b574cc43-2053-42f2-b6fe-f53c201775b2 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:33:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-b574cc43-2053-42f2-b6fe-f53c201775b2 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] <== disconnect_volume: return (332ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:33:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b574cc43-2053-42f2-b6fe-f53c201775b2 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:33:41 user nova-compute[73078]: DEBUG nova.objects.instance [None req-b574cc43-2053-42f2-b6fe-f53c201775b2 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lazy-loading 'flavor' on Instance uuid 2f960239-8deb-4d9f-9cab-eea0274aca38 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:33:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-b574cc43-2053-42f2-b6fe-f53c201775b2 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.788s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:33:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:43 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:43 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692038008.8632026, 16a18fae-165b-487b-bfd5-20097eac0a8e => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:33:43 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] VM Stopped (Lifecycle Event)
Aug 14 18:33:43 user nova-compute[73078]: DEBUG nova.compute.manager [None req-264174e7-dedf-44bb-9570-daaf893dba1a None None] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:33:43 user nova-compute[73078]: DEBUG nova.compute.manager [None req-264174e7-dedf-44bb-9570-daaf893dba1a None None] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:33:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:33:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:34:00 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:34:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:34:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:34:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:34:00 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:34:00 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:34:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:00 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:34:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:34:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bb1bc98-12ee-4a5b-91db-6e66966c482f/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bb1bc98-12ee-4a5b-91db-6e66966c482f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bb1bc98-12ee-4a5b-91db-6e66966c482f/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bb1bc98-12ee-4a5b-91db-6e66966c482f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:34:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:34:02 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:34:02 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:34:02 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=7936MB free_disk=24.930706024169922GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:34:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:34:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:34:02 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 61dfe42b-c943-4617-bf8e-745eaf1a1bb8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:34:02 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 3088da30-65b7-4801-b425-93df4fca6ad8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:34:02 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 2f960239-8deb-4d9f-9cab-eea0274aca38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:34:02 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance ebbaec07-9843-4cc0-bcb6-f993e62d88c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:34:02 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 16a18fae-165b-487b-bfd5-20097eac0a8e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:34:02 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 8bb1bc98-12ee-4a5b-91db-6e66966c482f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:34:02 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 631dc4c9-0df2-480b-952c-c088007703df actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:34:02 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance fc7d44f5-3616-4dba-a851-b6f7dddbad32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:34:02 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:34:02 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:34:02 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:34:02 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:34:02 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:34:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.388s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:34:03 user nova-compute[73078]: DEBUG nova.compute.manager [req-5dddb484-e836-4ef4-9dc2-1a1f7b8b27c9 req-28b19b16-196a-4840-96d7-fd8640c1d7a5 service nova] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Received event network-changed-3e131470-acea-41bf-80c0-e2d7eaa98d3f {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:34:03 user nova-compute[73078]: DEBUG nova.compute.manager [req-5dddb484-e836-4ef4-9dc2-1a1f7b8b27c9 req-28b19b16-196a-4840-96d7-fd8640c1d7a5 service nova] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Refreshing instance network info cache due to event network-changed-3e131470-acea-41bf-80c0-e2d7eaa98d3f. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:34:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5dddb484-e836-4ef4-9dc2-1a1f7b8b27c9 req-28b19b16-196a-4840-96d7-fd8640c1d7a5 service nova] Acquiring lock "refresh_cache-8bb1bc98-12ee-4a5b-91db-6e66966c482f" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:34:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5dddb484-e836-4ef4-9dc2-1a1f7b8b27c9 req-28b19b16-196a-4840-96d7-fd8640c1d7a5 service nova] Acquired lock "refresh_cache-8bb1bc98-12ee-4a5b-91db-6e66966c482f" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:34:03 user nova-compute[73078]: DEBUG nova.network.neutron [req-5dddb484-e836-4ef4-9dc2-1a1f7b8b27c9 req-28b19b16-196a-4840-96d7-fd8640c1d7a5 service nova] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Refreshing network info cache for port 3e131470-acea-41bf-80c0-e2d7eaa98d3f {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:34:03 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:34:03 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:34:04 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:34:04 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:34:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-2f960239-8deb-4d9f-9cab-eea0274aca38" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:34:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-2f960239-8deb-4d9f-9cab-eea0274aca38" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:34:04 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:34:04 user nova-compute[73078]: DEBUG nova.network.neutron [req-5dddb484-e836-4ef4-9dc2-1a1f7b8b27c9 req-28b19b16-196a-4840-96d7-fd8640c1d7a5 service nova] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Updated VIF entry in instance network info cache for port 3e131470-acea-41bf-80c0-e2d7eaa98d3f. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:34:04 user nova-compute[73078]: DEBUG nova.network.neutron [req-5dddb484-e836-4ef4-9dc2-1a1f7b8b27c9 req-28b19b16-196a-4840-96d7-fd8640c1d7a5 service nova] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Updating instance_info_cache with network_info: [{"id": "3e131470-acea-41bf-80c0-e2d7eaa98d3f", "address": "fa:16:3e:ff:7b:5b", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e131470-ac", "ovs_interfaceid": "3e131470-acea-41bf-80c0-e2d7eaa98d3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:34:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5dddb484-e836-4ef4-9dc2-1a1f7b8b27c9 req-28b19b16-196a-4840-96d7-fd8640c1d7a5 service nova] Releasing lock "refresh_cache-8bb1bc98-12ee-4a5b-91db-6e66966c482f" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:34:04 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Updating instance_info_cache with network_info: [{"id": "665b631d-4caf-4f3f-8c30-3a8ab77e79c0", "address": "fa:16:3e:38:ed:9c", "network": {"id": "9231db47-733a-46df-876b-ee8ed8157a6e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1021535791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c449c8c411c34206af9251f78b912565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665b631d-4c", "ovs_interfaceid": "665b631d-4caf-4f3f-8c30-3a8ab77e79c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:34:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-2f960239-8deb-4d9f-9cab-eea0274aca38" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:34:04 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:34:04 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:34:05 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:34:06 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:34:06 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:34:06 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:34:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:34:07 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:34:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:34:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "8bb1bc98-12ee-4a5b-91db-6e66966c482f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:34:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "8bb1bc98-12ee-4a5b-91db-6e66966c482f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:34:08 user nova-compute[73078]: DEBUG nova.objects.instance [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lazy-loading 'flavor' on Instance uuid 8bb1bc98-12ee-4a5b-91db-6e66966c482f {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:34:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "8bb1bc98-12ee-4a5b-91db-6e66966c482f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:34:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "8bb1bc98-12ee-4a5b-91db-6e66966c482f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:34:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "8bb1bc98-12ee-4a5b-91db-6e66966c482f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:34:08 user nova-compute[73078]: INFO nova.compute.manager [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Attaching volume fdbd892a-dbc8-41e7-8e5f-77e7dee45f75 to /dev/vdb
Aug 14 18:34:08 user nova-compute[73078]: DEBUG os_brick.utils [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:34:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:09 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed19008-1a9b-4fa6-a8b1-4f31d3864ce9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:09 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[662bd3e6-bb67-435c-a5df-ec02c03c793f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:09 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23314f3-1a85-4c19-bb5f-669510f25785]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:09 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d8487a-e4a2-4ff9-ba98-f8b0d60f18fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:34:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:34:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:34:09 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:34:09 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8897f82-da7f-46ad-b38c-6810f212c13e]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:34:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:34:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:34:09 user nova-compute[73078]: DEBUG os_brick.utils [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:34:09 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Updating existing volume attachment record: 4624e221-ce70-4727-86d8-4ef7b87479e0 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:34:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:34:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:34:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:34:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:34:17 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VcmeJQMG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:34:17 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:34:17 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:34:17 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:34:17 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:34:17 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:34:17 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:34:17 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:34:17 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9eb8d8-73f6-423d-be7d-a1d2243b23ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:34:18 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5c348b-37c9-413e-8dca-c56d02705fb6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75] added
Aug 14 18:34:18 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e2ffb0-b9f0-40c2-ad22-e3fad3079963]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b1e7b4-7d76-49bd-8a86-e297833b54d2]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VcmeJQMG {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VcmeJQMG" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[de861622-ae1a-49a4-b0ec-7f07b0f65e0e]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VcmeJQMG'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6827c0e-3701-4db2-9508-2a7e4c9859d5]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1fc5fb-276e-4529-87e9-7a16a83d539d]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:34:18 user nova-compute[73078]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:34:18 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:34:18 user nova-compute[73078]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)
Aug 14 18:34:18 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:34:18 user nova-compute[73078]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:34:18 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:34:18 user nova-compute[73078]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)
Aug 14 18:34:18 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee75966-918b-4937-ac5a-2f354a3e1607]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75, portal: 172.16.0.220,3260]
Aug 14 18:34:18 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75, portal: 172.16.0.220,3260] successful.
Aug 14 18:34:18 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bf56be-5435-4f2b-b5fa-7f50c8e03b82]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[917cc5f7-3c4a-4c8b-8fde-fdf43beac4ba]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:34:18 user nova-compute[73078]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:34:18 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:34:18 user nova-compute[73078]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)
Aug 14 18:34:18 user nova-compute[73078]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75 (non-flash)
Aug 14 18:34:18 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:34:18 user nova-compute[73078]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:34:18 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:34:18 user nova-compute[73078]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)
Aug 14 18:34:18 user nova-compute[73078]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75 (non-flash)
Aug 14 18:34:18 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] HCTL ('37', '-', '-', 0) found on session 54 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d689cf-92c8-46fe-9bf3-518aa22b5859]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Searching for a device in session 54 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VcmeJQMG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:34:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:34:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:34:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23332653137353936', 'path': '/dev/sdf'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:34:19 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332653137353936', 'path': '/dev/sdf'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:34:19 user nova-compute[73078]: DEBUG nova.objects.instance [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lazy-loading 'flavor' on Instance uuid 8bb1bc98-12ee-4a5b-91db-6e66966c482f {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:34:19 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 18:34:19 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:34:19 user nova-compute[73078]:   <source dev="/dev/sdf"/>
Aug 14 18:34:19 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:34:19 user nova-compute[73078]:   <serial>fdbd892a-dbc8-41e7-8e5f-77e7dee45f75</serial>
Aug 14 18:34:19 user nova-compute[73078]: </disk>
Aug 14 18:34:19 user nova-compute[73078]:  {{(pid=73078) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 18:34:19 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:34:19 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:34:19 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] No VIF found with MAC fa:16:3e:ff:7b:5b, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:34:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-47e8a56f-256c-474f-84ba-ae55c56fe56e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "8bb1bc98-12ee-4a5b-91db-6e66966c482f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.009s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-315bb42b-6fad-48ec-9a48-454126eb82ff tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "8bb1bc98-12ee-4a5b-91db-6e66966c482f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-315bb42b-6fad-48ec-9a48-454126eb82ff tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "8bb1bc98-12ee-4a5b-91db-6e66966c482f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:34:21 user nova-compute[73078]: INFO nova.compute.manager [None req-315bb42b-6fad-48ec-9a48-454126eb82ff tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Detaching volume fdbd892a-dbc8-41e7-8e5f-77e7dee45f75
Aug 14 18:34:21 user nova-compute[73078]: INFO nova.virt.block_device [None req-315bb42b-6fad-48ec-9a48-454126eb82ff tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Attempting to driver detach volume fdbd892a-dbc8-41e7-8e5f-77e7dee45f75 from mountpoint /dev/vdb
Aug 14 18:34:21 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-315bb42b-6fad-48ec-9a48-454126eb82ff tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Attempting to detach device vdb from instance 8bb1bc98-12ee-4a5b-91db-6e66966c482f from the persistent domain config. {{(pid=73078) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-315bb42b-6fad-48ec-9a48-454126eb82ff tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:34:21 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:34:21 user nova-compute[73078]:   <source dev="/dev/sdf"/>
Aug 14 18:34:21 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:34:21 user nova-compute[73078]:   <serial>fdbd892a-dbc8-41e7-8e5f-77e7dee45f75</serial>
Aug 14 18:34:21 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:34:21 user nova-compute[73078]: </disk>
Aug 14 18:34:21 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:34:21 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-315bb42b-6fad-48ec-9a48-454126eb82ff tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Successfully detached device vdb from instance 8bb1bc98-12ee-4a5b-91db-6e66966c482f from the persistent domain config.
Aug 14 18:34:21 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-315bb42b-6fad-48ec-9a48-454126eb82ff tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8bb1bc98-12ee-4a5b-91db-6e66966c482f from the live domain config. {{(pid=73078) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-315bb42b-6fad-48ec-9a48-454126eb82ff tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:34:21 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:34:21 user nova-compute[73078]:   <source dev="/dev/sdf"/>
Aug 14 18:34:21 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:34:21 user nova-compute[73078]:   <serial>fdbd892a-dbc8-41e7-8e5f-77e7dee45f75</serial>
Aug 14 18:34:21 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:34:21 user nova-compute[73078]: </disk>
Aug 14 18:34:21 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Received event <DeviceRemovedEvent: 1692038061.603988, 8bb1bc98-12ee-4a5b-91db-6e66966c482f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73078) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-315bb42b-6fad-48ec-9a48-454126eb82ff tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8bb1bc98-12ee-4a5b-91db-6e66966c482f {{(pid=73078) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 18:34:21 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-315bb42b-6fad-48ec-9a48-454126eb82ff tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Successfully detached device vdb from instance 8bb1bc98-12ee-4a5b-91db-6e66966c482f from the live domain config.
Aug 14 18:34:21 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-315bb42b-6fad-48ec-9a48-454126eb82ff tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-315bb42b-6fad-48ec-9a48-454126eb82ff tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VcmeJQMG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:34:21 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-315bb42b-6fad-48ec-9a48-454126eb82ff tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:34:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-315bb42b-6fad-48ec-9a48-454126eb82ff tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-315bb42b-6fad-48ec-9a48-454126eb82ff tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-315bb42b-6fad-48ec-9a48-454126eb82ff tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d93aa83-5587-4cef-bf81-e44cfb28068a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[051f7006-b48e-4a5f-9ec7-1c5f671094a8]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-315bb42b-6fad-48ec-9a48-454126eb82ff tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:34:21 user nova-compute[73078]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:34:21 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:34:21 user nova-compute[73078]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)
Aug 14 18:34:21 user nova-compute[73078]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75 (non-flash)
Aug 14 18:34:21 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-315bb42b-6fad-48ec-9a48-454126eb82ff tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:34:21 user nova-compute[73078]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:34:21 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:34:21 user nova-compute[73078]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)
Aug 14 18:34:21 user nova-compute[73078]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75 (non-flash)
Aug 14 18:34:21 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-315bb42b-6fad-48ec-9a48-454126eb82ff tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9547b4e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75'): ({'sdf'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-315bb42b-6fad-48ec-9a48-454126eb82ff tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Removing single pathed devices sdf {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06f49a4-5372-474e-8c0e-1a5bf24099a9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4577ece-86c7-4f70-8abc-b10ef78fd046]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-315bb42b-6fad-48ec-9a48-454126eb82ff tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Flushing IO for device /dev/sdf {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[85abe6d6-982d-4a79-a656-a1fe1c83dccc]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-315bb42b-6fad-48ec-9a48-454126eb82ff tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[094a2120-73e2-4031-bd1e-6d677bb0b901]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-315bb42b-6fad-48ec-9a48-454126eb82ff tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-315bb42b-6fad-48ec-9a48-454126eb82ff tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] SCSI volumes sdf have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-315bb42b-6fad-48ec-9a48-454126eb82ff tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c208a260-0cf6-43e6-958c-7b586f3b3efd]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-315bb42b-6fad-48ec-9a48-454126eb82ff tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbe9126-57b2-49d4-8770-e9c9bb6fe1e7]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-315bb42b-6fad-48ec-9a48-454126eb82ff tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75, portal: 172.16.0.220,3260]
Aug 14 18:34:21 user nova-compute[73078]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75, portal: 172.16.0.220,3260] successful.
Aug 14 18:34:21 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdbd892a-dbc8-41e7-8e5f-77e7dee45f75 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec8ba36-99e4-4da4-bae9-cb0177addee6]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-315bb42b-6fad-48ec-9a48-454126eb82ff tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-315bb42b-6fad-48ec-9a48-454126eb82ff tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-315bb42b-6fad-48ec-9a48-454126eb82ff tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] <== disconnect_volume: return (291ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:34:21 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-315bb42b-6fad-48ec-9a48-454126eb82ff tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:34:22 user nova-compute[73078]: DEBUG nova.objects.instance [None req-315bb42b-6fad-48ec-9a48-454126eb82ff tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lazy-loading 'flavor' on Instance uuid 8bb1bc98-12ee-4a5b-91db-6e66966c482f {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:34:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-315bb42b-6fad-48ec-9a48-454126eb82ff tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "8bb1bc98-12ee-4a5b-91db-6e66966c482f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.573s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:34:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:34:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:34:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:34:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:34:39 user nova-compute[73078]: INFO nova.compute.manager [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Rescuing
Aug 14 18:34:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "refresh_cache-fc7d44f5-3616-4dba-a851-b6f7dddbad32" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:34:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquired lock "refresh_cache-fc7d44f5-3616-4dba-a851-b6f7dddbad32" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:34:40 user nova-compute[73078]: DEBUG nova.network.neutron [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:34:40 user nova-compute[73078]: DEBUG nova.compute.manager [req-70f2d6fb-5109-464f-ad6f-0ce95b9e6871 req-30c7553b-090d-4a66-b6b5-53409a4b1a13 service nova] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Received event network-changed-f1a22a14-2365-4acb-8349-4fa3ec865bae {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:34:40 user nova-compute[73078]: DEBUG nova.compute.manager [req-70f2d6fb-5109-464f-ad6f-0ce95b9e6871 req-30c7553b-090d-4a66-b6b5-53409a4b1a13 service nova] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Refreshing instance network info cache due to event network-changed-f1a22a14-2365-4acb-8349-4fa3ec865bae. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:34:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-70f2d6fb-5109-464f-ad6f-0ce95b9e6871 req-30c7553b-090d-4a66-b6b5-53409a4b1a13 service nova] Acquiring lock "refresh_cache-631dc4c9-0df2-480b-952c-c088007703df" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:34:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-70f2d6fb-5109-464f-ad6f-0ce95b9e6871 req-30c7553b-090d-4a66-b6b5-53409a4b1a13 service nova] Acquired lock "refresh_cache-631dc4c9-0df2-480b-952c-c088007703df" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:34:40 user nova-compute[73078]: DEBUG nova.network.neutron [req-70f2d6fb-5109-464f-ad6f-0ce95b9e6871 req-30c7553b-090d-4a66-b6b5-53409a4b1a13 service nova] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Refreshing network info cache for port f1a22a14-2365-4acb-8349-4fa3ec865bae {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:34:40 user nova-compute[73078]: DEBUG nova.network.neutron [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Updating instance_info_cache with network_info: [{"id": "c9ff8bc1-a391-4c5f-826f-a533290f2a98", "address": "fa:16:3e:e7:4a:6c", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ff8bc1-a3", "ovs_interfaceid": "c9ff8bc1-a391-4c5f-826f-a533290f2a98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:34:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Releasing lock "refresh_cache-fc7d44f5-3616-4dba-a851-b6f7dddbad32" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:34:40 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:34:40 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:34:41 user nova-compute[73078]: DEBUG nova.compute.manager [req-773f0088-cec7-4a12-ab82-d76157ea6edb req-0115e17e-c647-483e-ab22-096e33a8db98 service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Received event network-vif-unplugged-c9ff8bc1-a391-4c5f-826f-a533290f2a98 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:34:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-773f0088-cec7-4a12-ab82-d76157ea6edb req-0115e17e-c647-483e-ab22-096e33a8db98 service nova] Acquiring lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:34:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-773f0088-cec7-4a12-ab82-d76157ea6edb req-0115e17e-c647-483e-ab22-096e33a8db98 service nova] Lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:34:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-773f0088-cec7-4a12-ab82-d76157ea6edb req-0115e17e-c647-483e-ab22-096e33a8db98 service nova] Lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:34:41 user nova-compute[73078]: DEBUG nova.compute.manager [req-773f0088-cec7-4a12-ab82-d76157ea6edb req-0115e17e-c647-483e-ab22-096e33a8db98 service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] No waiting events found dispatching network-vif-unplugged-c9ff8bc1-a391-4c5f-826f-a533290f2a98 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:34:41 user nova-compute[73078]: WARNING nova.compute.manager [req-773f0088-cec7-4a12-ab82-d76157ea6edb req-0115e17e-c647-483e-ab22-096e33a8db98 service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Received unexpected event network-vif-unplugged-c9ff8bc1-a391-4c5f-826f-a533290f2a98 for instance with vm_state active and task_state rescuing.
Aug 14 18:34:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:34:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:34:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "631dc4c9-0df2-480b-952c-c088007703df" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:34:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "631dc4c9-0df2-480b-952c-c088007703df" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:34:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "631dc4c9-0df2-480b-952c-c088007703df-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:34:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "631dc4c9-0df2-480b-952c-c088007703df-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:34:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "631dc4c9-0df2-480b-952c-c088007703df-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:34:41 user nova-compute[73078]: INFO nova.compute.manager [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Terminating instance
Aug 14 18:34:41 user nova-compute[73078]: DEBUG nova.compute.manager [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:34:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:34:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:34:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:34:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:34:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:34:41 user nova-compute[73078]: DEBUG nova.network.neutron [req-70f2d6fb-5109-464f-ad6f-0ce95b9e6871 req-30c7553b-090d-4a66-b6b5-53409a4b1a13 service nova] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Updated VIF entry in instance network info cache for port f1a22a14-2365-4acb-8349-4fa3ec865bae. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:34:41 user nova-compute[73078]: DEBUG nova.network.neutron [req-70f2d6fb-5109-464f-ad6f-0ce95b9e6871 req-30c7553b-090d-4a66-b6b5-53409a4b1a13 service nova] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Updating instance_info_cache with network_info: [{"id": "f1a22a14-2365-4acb-8349-4fa3ec865bae", "address": "fa:16:3e:16:f2:61", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a22a14-23", "ovs_interfaceid": "f1a22a14-2365-4acb-8349-4fa3ec865bae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:34:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-70f2d6fb-5109-464f-ad6f-0ce95b9e6871 req-30c7553b-090d-4a66-b6b5-53409a4b1a13 service nova] Releasing lock "refresh_cache-631dc4c9-0df2-480b-952c-c088007703df" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:34:41 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Instance destroyed successfully.
Aug 14 18:34:41 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Attempting a stable device rescue
Aug 14 18:34:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:34:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73078) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 18:34:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Instance directory exists: not creating {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 18:34:41 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Creating image(s)
Aug 14 18:34:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc7d44f5-3616-4dba-a851-b6f7dddbad32/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:34:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "/opt/stack/data/nova/instances/fc7d44f5-3616-4dba-a851-b6f7dddbad32/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:34:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "/opt/stack/data/nova/instances/fc7d44f5-3616-4dba-a851-b6f7dddbad32/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:34:41 user nova-compute[73078]: DEBUG nova.objects.instance [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lazy-loading 'trusted_certs' on Instance uuid fc7d44f5-3616-4dba-a851-b6f7dddbad32 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:34:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "7525cdc2f4a31c89032b5077a27a0a9b409a3807" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:34:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "7525cdc2f4a31c89032b5077a27a0a9b409a3807" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7525cdc2f4a31c89032b5077a27a0a9b409a3807.part --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:34:42 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Instance destroyed successfully.
Aug 14 18:34:42 user nova-compute[73078]: DEBUG nova.objects.instance [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lazy-loading 'resources' on Instance uuid 631dc4c9-0df2-480b-952c-c088007703df {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:32:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-850621936',display_name='tempest-TestVolumeBootPattern-server-850621936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-850621936',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU8q8wtxkW9pROl2j0NkoRwpKKcmziB/20QEkNRAKEXt/Sm0AgtPtqW4EQeZ9Nz+9SI3khJoGje9+NMiFY56dE76HSwv/RbWY1Ab2OSscMaXE4ftFHwz3mwUt13yK/iVg==',key_name='tempest-TestVolumeBootPattern-511986969',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:33:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7142101014c4defa7261a34fb9f28e4',ramdisk_id='',reservation_id='r-tbblo0qz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1889877750',owner_user_name='tempest-TestVolumeBootPattern-1889877750-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:33:03Z,user_data=None,user_id='fe79455616584e0fb80e6007edf0b706',uuid=631dc4c9-0df2-480b-952c-c088007703df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1a22a14-2365-4acb-8349-4fa3ec865bae", "address": "fa:16:3e:16:f2:61", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a22a14-23", "ovs_interfaceid": "f1a22a14-2365-4acb-8349-4fa3ec865bae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Converting VIF {"id": "f1a22a14-2365-4acb-8349-4fa3ec865bae", "address": "fa:16:3e:16:f2:61", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a22a14-23", "ovs_interfaceid": "f1a22a14-2365-4acb-8349-4fa3ec865bae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:f2:61,bridge_name='br-int',has_traffic_filtering=True,id=f1a22a14-2365-4acb-8349-4fa3ec865bae,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1a22a14-23') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG os_vif [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:f2:61,bridge_name='br-int',has_traffic_filtering=True,id=f1a22a14-2365-4acb-8349-4fa3ec865bae,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1a22a14-23') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1a22a14-23, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:34:42 user nova-compute[73078]: INFO os_vif [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:f2:61,bridge_name='br-int',has_traffic_filtering=True,id=f1a22a14-2365-4acb-8349-4fa3ec865bae,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1a22a14-23')
Aug 14 18:34:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lEybjUpx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:34:42 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:34:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df03e0f-7506-4e59-80af-e20cff795e0a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7525cdc2f4a31c89032b5077a27a0a9b409a3807.part --force-share --output=json" returned: 0 in 0.186s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG nova.virt.images [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] bc9e0ab1-4133-45ce-9d88-7035f5d1094f was qcow2, converting to raw {{(pid=73078) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG nova.privsep.utils [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73078) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7525cdc2f4a31c89032b5077a27a0a9b409a3807.part /opt/stack/data/nova/instances/_base/7525cdc2f4a31c89032b5077a27a0a9b409a3807.converted {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd53286e-f73d-4118-8e10-ba6c31c0b191]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:34:42 user nova-compute[73078]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:34:42 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:34:42 user nova-compute[73078]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)
Aug 14 18:34:42 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:34:42 user nova-compute[73078]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:34:42 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:34:42 user nova-compute[73078]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)
Aug 14 18:34:42 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe97876d480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9'): ({'sdc'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Removing single pathed devices sdc {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf9d406-1fc8-4fe6-be02-421f47998485]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c77ba6-d9ed-4f9f-b311-3eac9ae94d06]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Flushing IO for device /dev/sdc {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde6f8b1-9634-4ab7-a6b2-1896c8363f8b]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.113s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42cd5fc-ae81-4d88-907e-6e14c89820ba]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] SCSI volumes sdc have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f857c2-6faa-48eb-938f-2e431ccb85f2]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8769415-029d-481b-a84c-71b898bd7d3a]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9, portal: 172.16.0.220,3260]
Aug 14 18:34:42 user nova-compute[73078]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9, portal: 172.16.0.220,3260] successful.
Aug 14 18:34:42 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e68cfa-91e9-494c-ab32-69be7eedf2b1]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.465s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] <== disconnect_volume: return (467ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:34:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:34:42 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Deleting instance files /opt/stack/data/nova/instances/631dc4c9-0df2-480b-952c-c088007703df_del
Aug 14 18:34:42 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Deletion of /opt/stack/data/nova/instances/631dc4c9-0df2-480b-952c-c088007703df_del complete
Aug 14 18:34:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7525cdc2f4a31c89032b5077a27a0a9b409a3807.part /opt/stack/data/nova/instances/_base/7525cdc2f4a31c89032b5077a27a0a9b409a3807.converted" returned: 0 in 0.519s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7525cdc2f4a31c89032b5077a27a0a9b409a3807.converted --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG nova.compute.manager [req-f47cc187-d128-42ec-bcd7-a0478143f444 req-60a43b6b-ea19-45d3-9606-16247be44a57 service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Received event network-vif-plugged-c9ff8bc1-a391-4c5f-826f-a533290f2a98 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-f47cc187-d128-42ec-bcd7-a0478143f444 req-60a43b6b-ea19-45d3-9606-16247be44a57 service nova] Acquiring lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-f47cc187-d128-42ec-bcd7-a0478143f444 req-60a43b6b-ea19-45d3-9606-16247be44a57 service nova] Lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-f47cc187-d128-42ec-bcd7-a0478143f444 req-60a43b6b-ea19-45d3-9606-16247be44a57 service nova] Lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG nova.compute.manager [req-f47cc187-d128-42ec-bcd7-a0478143f444 req-60a43b6b-ea19-45d3-9606-16247be44a57 service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] No waiting events found dispatching network-vif-plugged-c9ff8bc1-a391-4c5f-826f-a533290f2a98 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:34:43 user nova-compute[73078]: WARNING nova.compute.manager [req-f47cc187-d128-42ec-bcd7-a0478143f444 req-60a43b6b-ea19-45d3-9606-16247be44a57 service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Received unexpected event network-vif-plugged-c9ff8bc1-a391-4c5f-826f-a533290f2a98 for instance with vm_state active and task_state rescuing.
Aug 14 18:34:43 user nova-compute[73078]: DEBUG nova.compute.manager [req-f47cc187-d128-42ec-bcd7-a0478143f444 req-60a43b6b-ea19-45d3-9606-16247be44a57 service nova] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Received event network-vif-unplugged-f1a22a14-2365-4acb-8349-4fa3ec865bae {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-f47cc187-d128-42ec-bcd7-a0478143f444 req-60a43b6b-ea19-45d3-9606-16247be44a57 service nova] Acquiring lock "631dc4c9-0df2-480b-952c-c088007703df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-f47cc187-d128-42ec-bcd7-a0478143f444 req-60a43b6b-ea19-45d3-9606-16247be44a57 service nova] Lock "631dc4c9-0df2-480b-952c-c088007703df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-f47cc187-d128-42ec-bcd7-a0478143f444 req-60a43b6b-ea19-45d3-9606-16247be44a57 service nova] Lock "631dc4c9-0df2-480b-952c-c088007703df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG nova.compute.manager [req-f47cc187-d128-42ec-bcd7-a0478143f444 req-60a43b6b-ea19-45d3-9606-16247be44a57 service nova] [instance: 631dc4c9-0df2-480b-952c-c088007703df] No waiting events found dispatching network-vif-unplugged-f1a22a14-2365-4acb-8349-4fa3ec865bae {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG nova.compute.manager [req-f47cc187-d128-42ec-bcd7-a0478143f444 req-60a43b6b-ea19-45d3-9606-16247be44a57 service nova] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Received event network-vif-unplugged-f1a22a14-2365-4acb-8349-4fa3ec865bae for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG nova.compute.manager [req-f47cc187-d128-42ec-bcd7-a0478143f444 req-60a43b6b-ea19-45d3-9606-16247be44a57 service nova] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Received event network-vif-plugged-f1a22a14-2365-4acb-8349-4fa3ec865bae {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-f47cc187-d128-42ec-bcd7-a0478143f444 req-60a43b6b-ea19-45d3-9606-16247be44a57 service nova] Acquiring lock "631dc4c9-0df2-480b-952c-c088007703df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-f47cc187-d128-42ec-bcd7-a0478143f444 req-60a43b6b-ea19-45d3-9606-16247be44a57 service nova] Lock "631dc4c9-0df2-480b-952c-c088007703df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-f47cc187-d128-42ec-bcd7-a0478143f444 req-60a43b6b-ea19-45d3-9606-16247be44a57 service nova] Lock "631dc4c9-0df2-480b-952c-c088007703df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG nova.compute.manager [req-f47cc187-d128-42ec-bcd7-a0478143f444 req-60a43b6b-ea19-45d3-9606-16247be44a57 service nova] [instance: 631dc4c9-0df2-480b-952c-c088007703df] No waiting events found dispatching network-vif-plugged-f1a22a14-2365-4acb-8349-4fa3ec865bae {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:34:43 user nova-compute[73078]: WARNING nova.compute.manager [req-f47cc187-d128-42ec-bcd7-a0478143f444 req-60a43b6b-ea19-45d3-9606-16247be44a57 service nova] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Received unexpected event network-vif-plugged-f1a22a14-2365-4acb-8349-4fa3ec865bae for instance with vm_state active and task_state deleting.
Aug 14 18:34:43 user nova-compute[73078]: INFO nova.compute.manager [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Took 2.02 seconds to destroy the instance on the hypervisor.
Aug 14 18:34:43 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 631dc4c9-0df2-480b-952c-c088007703df] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7525cdc2f4a31c89032b5077a27a0a9b409a3807.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "7525cdc2f4a31c89032b5077a27a0a9b409a3807" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.684s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "7525cdc2f4a31c89032b5077a27a0a9b409a3807" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "7525cdc2f4a31c89032b5077a27a0a9b409a3807" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7525cdc2f4a31c89032b5077a27a0a9b409a3807 --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7525cdc2f4a31c89032b5077a27a0a9b409a3807 --force-share --output=json" returned: 0 in 0.172s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7525cdc2f4a31c89032b5077a27a0a9b409a3807,backing_fmt=raw /opt/stack/data/nova/instances/fc7d44f5-3616-4dba-a851-b6f7dddbad32/disk.rescue {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7525cdc2f4a31c89032b5077a27a0a9b409a3807,backing_fmt=raw /opt/stack/data/nova/instances/fc7d44f5-3616-4dba-a851-b6f7dddbad32/disk.rescue" returned: 0 in 0.050s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "7525cdc2f4a31c89032b5077a27a0a9b409a3807" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG nova.objects.instance [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lazy-loading 'migration_context' on Instance uuid fc7d44f5-3616-4dba-a851-b6f7dddbad32 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Start _get_guest_xml network_info=[{"id": "c9ff8bc1-a391-4c5f-826f-a533290f2a98", "address": "fa:16:3e:e7:4a:6c", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "vif_mac": "fa:16:3e:e7:4a:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ff8bc1-a3", "ovs_interfaceid": "c9ff8bc1-a391-4c5f-826f-a533290f2a98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bc9e0ab1-4133-45ce-9d88-7035f5d1094f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'dc0b72a5-e4d9-4885-bfed-eab245914cc1', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oMItkiKx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'fc7d44f5-3616-4dba-a851-b6f7dddbad32', 'attached_at': '', 'detached_at': '', 'volume_id': '365d0bf8-ac18-49e0-a595-f9cda5d0c3dc', 'serial': '365d0bf8-ac18-49e0-a595-f9cda5d0c3dc'}, 'volume_type': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG nova.objects.instance [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lazy-loading 'resources' on Instance uuid fc7d44f5-3616-4dba-a851-b6f7dddbad32 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG nova.objects.instance [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lazy-loading 'numa_topology' on Instance uuid fc7d44f5-3616-4dba-a851-b6f7dddbad32 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:34:43 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:34:43 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:34:43 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:34:43 user nova-compute[73078]: DEBUG nova.objects.instance [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lazy-loading 'vcpu_model' on Instance uuid fc7d44f5-3616-4dba-a851-b6f7dddbad32 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oMItkiKx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:34:44 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:34:44 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:34:44 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:34:44 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:34:44 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:34:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc -p 172.16.0.220:3260" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9df64a-ae8b-4621-8aa7-6ede5e012a2d]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = oMItkiKx\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 14 18:34:44 user nova-compute[73078]: node.name = iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc
Aug 14 18:34:44 user nova-compute[73078]: node.tpgt = -1
Aug 14 18:34:44 user nova-compute[73078]: node.startup = automatic
Aug 14 18:34:44 user nova-compute[73078]: node.leading_login = No
Aug 14 18:34:44 user nova-compute[73078]: iface.iscsi_ifacename = default
Aug 14 18:34:44 user nova-compute[73078]: iface.net_ifacename = <empty>
Aug 14 18:34:44 user nova-compute[73078]: iface.ipaddress = <empty>
Aug 14 18:34:44 user nova-compute[73078]: iface.prefix_len = 0
Aug 14 18:34:44 user nova-compute[73078]: iface.hwaddress = <empty>
Aug 14 18:34:44 user nova-compute[73078]: iface.transport_name = tcp
Aug 14 18:34:44 user nova-compute[73078]: iface.initiatorname = <empty>
Aug 14 18:34:44 user nova-compute[73078]: iface.state = <empty>
Aug 14 18:34:44 user nova-compute[73078]: iface.vlan_id = 0
Aug 14 18:34:44 user nova-compute[73078]: iface.vlan_priority = 0
Aug 14 18:34:44 user nova-compute[73078]: iface.vlan_state = <empty>
Aug 14 18:34:44 user nova-compute[73078]: iface.iface_num = 0
Aug 14 18:34:44 user nova-compute[73078]: iface.mtu = 0
Aug 14 18:34:44 user nova-compute[73078]: iface.port = 0
Aug 14 18:34:44 user nova-compute[73078]: iface.bootproto = <empty>
Aug 14 18:34:44 user nova-compute[73078]: iface.subnet_mask = <empty>
Aug 14 18:34:44 user nova-compute[73078]: iface.gateway = <empty>
Aug 14 18:34:44 user nova-compute[73078]: iface.dhcp_alt_client_id_state = <empty>
Aug 14 18:34:44 user nova-compute[73078]: iface.dhcp_alt_client_id = <empty>
Aug 14 18:34:44 user nova-compute[73078]: iface.dhcp_dns = <empty>
Aug 14 18:34:44 user nova-compute[73078]: iface.dhcp_learn_iqn = <empty>
Aug 14 18:34:44 user nova-compute[73078]: iface.dhcp_req_vendor_id_state = <empty>
Aug 14 18:34:44 user nova-compute[73078]: iface.dhcp_vendor_id_state = <empty>
Aug 14 18:34:44 user nova-compute[73078]: iface.dhcp_vendor_id = <empty>
Aug 14 18:34:44 user nova-compute[73078]: iface.dhcp_slp_da = <empty>
Aug 14 18:34:44 user nova-compute[73078]: iface.fragmentation = <empty>
Aug 14 18:34:44 user nova-compute[73078]: iface.gratuitous_arp = <empty>
Aug 14 18:34:44 user nova-compute[73078]: iface.incoming_forwarding = <empty>
Aug 14 18:34:44 user nova-compute[73078]: iface.tos_state = <empty>
Aug 14 18:34:44 user nova-compute[73078]: iface.tos = 0
Aug 14 18:34:44 user nova-compute[73078]: iface.ttl = 0
Aug 14 18:34:44 user nova-compute[73078]: iface.delayed_ack = <empty>
Aug 14 18:34:44 user nova-compute[73078]: iface.tcp_nagle = <empty>
Aug 14 18:34:44 user nova-compute[73078]: iface.tcp_wsf_state = <empty>
Aug 14 18:34:44 user nova-compute[73078]: iface.tcp_wsf = 0
Aug 14 18:34:44 user nova-compute[73078]: iface.tcp_timer_scale = 0
Aug 14 18:34:44 user nova-compute[73078]: iface.tcp_timestamp = <empty>
Aug 14 18:34:44 user nova-compute[73078]: iface.redirect = <empty>
Aug 14 18:34:44 user nova-compute[73078]: iface.def_task_mgmt_timeout = 0
Aug 14 18:34:44 user nova-compute[73078]: iface.header_digest = <empty>
Aug 14 18:34:44 user nova-compute[73078]: iface.data_digest = <empty>
Aug 14 18:34:44 user nova-compute[73078]: iface.immediate_data = <empty>
Aug 14 18:34:44 user nova-compute[73078]: iface.initial_r2t = <empty>
Aug 14 18:34:44 user nova-compute[73078]: iface.data_seq_inorder = <empty>
Aug 14 18:34:44 user nova-compute[73078]: iface.data_pdu_inorder = <empty>
Aug 14 18:34:44 user nova-compute[73078]: iface.erl = 0
Aug 14 18:34:44 user nova-compute[73078]: iface.max_receive_data_len = 0
Aug 14 18:34:44 user nova-compute[73078]: iface.first_burst_len = 0
Aug 14 18:34:44 user nova-compute[73078]: iface.max_outstanding_r2t = 0
Aug 14 18:34:44 user nova-compute[73078]: iface.max_burst_len = 0
Aug 14 18:34:44 user nova-compute[73078]: iface.chap_auth = <empty>
Aug 14 18:34:44 user nova-compute[73078]: iface.bidi_chap = <empty>
Aug 14 18:34:44 user nova-compute[73078]: iface.strict_login_compliance = <empty>
Aug 14 18:34:44 user nova-compute[73078]: iface.discovery_auth = <empty>
Aug 14 18:34:44 user nova-compute[73078]: iface.discovery_logout = <empty>
Aug 14 18:34:44 user nova-compute[73078]: node.discovery_address = <empty>
Aug 14 18:34:44 user nova-compute[73078]: node.discovery_port = 0
Aug 14 18:34:44 user nova-compute[73078]: node.discovery_type = static
Aug 14 18:34:44 user nova-compute[73078]: node.session.initial_cmdsn = 0
Aug 14 18:34:44 user nova-compute[73078]: node.session.initial_login_retry_max = 8
Aug 14 18:34:44 user nova-compute[73078]: node.session.xmit_thread_priority = -20
Aug 14 18:34:44 user nova-compute[73078]: node.session.cmds_max = 128
Aug 14 18:34:44 user nova-compute[73078]: node.session.queue_depth = 32
Aug 14 18:34:44 user nova-compute[73078]: node.session.nr_sessions = 1
Aug 14 18:34:44 user nova-compute[73078]: node.session.auth.authmethod = CHAP
Aug 14 18:34:44 user nova-compute[73078]: node.session.auth.username = oMItkiKx
Aug 14 18:34:44 user nova-compute[73078]: node.session.auth.password = ***
Aug 14 18:34:44 user nova-compute[73078]: node.session.auth.username_in = <empty>
Aug 14 18:34:44 user nova-compute[73078]: node.session.auth.password_in = <empty>
Aug 14 18:34:44 user nova-compute[73078]: node.session.auth.chap_algs = MD5
Aug 14 18:34:44 user nova-compute[73078]: node.session.timeo.replacement_timeout = 120
Aug 14 18:34:44 user nova-compute[73078]: node.session.err_timeo.abort_timeout = 15
Aug 14 18:34:44 user nova-compute[73078]: node.session.err_timeo.lu_reset_timeout = 30
Aug 14 18:34:44 user nova-compute[73078]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 14 18:34:44 user nova-compute[73078]: node.session.err_timeo.host_reset_timeout = 60
Aug 14 18:34:44 user nova-compute[73078]: node.session.iscsi.FastAbort = Yes
Aug 14 18:34:44 user nova-compute[73078]: node.session.iscsi.InitialR2T = No
Aug 14 18:34:44 user nova-compute[73078]: node.session.iscsi.ImmediateData = Yes
Aug 14 18:34:44 user nova-compute[73078]: node.session.iscsi.FirstBurstLength = 262144
Aug 14 18:34:44 user nova-compute[73078]: node.session.iscsi.MaxBurstLength = 16776192
Aug 14 18:34:44 user nova-compute[73078]: node.session.iscsi.DefaultTime2Retain = 0
Aug 14 18:34:44 user nova-compute[73078]: node.session.iscsi.DefaultTime2Wait = 2
Aug 14 18:34:44 user nova-compute[73078]: node.session.iscsi.MaxConnections = 1
Aug 14 18:34:44 user nova-compute[73078]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 14 18:34:44 user nova-compute[73078]: node.session.iscsi.ERL = 0
Aug 14 18:34:44 user nova-compute[73078]: node.session.scan = manual
Aug 14 18:34:44 user nova-compute[73078]: node.session.reopen_max = 0
Aug 14 18:34:44 user nova-compute[73078]: node.conn[0].address = 172.16.0.220
Aug 14 18:34:44 user nova-compute[73078]: node.conn[0].port = 3260
Aug 14 18:34:44 user nova-compute[73078]: node.conn[0].startup = manual
Aug 14 18:34:44 user nova-compute[73078]: node.conn[0].tcp.window_size = 524288
Aug 14 18:34:44 user nova-compute[73078]: node.conn[0].tcp.type_of_service = 0
Aug 14 18:34:44 user nova-compute[73078]: node.conn[0].timeo.logout_timeout = 15
Aug 14 18:34:44 user nova-compute[73078]: node.conn[0].timeo.login_timeout = 15
Aug 14 18:34:44 user nova-compute[73078]: node.conn[0].timeo.auth_timeout = 45
Aug 14 18:34:44 user nova-compute[73078]: node.conn[0].timeo.noop_out_interval = 5
Aug 14 18:34:44 user nova-compute[73078]: node.conn[0].timeo.noop_out_timeout = 5
Aug 14 18:34:44 user nova-compute[73078]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 14 18:34:44 user nova-compute[73078]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 14 18:34:44 user nova-compute[73078]: node.conn[0].iscsi.HeaderDigest = None
Aug 14 18:34:44 user nova-compute[73078]: node.conn[0].iscsi.DataDigest = None
Aug 14 18:34:44 user nova-compute[73078]: node.conn[0].iscsi.IFMarker = No
Aug 14 18:34:44 user nova-compute[73078]: node.conn[0].iscsi.OFMarker = No
Aug 14 18:34:44 user nova-compute[73078]: # END RECORD
Aug 14 18:34:44 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c132c8-22f3-49c0-a96f-7ab2359f8b59]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5833c89f-22b9-4c8f-a6cc-b46ff88a44a1]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oMItkiKx {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oMItkiKx" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d77097e-08b5-4fc2-81a8-052a318a0620]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oMItkiKx'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5ef5a1-fac6-4271-b924-9a96ecfd53ca]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf13116-1ab5-4c56-8aa6-8a37d22a39e9]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:34:44 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:34:44 user nova-compute[73078]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)
Aug 14 18:34:44 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:34:44 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:34:44 user nova-compute[73078]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)
Aug 14 18:34:44 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.164s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] HCTL ('35', '0', '0', 0) found on session 51 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be0230a-ca19-4348-9b6b-556a54ec9d53]: (4, ('0 0 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Searching for a device in session 51 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oMItkiKx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.188s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] <== connect_volume: return (189ms) {'type': 'block', 'scsi_wwn': '23164376234353463', 'path': '/dev/sdd'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164376234353463', 'path': '/dev/sdd'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:32:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-502950209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-502950209',id=44,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:33:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16e938ed650845d0a64b49273c9f6287',ramdisk_id='',reservation_id='r-p6wrvd40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1267883434',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:33:15Z,user_data=None,user_id='0bff079d90d942bb8ab3ba53fb007125',uuid=fc7d44f5-3616-4dba-a851-b6f7dddbad32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9ff8bc1-a391-4c5f-826f-a533290f2a98", "address": "fa:16:3e:e7:4a:6c", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "vif_mac": "fa:16:3e:e7:4a:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ff8bc1-a3", "ovs_interfaceid": "c9ff8bc1-a391-4c5f-826f-a533290f2a98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Converting VIF {"id": "c9ff8bc1-a391-4c5f-826f-a533290f2a98", "address": "fa:16:3e:e7:4a:6c", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "vif_mac": "fa:16:3e:e7:4a:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ff8bc1-a3", "ovs_interfaceid": "c9ff8bc1-a391-4c5f-826f-a533290f2a98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:4a:6c,bridge_name='br-int',has_traffic_filtering=True,id=c9ff8bc1-a391-4c5f-826f-a533290f2a98,network=Network(98a29135-c5de-46a6-a2bf-46c90b4e255b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9ff8bc1-a3') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG nova.objects.instance [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lazy-loading 'pci_devices' on Instance uuid fc7d44f5-3616-4dba-a851-b6f7dddbad32 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:34:44 user nova-compute[73078]:   <uuid>fc7d44f5-3616-4dba-a851-b6f7dddbad32</uuid>
Aug 14 18:34:44 user nova-compute[73078]:   <name>instance-0000002c</name>
Aug 14 18:34:44 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:34:44 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:34:44 user nova-compute[73078]:   <metadata>
Aug 14 18:34:44 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:34:44 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:34:44 user nova-compute[73078]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-502950209</nova:name>
Aug 14 18:34:44 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:34:43</nova:creationTime>
Aug 14 18:34:44 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:34:44 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:34:44 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:34:44 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:34:44 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:34:44 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:34:44 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:34:44 user nova-compute[73078]:       <nova:owner>
Aug 14 18:34:44 user nova-compute[73078]:         <nova:user uuid="0bff079d90d942bb8ab3ba53fb007125">tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member</nova:user>
Aug 14 18:34:44 user nova-compute[73078]:         <nova:project uuid="16e938ed650845d0a64b49273c9f6287">tempest-ServerBootFromVolumeStableRescueTest-1267883434</nova:project>
Aug 14 18:34:44 user nova-compute[73078]:       </nova:owner>
Aug 14 18:34:44 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:34:44 user nova-compute[73078]:       <nova:ports>
Aug 14 18:34:44 user nova-compute[73078]:         <nova:port uuid="c9ff8bc1-a391-4c5f-826f-a533290f2a98">
Aug 14 18:34:44 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 18:34:44 user nova-compute[73078]:         </nova:port>
Aug 14 18:34:44 user nova-compute[73078]:       </nova:ports>
Aug 14 18:34:44 user nova-compute[73078]:     </nova:instance>
Aug 14 18:34:44 user nova-compute[73078]:   </metadata>
Aug 14 18:34:44 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:34:44 user nova-compute[73078]:     <system>
Aug 14 18:34:44 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:34:44 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:34:44 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:34:44 user nova-compute[73078]:       <entry name="serial">fc7d44f5-3616-4dba-a851-b6f7dddbad32</entry>
Aug 14 18:34:44 user nova-compute[73078]:       <entry name="uuid">fc7d44f5-3616-4dba-a851-b6f7dddbad32</entry>
Aug 14 18:34:44 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:34:44 user nova-compute[73078]:     </system>
Aug 14 18:34:44 user nova-compute[73078]:   </sysinfo>
Aug 14 18:34:44 user nova-compute[73078]:   <os>
Aug 14 18:34:44 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:34:44 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:34:44 user nova-compute[73078]:   </os>
Aug 14 18:34:44 user nova-compute[73078]:   <features>
Aug 14 18:34:44 user nova-compute[73078]:     <acpi/>
Aug 14 18:34:44 user nova-compute[73078]:     <apic/>
Aug 14 18:34:44 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:34:44 user nova-compute[73078]:   </features>
Aug 14 18:34:44 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:34:44 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:34:44 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:34:44 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:34:44 user nova-compute[73078]:   </clock>
Aug 14 18:34:44 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:34:44 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:34:44 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:34:44 user nova-compute[73078]:   </cpu>
Aug 14 18:34:44 user nova-compute[73078]:   <devices>
Aug 14 18:34:44 user nova-compute[73078]:     <disk type="block" device="disk">
Aug 14 18:34:44 user nova-compute[73078]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:34:44 user nova-compute[73078]:       <source dev="/dev/sdd"/>
Aug 14 18:34:44 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:34:44 user nova-compute[73078]:       <serial>365d0bf8-ac18-49e0-a595-f9cda5d0c3dc</serial>
Aug 14 18:34:44 user nova-compute[73078]:     </disk>
Aug 14 18:34:44 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:34:44 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:34:44 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/fc7d44f5-3616-4dba-a851-b6f7dddbad32/disk.rescue"/>
Aug 14 18:34:44 user nova-compute[73078]:       <target dev="vdb" bus="virtio"/>
Aug 14 18:34:44 user nova-compute[73078]:       <boot order="1"/>
Aug 14 18:34:44 user nova-compute[73078]:     </disk>
Aug 14 18:34:44 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:34:44 user nova-compute[73078]:       <mac address="fa:16:3e:e7:4a:6c"/>
Aug 14 18:34:44 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:34:44 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:34:44 user nova-compute[73078]:       <target dev="tapc9ff8bc1-a3"/>
Aug 14 18:34:44 user nova-compute[73078]:     </interface>
Aug 14 18:34:44 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:34:44 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/fc7d44f5-3616-4dba-a851-b6f7dddbad32/console.log" append="off"/>
Aug 14 18:34:44 user nova-compute[73078]:     </serial>
Aug 14 18:34:44 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:34:44 user nova-compute[73078]:     <video>
Aug 14 18:34:44 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:34:44 user nova-compute[73078]:     </video>
Aug 14 18:34:44 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:34:44 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:34:44 user nova-compute[73078]:     </rng>
Aug 14 18:34:44 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:34:44 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:34:44 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:34:44 user nova-compute[73078]:     </memballoon>
Aug 14 18:34:44 user nova-compute[73078]:   </devices>
Aug 14 18:34:44 user nova-compute[73078]: </domain>
Aug 14 18:34:44 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:34:44 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Instance destroyed successfully.
Aug 14 18:34:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] No VIF found with MAC fa:16:3e:e7:4a:6c, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:34:44 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:34:44 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Took 1.23 seconds to deallocate network for instance.
Aug 14 18:34:45 user nova-compute[73078]: DEBUG nova.compute.manager [req-8d259e7b-7393-404c-98bb-af685917731e req-8347aba6-a7f8-4230-abed-1070f052f2db service nova] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Received event network-vif-deleted-f1a22a14-2365-4acb-8349-4fa3ec865bae {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:34:45 user nova-compute[73078]: INFO nova.compute.manager [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Took 0.84 seconds to detach 1 volumes for instance.
Aug 14 18:34:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:34:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:34:45 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:34:45 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:34:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.263s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:34:45 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Deleted allocations for instance 631dc4c9-0df2-480b-952c-c088007703df
Aug 14 18:34:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-65b19ae5-03bc-4a24-aa5c-65fad48b30d0 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "631dc4c9-0df2-480b-952c-c088007703df" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.533s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:34:45 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:34:45 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:34:45 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:34:45 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:34:45 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:34:45 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:34:45 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:34:47 user nova-compute[73078]: DEBUG nova.compute.manager [req-c570eccb-5887-457b-b528-9e46a1d47b8a req-9132d5cb-cabe-4e33-a6d5-354370339acd service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Received event network-vif-plugged-c9ff8bc1-a391-4c5f-826f-a533290f2a98 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:34:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-c570eccb-5887-457b-b528-9e46a1d47b8a req-9132d5cb-cabe-4e33-a6d5-354370339acd service nova] Acquiring lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:34:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-c570eccb-5887-457b-b528-9e46a1d47b8a req-9132d5cb-cabe-4e33-a6d5-354370339acd service nova] Lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:34:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-c570eccb-5887-457b-b528-9e46a1d47b8a req-9132d5cb-cabe-4e33-a6d5-354370339acd service nova] Lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:34:47 user nova-compute[73078]: DEBUG nova.compute.manager [req-c570eccb-5887-457b-b528-9e46a1d47b8a req-9132d5cb-cabe-4e33-a6d5-354370339acd service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] No waiting events found dispatching network-vif-plugged-c9ff8bc1-a391-4c5f-826f-a533290f2a98 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:34:47 user nova-compute[73078]: WARNING nova.compute.manager [req-c570eccb-5887-457b-b528-9e46a1d47b8a req-9132d5cb-cabe-4e33-a6d5-354370339acd service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Received unexpected event network-vif-plugged-c9ff8bc1-a391-4c5f-826f-a533290f2a98 for instance with vm_state active and task_state rescuing.
Aug 14 18:34:47 user nova-compute[73078]: DEBUG nova.compute.manager [req-c570eccb-5887-457b-b528-9e46a1d47b8a req-9132d5cb-cabe-4e33-a6d5-354370339acd service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Received event network-vif-plugged-c9ff8bc1-a391-4c5f-826f-a533290f2a98 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:34:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-c570eccb-5887-457b-b528-9e46a1d47b8a req-9132d5cb-cabe-4e33-a6d5-354370339acd service nova] Acquiring lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:34:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-c570eccb-5887-457b-b528-9e46a1d47b8a req-9132d5cb-cabe-4e33-a6d5-354370339acd service nova] Lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:34:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-c570eccb-5887-457b-b528-9e46a1d47b8a req-9132d5cb-cabe-4e33-a6d5-354370339acd service nova] Lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:34:47 user nova-compute[73078]: DEBUG nova.compute.manager [req-c570eccb-5887-457b-b528-9e46a1d47b8a req-9132d5cb-cabe-4e33-a6d5-354370339acd service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] No waiting events found dispatching network-vif-plugged-c9ff8bc1-a391-4c5f-826f-a533290f2a98 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:34:47 user nova-compute[73078]: WARNING nova.compute.manager [req-c570eccb-5887-457b-b528-9e46a1d47b8a req-9132d5cb-cabe-4e33-a6d5-354370339acd service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Received unexpected event network-vif-plugged-c9ff8bc1-a391-4c5f-826f-a533290f2a98 for instance with vm_state active and task_state rescuing.
Aug 14 18:34:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:34:47 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Removed pending event for fc7d44f5-3616-4dba-a851-b6f7dddbad32 due to event {{(pid=73078) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 18:34:47 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692038087.7514079, fc7d44f5-3616-4dba-a851-b6f7dddbad32 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:34:47 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] VM Resumed (Lifecycle Event)
Aug 14 18:34:47 user nova-compute[73078]: DEBUG nova.compute.manager [None req-4e381771-d542-4b7a-be1d-bf3aa29a8996 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:34:47 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:34:47 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:34:47 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 18:34:47 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692038087.7534046, fc7d44f5-3616-4dba-a851-b6f7dddbad32 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:34:47 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] VM Started (Lifecycle Event)
Aug 14 18:34:47 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:34:47 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:34:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:34:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:34:57 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692038081.871046, 631dc4c9-0df2-480b-952c-c088007703df => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:34:57 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 631dc4c9-0df2-480b-952c-c088007703df] VM Stopped (Lifecycle Event)
Aug 14 18:34:57 user nova-compute[73078]: DEBUG nova.compute.manager [None req-0ddae063-f21d-4948-af50-3ff413be65a7 None None] [instance: 631dc4c9-0df2-480b-952c-c088007703df] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:34:57 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:34:57 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:34:57 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:34:57 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:34:57 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:34:57 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:02 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:35:02 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:35:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:35:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:35:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:35:02 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:35:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:35:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:35:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:03 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:35:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bb1bc98-12ee-4a5b-91db-6e66966c482f/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bb1bc98-12ee-4a5b-91db-6e66966c482f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bb1bc98-12ee-4a5b-91db-6e66966c482f/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bb1bc98-12ee-4a5b-91db-6e66966c482f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:35:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7d44f5-3616-4dba-a851-b6f7dddbad32/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7d44f5-3616-4dba-a851-b6f7dddbad32/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7d44f5-3616-4dba-a851-b6f7dddbad32/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7d44f5-3616-4dba-a851-b6f7dddbad32/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:05 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:35:05 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:35:05 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=8099MB free_disk=24.82534408569336GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:35:05 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:35:05 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:35:05 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 61dfe42b-c943-4617-bf8e-745eaf1a1bb8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:35:05 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 3088da30-65b7-4801-b425-93df4fca6ad8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:35:05 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 2f960239-8deb-4d9f-9cab-eea0274aca38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:35:05 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance ebbaec07-9843-4cc0-bcb6-f993e62d88c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:35:05 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 16a18fae-165b-487b-bfd5-20097eac0a8e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:35:05 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 8bb1bc98-12ee-4a5b-91db-6e66966c482f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:35:05 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance fc7d44f5-3616-4dba-a851-b6f7dddbad32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:35:05 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:35:05 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:35:05 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:35:05 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:35:05 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:35:05 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.451s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:35:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:07 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:35:07 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:35:07 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:35:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-ebbaec07-9843-4cc0-bcb6-f993e62d88c1" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:35:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-ebbaec07-9843-4cc0-bcb6-f993e62d88c1" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:35:07 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:35:07 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Updating instance_info_cache with network_info: [{"id": "f4b39d8b-c9a2-4747-88ba-834f2542b617", "address": "fa:16:3e:7d:d8:49", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b39d8b-c9", "ovs_interfaceid": "f4b39d8b-c9a2-4747-88ba-834f2542b617", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:35:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-ebbaec07-9843-4cc0-bcb6-f993e62d88c1" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:35:07 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:35:07 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:35:07 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:35:07 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:35:07 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:35:07 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:35:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-606e50ef-0f50-4db2-8c9a-42c33496d468 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Acquiring lock "2f960239-8deb-4d9f-9cab-eea0274aca38" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:35:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-606e50ef-0f50-4db2-8c9a-42c33496d468 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:35:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-606e50ef-0f50-4db2-8c9a-42c33496d468 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Acquiring lock "2f960239-8deb-4d9f-9cab-eea0274aca38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:35:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-606e50ef-0f50-4db2-8c9a-42c33496d468 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:35:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-606e50ef-0f50-4db2-8c9a-42c33496d468 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:35:08 user nova-compute[73078]: INFO nova.compute.manager [None req-606e50ef-0f50-4db2-8c9a-42c33496d468 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Terminating instance
Aug 14 18:35:08 user nova-compute[73078]: DEBUG nova.compute.manager [None req-606e50ef-0f50-4db2-8c9a-42c33496d468 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:35:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:08 user nova-compute[73078]: DEBUG nova.compute.manager [req-4de65e53-448a-424a-b3c6-9ca519479f2b req-e5628376-ac8f-43a0-9260-c230816c7b5e service nova] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Received event network-vif-unplugged-665b631d-4caf-4f3f-8c30-3a8ab77e79c0 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:35:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4de65e53-448a-424a-b3c6-9ca519479f2b req-e5628376-ac8f-43a0-9260-c230816c7b5e service nova] Acquiring lock "2f960239-8deb-4d9f-9cab-eea0274aca38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:35:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4de65e53-448a-424a-b3c6-9ca519479f2b req-e5628376-ac8f-43a0-9260-c230816c7b5e service nova] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:35:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4de65e53-448a-424a-b3c6-9ca519479f2b req-e5628376-ac8f-43a0-9260-c230816c7b5e service nova] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:35:08 user nova-compute[73078]: DEBUG nova.compute.manager [req-4de65e53-448a-424a-b3c6-9ca519479f2b req-e5628376-ac8f-43a0-9260-c230816c7b5e service nova] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] No waiting events found dispatching network-vif-unplugged-665b631d-4caf-4f3f-8c30-3a8ab77e79c0 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:35:08 user nova-compute[73078]: DEBUG nova.compute.manager [req-4de65e53-448a-424a-b3c6-9ca519479f2b req-e5628376-ac8f-43a0-9260-c230816c7b5e service nova] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Received event network-vif-unplugged-665b631d-4caf-4f3f-8c30-3a8ab77e79c0 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:35:09 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:35:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:09 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Instance destroyed successfully.
Aug 14 18:35:09 user nova-compute[73078]: DEBUG nova.objects.instance [None req-606e50ef-0f50-4db2-8c9a-42c33496d468 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lazy-loading 'resources' on Instance uuid 2f960239-8deb-4d9f-9cab-eea0274aca38 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:35:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-606e50ef-0f50-4db2-8c9a-42c33496d468 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:27:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-410665744',display_name='tempest-SnapshotDataIntegrityTests-server-410665744',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-410665744',id=36,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUrkv6bX46z7g+M1+PLp78HR90ICrwLqzcyof00hU4DyyTheIJV2AKYz8gfNSDvZ6lfz468xmJtlpUTwTB5Qokh1jjndsK0ZvTQkLWQvgQR+G8YTvfo7/o1I2NCiYEqhQ==',key_name='tempest-keypair-183526759',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:27:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c449c8c411c34206af9251f78b912565',ramdisk_id='',reservation_id='r-46m5q4vj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1220717353',owner_user_name='tempest-SnapshotDataIntegrityTests-1220717353-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:27:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30953ec1cba84ed39611a8801e38dc8c',uuid=2f960239-8deb-4d9f-9cab-eea0274aca38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "665b631d-4caf-4f3f-8c30-3a8ab77e79c0", "address": "fa:16:3e:38:ed:9c", "network": {"id": "9231db47-733a-46df-876b-ee8ed8157a6e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1021535791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c449c8c411c34206af9251f78b912565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665b631d-4c", "ovs_interfaceid": "665b631d-4caf-4f3f-8c30-3a8ab77e79c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:35:09 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-606e50ef-0f50-4db2-8c9a-42c33496d468 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Converting VIF {"id": "665b631d-4caf-4f3f-8c30-3a8ab77e79c0", "address": "fa:16:3e:38:ed:9c", "network": {"id": "9231db47-733a-46df-876b-ee8ed8157a6e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1021535791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c449c8c411c34206af9251f78b912565", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665b631d-4c", "ovs_interfaceid": "665b631d-4caf-4f3f-8c30-3a8ab77e79c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:35:09 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-606e50ef-0f50-4db2-8c9a-42c33496d468 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:ed:9c,bridge_name='br-int',has_traffic_filtering=True,id=665b631d-4caf-4f3f-8c30-3a8ab77e79c0,network=Network(9231db47-733a-46df-876b-ee8ed8157a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665b631d-4c') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:35:09 user nova-compute[73078]: DEBUG os_vif [None req-606e50ef-0f50-4db2-8c9a-42c33496d468 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:ed:9c,bridge_name='br-int',has_traffic_filtering=True,id=665b631d-4caf-4f3f-8c30-3a8ab77e79c0,network=Network(9231db47-733a-46df-876b-ee8ed8157a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665b631d-4c') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:35:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap665b631d-4c, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:35:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:35:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:09 user nova-compute[73078]: INFO os_vif [None req-606e50ef-0f50-4db2-8c9a-42c33496d468 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:ed:9c,bridge_name='br-int',has_traffic_filtering=True,id=665b631d-4caf-4f3f-8c30-3a8ab77e79c0,network=Network(9231db47-733a-46df-876b-ee8ed8157a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665b631d-4c')
Aug 14 18:35:09 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-606e50ef-0f50-4db2-8c9a-42c33496d468 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Deleting instance files /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38_del
Aug 14 18:35:09 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-606e50ef-0f50-4db2-8c9a-42c33496d468 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Deletion of /opt/stack/data/nova/instances/2f960239-8deb-4d9f-9cab-eea0274aca38_del complete
Aug 14 18:35:09 user nova-compute[73078]: INFO nova.compute.manager [None req-606e50ef-0f50-4db2-8c9a-42c33496d468 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 14 18:35:09 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-606e50ef-0f50-4db2-8c9a-42c33496d468 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:35:09 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:35:09 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:35:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:10 user nova-compute[73078]: DEBUG nova.compute.manager [req-11e4b592-c427-4724-aad4-2766ab455a65 req-c75593d5-c9a3-4133-8b00-df12e2d54a20 service nova] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Received event network-vif-plugged-665b631d-4caf-4f3f-8c30-3a8ab77e79c0 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:35:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-11e4b592-c427-4724-aad4-2766ab455a65 req-c75593d5-c9a3-4133-8b00-df12e2d54a20 service nova] Acquiring lock "2f960239-8deb-4d9f-9cab-eea0274aca38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:35:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-11e4b592-c427-4724-aad4-2766ab455a65 req-c75593d5-c9a3-4133-8b00-df12e2d54a20 service nova] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:35:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-11e4b592-c427-4724-aad4-2766ab455a65 req-c75593d5-c9a3-4133-8b00-df12e2d54a20 service nova] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:35:10 user nova-compute[73078]: DEBUG nova.compute.manager [req-11e4b592-c427-4724-aad4-2766ab455a65 req-c75593d5-c9a3-4133-8b00-df12e2d54a20 service nova] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] No waiting events found dispatching network-vif-plugged-665b631d-4caf-4f3f-8c30-3a8ab77e79c0 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:35:10 user nova-compute[73078]: WARNING nova.compute.manager [req-11e4b592-c427-4724-aad4-2766ab455a65 req-c75593d5-c9a3-4133-8b00-df12e2d54a20 service nova] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Received unexpected event network-vif-plugged-665b631d-4caf-4f3f-8c30-3a8ab77e79c0 for instance with vm_state active and task_state deleting.
Aug 14 18:35:10 user nova-compute[73078]: DEBUG nova.compute.manager [req-11e4b592-c427-4724-aad4-2766ab455a65 req-c75593d5-c9a3-4133-8b00-df12e2d54a20 service nova] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Received event network-vif-plugged-665b631d-4caf-4f3f-8c30-3a8ab77e79c0 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:35:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-11e4b592-c427-4724-aad4-2766ab455a65 req-c75593d5-c9a3-4133-8b00-df12e2d54a20 service nova] Acquiring lock "2f960239-8deb-4d9f-9cab-eea0274aca38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:35:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-11e4b592-c427-4724-aad4-2766ab455a65 req-c75593d5-c9a3-4133-8b00-df12e2d54a20 service nova] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:35:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-11e4b592-c427-4724-aad4-2766ab455a65 req-c75593d5-c9a3-4133-8b00-df12e2d54a20 service nova] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:35:10 user nova-compute[73078]: DEBUG nova.compute.manager [req-11e4b592-c427-4724-aad4-2766ab455a65 req-c75593d5-c9a3-4133-8b00-df12e2d54a20 service nova] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] No waiting events found dispatching network-vif-plugged-665b631d-4caf-4f3f-8c30-3a8ab77e79c0 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:35:10 user nova-compute[73078]: WARNING nova.compute.manager [req-11e4b592-c427-4724-aad4-2766ab455a65 req-c75593d5-c9a3-4133-8b00-df12e2d54a20 service nova] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Received unexpected event network-vif-plugged-665b631d-4caf-4f3f-8c30-3a8ab77e79c0 for instance with vm_state active and task_state deleting.
Aug 14 18:35:10 user nova-compute[73078]: DEBUG nova.compute.manager [req-11e4b592-c427-4724-aad4-2766ab455a65 req-c75593d5-c9a3-4133-8b00-df12e2d54a20 service nova] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Received event network-vif-plugged-665b631d-4caf-4f3f-8c30-3a8ab77e79c0 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:35:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-11e4b592-c427-4724-aad4-2766ab455a65 req-c75593d5-c9a3-4133-8b00-df12e2d54a20 service nova] Acquiring lock "2f960239-8deb-4d9f-9cab-eea0274aca38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:35:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-11e4b592-c427-4724-aad4-2766ab455a65 req-c75593d5-c9a3-4133-8b00-df12e2d54a20 service nova] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:35:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-11e4b592-c427-4724-aad4-2766ab455a65 req-c75593d5-c9a3-4133-8b00-df12e2d54a20 service nova] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:35:10 user nova-compute[73078]: DEBUG nova.compute.manager [req-11e4b592-c427-4724-aad4-2766ab455a65 req-c75593d5-c9a3-4133-8b00-df12e2d54a20 service nova] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] No waiting events found dispatching network-vif-plugged-665b631d-4caf-4f3f-8c30-3a8ab77e79c0 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:35:10 user nova-compute[73078]: WARNING nova.compute.manager [req-11e4b592-c427-4724-aad4-2766ab455a65 req-c75593d5-c9a3-4133-8b00-df12e2d54a20 service nova] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Received unexpected event network-vif-plugged-665b631d-4caf-4f3f-8c30-3a8ab77e79c0 for instance with vm_state active and task_state deleting.
Aug 14 18:35:10 user nova-compute[73078]: DEBUG nova.compute.manager [req-11e4b592-c427-4724-aad4-2766ab455a65 req-c75593d5-c9a3-4133-8b00-df12e2d54a20 service nova] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Received event network-vif-unplugged-665b631d-4caf-4f3f-8c30-3a8ab77e79c0 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:35:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-11e4b592-c427-4724-aad4-2766ab455a65 req-c75593d5-c9a3-4133-8b00-df12e2d54a20 service nova] Acquiring lock "2f960239-8deb-4d9f-9cab-eea0274aca38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:35:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-11e4b592-c427-4724-aad4-2766ab455a65 req-c75593d5-c9a3-4133-8b00-df12e2d54a20 service nova] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:35:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-11e4b592-c427-4724-aad4-2766ab455a65 req-c75593d5-c9a3-4133-8b00-df12e2d54a20 service nova] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:35:10 user nova-compute[73078]: DEBUG nova.compute.manager [req-11e4b592-c427-4724-aad4-2766ab455a65 req-c75593d5-c9a3-4133-8b00-df12e2d54a20 service nova] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] No waiting events found dispatching network-vif-unplugged-665b631d-4caf-4f3f-8c30-3a8ab77e79c0 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:35:10 user nova-compute[73078]: DEBUG nova.compute.manager [req-11e4b592-c427-4724-aad4-2766ab455a65 req-c75593d5-c9a3-4133-8b00-df12e2d54a20 service nova] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Received event network-vif-unplugged-665b631d-4caf-4f3f-8c30-3a8ab77e79c0 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:35:10 user nova-compute[73078]: DEBUG nova.compute.manager [req-11e4b592-c427-4724-aad4-2766ab455a65 req-c75593d5-c9a3-4133-8b00-df12e2d54a20 service nova] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Received event network-vif-plugged-665b631d-4caf-4f3f-8c30-3a8ab77e79c0 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:35:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-11e4b592-c427-4724-aad4-2766ab455a65 req-c75593d5-c9a3-4133-8b00-df12e2d54a20 service nova] Acquiring lock "2f960239-8deb-4d9f-9cab-eea0274aca38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:35:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-11e4b592-c427-4724-aad4-2766ab455a65 req-c75593d5-c9a3-4133-8b00-df12e2d54a20 service nova] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:35:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-11e4b592-c427-4724-aad4-2766ab455a65 req-c75593d5-c9a3-4133-8b00-df12e2d54a20 service nova] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:35:10 user nova-compute[73078]: DEBUG nova.compute.manager [req-11e4b592-c427-4724-aad4-2766ab455a65 req-c75593d5-c9a3-4133-8b00-df12e2d54a20 service nova] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] No waiting events found dispatching network-vif-plugged-665b631d-4caf-4f3f-8c30-3a8ab77e79c0 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:35:10 user nova-compute[73078]: WARNING nova.compute.manager [req-11e4b592-c427-4724-aad4-2766ab455a65 req-c75593d5-c9a3-4133-8b00-df12e2d54a20 service nova] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Received unexpected event network-vif-plugged-665b631d-4caf-4f3f-8c30-3a8ab77e79c0 for instance with vm_state active and task_state deleting.
Aug 14 18:35:10 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:35:10 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Took 1.39 seconds to deallocate network for instance.
Aug 14 18:35:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-606e50ef-0f50-4db2-8c9a-42c33496d468 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:35:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-606e50ef-0f50-4db2-8c9a-42c33496d468 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:35:11 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-606e50ef-0f50-4db2-8c9a-42c33496d468 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:35:11 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-606e50ef-0f50-4db2-8c9a-42c33496d468 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:35:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-606e50ef-0f50-4db2-8c9a-42c33496d468 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.258s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:35:11 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-606e50ef-0f50-4db2-8c9a-42c33496d468 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Deleted allocations for instance 2f960239-8deb-4d9f-9cab-eea0274aca38
Aug 14 18:35:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-606e50ef-0f50-4db2-8c9a-42c33496d468 tempest-SnapshotDataIntegrityTests-1220717353 tempest-SnapshotDataIntegrityTests-1220717353-project-member] Lock "2f960239-8deb-4d9f-9cab-eea0274aca38" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.774s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:35:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c95ac3d1-8fbb-4d99-a6d5-093146194dc0 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "8bb1bc98-12ee-4a5b-91db-6e66966c482f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:35:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c95ac3d1-8fbb-4d99-a6d5-093146194dc0 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "8bb1bc98-12ee-4a5b-91db-6e66966c482f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:35:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c95ac3d1-8fbb-4d99-a6d5-093146194dc0 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "8bb1bc98-12ee-4a5b-91db-6e66966c482f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:35:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c95ac3d1-8fbb-4d99-a6d5-093146194dc0 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "8bb1bc98-12ee-4a5b-91db-6e66966c482f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:35:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c95ac3d1-8fbb-4d99-a6d5-093146194dc0 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "8bb1bc98-12ee-4a5b-91db-6e66966c482f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:35:11 user nova-compute[73078]: INFO nova.compute.manager [None req-c95ac3d1-8fbb-4d99-a6d5-093146194dc0 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Terminating instance
Aug 14 18:35:11 user nova-compute[73078]: DEBUG nova.compute.manager [None req-c95ac3d1-8fbb-4d99-a6d5-093146194dc0 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:35:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:12 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Instance destroyed successfully.
Aug 14 18:35:12 user nova-compute[73078]: DEBUG nova.objects.instance [None req-c95ac3d1-8fbb-4d99-a6d5-093146194dc0 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lazy-loading 'resources' on Instance uuid 8bb1bc98-12ee-4a5b-91db-6e66966c482f {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:35:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-c95ac3d1-8fbb-4d99-a6d5-093146194dc0 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:32:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1139913388',display_name='tempest-AttachVolumeNegativeTest-server-1139913388',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1139913388',id=42,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTMoJCZGF58jKxpRGF+kp0D97klpJSBKJfXyPnDrxYBmnwq88FtqtQ8SHwLQpKr9zuiXwznl6cI2QI57BvwtzhpHqthF0elkaD2ABLL6tSaVQsc1HN63fgO689Srrpfvg==',key_name='tempest-keypair-1942474748',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:32:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1391a0a2167745348384e5890e6c22db',ramdisk_id='',reservation_id='r-kzvvbom1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1671295372',owner_user_name='tempest-AttachVolumeNegativeTest-1671295372-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:32:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3c5d292e9594e4aadad9ac72b9455ed',uuid=8bb1bc98-12ee-4a5b-91db-6e66966c482f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e131470-acea-41bf-80c0-e2d7eaa98d3f", "address": "fa:16:3e:ff:7b:5b", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e131470-ac", "ovs_interfaceid": "3e131470-acea-41bf-80c0-e2d7eaa98d3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:35:12 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-c95ac3d1-8fbb-4d99-a6d5-093146194dc0 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Converting VIF {"id": "3e131470-acea-41bf-80c0-e2d7eaa98d3f", "address": "fa:16:3e:ff:7b:5b", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e131470-ac", "ovs_interfaceid": "3e131470-acea-41bf-80c0-e2d7eaa98d3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:35:12 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-c95ac3d1-8fbb-4d99-a6d5-093146194dc0 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:7b:5b,bridge_name='br-int',has_traffic_filtering=True,id=3e131470-acea-41bf-80c0-e2d7eaa98d3f,network=Network(88e922e4-ec89-460a-954d-aff20a41293c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e131470-ac') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:35:12 user nova-compute[73078]: DEBUG os_vif [None req-c95ac3d1-8fbb-4d99-a6d5-093146194dc0 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:7b:5b,bridge_name='br-int',has_traffic_filtering=True,id=3e131470-acea-41bf-80c0-e2d7eaa98d3f,network=Network(88e922e4-ec89-460a-954d-aff20a41293c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e131470-ac') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:35:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e131470-ac, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:35:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:35:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:12 user nova-compute[73078]: INFO os_vif [None req-c95ac3d1-8fbb-4d99-a6d5-093146194dc0 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:7b:5b,bridge_name='br-int',has_traffic_filtering=True,id=3e131470-acea-41bf-80c0-e2d7eaa98d3f,network=Network(88e922e4-ec89-460a-954d-aff20a41293c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e131470-ac')
Aug 14 18:35:12 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-c95ac3d1-8fbb-4d99-a6d5-093146194dc0 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Deleting instance files /opt/stack/data/nova/instances/8bb1bc98-12ee-4a5b-91db-6e66966c482f_del
Aug 14 18:35:12 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-c95ac3d1-8fbb-4d99-a6d5-093146194dc0 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Deletion of /opt/stack/data/nova/instances/8bb1bc98-12ee-4a5b-91db-6e66966c482f_del complete
Aug 14 18:35:12 user nova-compute[73078]: INFO nova.compute.manager [None req-c95ac3d1-8fbb-4d99-a6d5-093146194dc0 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 14 18:35:12 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-c95ac3d1-8fbb-4d99-a6d5-093146194dc0 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:35:12 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:35:12 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:35:12 user nova-compute[73078]: DEBUG nova.compute.manager [req-13d60fc1-9924-448e-ba61-e0fbdb5ee48b req-560eec26-7bcb-4821-a09a-e32be1255749 service nova] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Received event network-vif-deleted-665b631d-4caf-4f3f-8c30-3a8ab77e79c0 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:35:12 user nova-compute[73078]: DEBUG nova.compute.manager [req-13d60fc1-9924-448e-ba61-e0fbdb5ee48b req-560eec26-7bcb-4821-a09a-e32be1255749 service nova] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Received event network-vif-unplugged-3e131470-acea-41bf-80c0-e2d7eaa98d3f {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:35:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-13d60fc1-9924-448e-ba61-e0fbdb5ee48b req-560eec26-7bcb-4821-a09a-e32be1255749 service nova] Acquiring lock "8bb1bc98-12ee-4a5b-91db-6e66966c482f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:35:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-13d60fc1-9924-448e-ba61-e0fbdb5ee48b req-560eec26-7bcb-4821-a09a-e32be1255749 service nova] Lock "8bb1bc98-12ee-4a5b-91db-6e66966c482f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:35:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-13d60fc1-9924-448e-ba61-e0fbdb5ee48b req-560eec26-7bcb-4821-a09a-e32be1255749 service nova] Lock "8bb1bc98-12ee-4a5b-91db-6e66966c482f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:35:12 user nova-compute[73078]: DEBUG nova.compute.manager [req-13d60fc1-9924-448e-ba61-e0fbdb5ee48b req-560eec26-7bcb-4821-a09a-e32be1255749 service nova] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] No waiting events found dispatching network-vif-unplugged-3e131470-acea-41bf-80c0-e2d7eaa98d3f {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:35:12 user nova-compute[73078]: DEBUG nova.compute.manager [req-13d60fc1-9924-448e-ba61-e0fbdb5ee48b req-560eec26-7bcb-4821-a09a-e32be1255749 service nova] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Received event network-vif-unplugged-3e131470-acea-41bf-80c0-e2d7eaa98d3f for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:35:12 user nova-compute[73078]: DEBUG nova.compute.manager [req-13d60fc1-9924-448e-ba61-e0fbdb5ee48b req-560eec26-7bcb-4821-a09a-e32be1255749 service nova] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Received event network-vif-plugged-3e131470-acea-41bf-80c0-e2d7eaa98d3f {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:35:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-13d60fc1-9924-448e-ba61-e0fbdb5ee48b req-560eec26-7bcb-4821-a09a-e32be1255749 service nova] Acquiring lock "8bb1bc98-12ee-4a5b-91db-6e66966c482f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:35:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-13d60fc1-9924-448e-ba61-e0fbdb5ee48b req-560eec26-7bcb-4821-a09a-e32be1255749 service nova] Lock "8bb1bc98-12ee-4a5b-91db-6e66966c482f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:35:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-13d60fc1-9924-448e-ba61-e0fbdb5ee48b req-560eec26-7bcb-4821-a09a-e32be1255749 service nova] Lock "8bb1bc98-12ee-4a5b-91db-6e66966c482f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:35:12 user nova-compute[73078]: DEBUG nova.compute.manager [req-13d60fc1-9924-448e-ba61-e0fbdb5ee48b req-560eec26-7bcb-4821-a09a-e32be1255749 service nova] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] No waiting events found dispatching network-vif-plugged-3e131470-acea-41bf-80c0-e2d7eaa98d3f {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:35:12 user nova-compute[73078]: WARNING nova.compute.manager [req-13d60fc1-9924-448e-ba61-e0fbdb5ee48b req-560eec26-7bcb-4821-a09a-e32be1255749 service nova] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Received unexpected event network-vif-plugged-3e131470-acea-41bf-80c0-e2d7eaa98d3f for instance with vm_state active and task_state deleting.
Aug 14 18:35:13 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:35:13 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Took 0.82 seconds to deallocate network for instance.
Aug 14 18:35:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c95ac3d1-8fbb-4d99-a6d5-093146194dc0 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:35:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c95ac3d1-8fbb-4d99-a6d5-093146194dc0 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:35:13 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-c95ac3d1-8fbb-4d99-a6d5-093146194dc0 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:35:13 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-c95ac3d1-8fbb-4d99-a6d5-093146194dc0 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:35:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c95ac3d1-8fbb-4d99-a6d5-093146194dc0 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.236s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:35:13 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-c95ac3d1-8fbb-4d99-a6d5-093146194dc0 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Deleted allocations for instance 8bb1bc98-12ee-4a5b-91db-6e66966c482f
Aug 14 18:35:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c95ac3d1-8fbb-4d99-a6d5-093146194dc0 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "8bb1bc98-12ee-4a5b-91db-6e66966c482f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.100s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:35:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:14 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:35:14 user nova-compute[73078]: DEBUG nova.compute.manager [req-49eee1a5-becf-4a16-889d-6c5f556e8525 req-e386897e-f04a-40d0-bbb9-b8fe65388be4 service nova] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Received event network-vif-deleted-3e131470-acea-41bf-80c0-e2d7eaa98d3f {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:35:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:18 user nova-compute[73078]: DEBUG nova.objects.instance [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lazy-loading 'flavor' on Instance uuid 16a18fae-165b-487b-bfd5-20097eac0a8e {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:35:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "refresh_cache-16a18fae-165b-487b-bfd5-20097eac0a8e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:35:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquired lock "refresh_cache-16a18fae-165b-487b-bfd5-20097eac0a8e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:35:18 user nova-compute[73078]: DEBUG nova.network.neutron [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:35:18 user nova-compute[73078]: DEBUG nova.objects.instance [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lazy-loading 'info_cache' on Instance uuid 16a18fae-165b-487b-bfd5-20097eac0a8e {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG nova.network.neutron [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Updating instance_info_cache with network_info: [{"id": "2dd60866-9ed8-4840-a797-893d81ab2b65", "address": "fa:16:3e:62:78:e2", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd60866-9e", "ovs_interfaceid": "2dd60866-9ed8-4840-a797-893d81ab2b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Releasing lock "refresh_cache-16a18fae-165b-487b-bfd5-20097eac0a8e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:35:19 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Instance destroyed successfully.
Aug 14 18:35:19 user nova-compute[73078]: DEBUG nova.objects.instance [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lazy-loading 'resources' on Instance uuid 16a18fae-165b-487b-bfd5-20097eac0a8e {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:31:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1523618791',display_name='tempest-AttachVolumeTestJSON-server-1523618791',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1523618791',id=41,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGt0IZUR45BoJPTktrLR+OSUIGX16DeSC3GRnxH2CMKh+NvhLefmy7aiMx94bvaYe2eBuYWP6rvvpzTkrEkuFVyTl4uoHzIOYqmCyqn8E4fpKgZ5Lep2EZjGHAoZGcIfQ==',key_name='tempest-keypair-1506094444',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:31:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8c717b7be2814591a20db3c81bc5ba89',ramdisk_id='',reservation_id='r-j7btfmht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-120525527',owner_user_name='tempest-AttachVolumeTestJSON-120525527-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:33:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc0adf66a66f4f4fb698706b5d3294cd',uuid=16a18fae-165b-487b-bfd5-20097eac0a8e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2dd60866-9ed8-4840-a797-893d81ab2b65", "address": "fa:16:3e:62:78:e2", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd60866-9e", "ovs_interfaceid": "2dd60866-9ed8-4840-a797-893d81ab2b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Converting VIF {"id": "2dd60866-9ed8-4840-a797-893d81ab2b65", "address": "fa:16:3e:62:78:e2", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd60866-9e", "ovs_interfaceid": "2dd60866-9ed8-4840-a797-893d81ab2b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:78:e2,bridge_name='br-int',has_traffic_filtering=True,id=2dd60866-9ed8-4840-a797-893d81ab2b65,network=Network(0e58d249-c00c-45c4-bc46-9d975b128a0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd60866-9e') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG os_vif [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:78:e2,bridge_name='br-int',has_traffic_filtering=True,id=2dd60866-9ed8-4840-a797-893d81ab2b65,network=Network(0e58d249-c00c-45c4-bc46-9d975b128a0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd60866-9e') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2dd60866-9e, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:35:19 user nova-compute[73078]: INFO os_vif [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:78:e2,bridge_name='br-int',has_traffic_filtering=True,id=2dd60866-9ed8-4840-a797-893d81ab2b65,network=Network(0e58d249-c00c-45c4-bc46-9d975b128a0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd60866-9e')
Aug 14 18:35:19 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uwHovVQj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:35:19 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:35:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ba08d8-52de-4718-ae1d-b40042afbd97]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b948b435-183d-46f8-83d6-3a15a6cf36c7]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:35:19 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:35:19 user nova-compute[73078]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)
Aug 14 18:35:19 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:35:19 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:35:19 user nova-compute[73078]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)
Aug 14 18:35:19 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe95479b6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99'): ({'sde'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Removing single pathed devices sde {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f8409c-89c1-4398-9b18-448f27bfb7a7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[20154c14-7788-4216-9a1b-bf8e99f624fa]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Flushing IO for device /dev/sde {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7998c0c6-8dbd-4f9c-9f02-e164399c2ea9]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b1ffe9-39f6-4376-be40-c2342caa8938]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] SCSI volumes sde have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[078f939f-bde0-407a-938d-dfedf702a044]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40876eb-bfde-47df-9e8f-dc3021cd3b4a]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99, portal: 172.16.0.220,3260]
Aug 14 18:35:19 user nova-compute[73078]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99, portal: 172.16.0.220,3260] successful.
Aug 14 18:35:19 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f841d3e3-52b4-4e55-a92f-8502dbbab7a0]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] <== disconnect_volume: return (279ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Start _get_guest_xml network_info=[{"id": "2dd60866-9ed8-4840-a797-893d81ab2b65", "address": "fa:16:3e:62:78:e2", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd60866-9e", "ovs_interfaceid": "2dd60866-9ed8-4840-a797-893d81ab2b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '69329335-36df-4a74-8413-beb0da91601c', 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uwHovVQj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '16a18fae-165b-487b-bfd5-20097eac0a8e', 'attached_at': '', 'detached_at': '', 'volume_id': '27eae141-3fe8-455c-9697-6bcfe0fefb99', 'serial': '27eae141-3fe8-455c-9697-6bcfe0fefb99'}, 'volume_type': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG nova.objects.instance [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lazy-loading 'numa_topology' on Instance uuid 16a18fae-165b-487b-bfd5-20097eac0a8e {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:35:19 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:35:19 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:35:19 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG nova.objects.instance [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lazy-loading 'vcpu_model' on Instance uuid 16a18fae-165b-487b-bfd5-20097eac0a8e {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uwHovVQj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:35:19 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:35:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:35:19 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:35:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:35:19 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8b8582-a685-45df-b3d4-987308ba75db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:35:19 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d5af4b-7899-497d-bce1-1e61527fe501]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99] added
Aug 14 18:35:19 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9547e796-7d55-492f-83c9-8fdf84360b1f]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e83a7b-15a6-439c-99b6-8544f7471074]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uwHovVQj {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uwHovVQj" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[88788ae0-6b0f-4aa2-a9cc-c403e1ce38d5]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uwHovVQj'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b728e9-a096-41e8-bcf6-27bc9fd5f396]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e79153-292d-4ac1-86b7-725189e94e53]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:35:19 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:35:19 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:35:19 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:35:19 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b99f41c-0f77-4aab-ba39-e8e4acd29445]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99, portal: 172.16.0.220,3260]
Aug 14 18:35:19 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99, portal: 172.16.0.220,3260] successful.
Aug 14 18:35:19 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[323049d7-61ec-4242-80fc-b379a1f3398f]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:35:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:20 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1536afda-5cb9-4618-9dc1-acf8be472351]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:35:20 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:35:20 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:35:20 user nova-compute[73078]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)
Aug 14 18:35:20 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:35:20 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:35:20 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:35:20 user nova-compute[73078]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)
Aug 14 18:35:20 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:35:20 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:35:20 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:35:20 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:35:20 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:35:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:20 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee2504b-b23c-44b7-830c-fcaa3c7e2120]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:35:20 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: None {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:35:21 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:35:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uwHovVQj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:35:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:35:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23765656565336333', 'path': '/dev/sdc'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:35:21 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765656565336333', 'path': '/dev/sdc'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:35:21 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:31:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1523618791',display_name='tempest-AttachVolumeTestJSON-server-1523618791',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1523618791',id=41,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGt0IZUR45BoJPTktrLR+OSUIGX16DeSC3GRnxH2CMKh+NvhLefmy7aiMx94bvaYe2eBuYWP6rvvpzTkrEkuFVyTl4uoHzIOYqmCyqn8E4fpKgZ5Lep2EZjGHAoZGcIfQ==',key_name='tempest-keypair-1506094444',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:31:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8c717b7be2814591a20db3c81bc5ba89',ramdisk_id='',reservation_id='r-j7btfmht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-120525527',owner_user_name='tempest-AttachVolumeTestJSON-120525527-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:33:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc0adf66a66f4f4fb698706b5d3294cd',uuid=16a18fae-165b-487b-bfd5-20097eac0a8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2dd60866-9ed8-4840-a797-893d81ab2b65", "address": "fa:16:3e:62:78:e2", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd60866-9e", "ovs_interfaceid": "2dd60866-9ed8-4840-a797-893d81ab2b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:35:21 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Converting VIF {"id": "2dd60866-9ed8-4840-a797-893d81ab2b65", "address": "fa:16:3e:62:78:e2", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd60866-9e", "ovs_interfaceid": "2dd60866-9ed8-4840-a797-893d81ab2b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:35:21 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:78:e2,bridge_name='br-int',has_traffic_filtering=True,id=2dd60866-9ed8-4840-a797-893d81ab2b65,network=Network(0e58d249-c00c-45c4-bc46-9d975b128a0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd60866-9e') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:35:21 user nova-compute[73078]: DEBUG nova.objects.instance [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lazy-loading 'pci_devices' on Instance uuid 16a18fae-165b-487b-bfd5-20097eac0a8e {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:35:21 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:35:21 user nova-compute[73078]:   <uuid>16a18fae-165b-487b-bfd5-20097eac0a8e</uuid>
Aug 14 18:35:21 user nova-compute[73078]:   <name>instance-00000029</name>
Aug 14 18:35:21 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:35:21 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:35:21 user nova-compute[73078]:   <metadata>
Aug 14 18:35:21 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:35:21 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:35:21 user nova-compute[73078]:       <nova:name>tempest-AttachVolumeTestJSON-server-1523618791</nova:name>
Aug 14 18:35:21 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:35:19</nova:creationTime>
Aug 14 18:35:21 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:35:21 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:35:21 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:35:21 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:35:21 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:35:21 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:35:21 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:35:21 user nova-compute[73078]:       <nova:owner>
Aug 14 18:35:21 user nova-compute[73078]:         <nova:user uuid="cc0adf66a66f4f4fb698706b5d3294cd">tempest-AttachVolumeTestJSON-120525527-project-member</nova:user>
Aug 14 18:35:21 user nova-compute[73078]:         <nova:project uuid="8c717b7be2814591a20db3c81bc5ba89">tempest-AttachVolumeTestJSON-120525527</nova:project>
Aug 14 18:35:21 user nova-compute[73078]:       </nova:owner>
Aug 14 18:35:21 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:35:21 user nova-compute[73078]:       <nova:ports>
Aug 14 18:35:21 user nova-compute[73078]:         <nova:port uuid="2dd60866-9ed8-4840-a797-893d81ab2b65">
Aug 14 18:35:21 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 18:35:21 user nova-compute[73078]:         </nova:port>
Aug 14 18:35:21 user nova-compute[73078]:       </nova:ports>
Aug 14 18:35:21 user nova-compute[73078]:     </nova:instance>
Aug 14 18:35:21 user nova-compute[73078]:   </metadata>
Aug 14 18:35:21 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:35:21 user nova-compute[73078]:     <system>
Aug 14 18:35:21 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:35:21 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:35:21 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:35:21 user nova-compute[73078]:       <entry name="serial">16a18fae-165b-487b-bfd5-20097eac0a8e</entry>
Aug 14 18:35:21 user nova-compute[73078]:       <entry name="uuid">16a18fae-165b-487b-bfd5-20097eac0a8e</entry>
Aug 14 18:35:21 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:35:21 user nova-compute[73078]:     </system>
Aug 14 18:35:21 user nova-compute[73078]:   </sysinfo>
Aug 14 18:35:21 user nova-compute[73078]:   <os>
Aug 14 18:35:21 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:35:21 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:35:21 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:35:21 user nova-compute[73078]:   </os>
Aug 14 18:35:21 user nova-compute[73078]:   <features>
Aug 14 18:35:21 user nova-compute[73078]:     <acpi/>
Aug 14 18:35:21 user nova-compute[73078]:     <apic/>
Aug 14 18:35:21 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:35:21 user nova-compute[73078]:   </features>
Aug 14 18:35:21 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:35:21 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:35:21 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:35:21 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:35:21 user nova-compute[73078]:   </clock>
Aug 14 18:35:21 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:35:21 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:35:21 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:35:21 user nova-compute[73078]:   </cpu>
Aug 14 18:35:21 user nova-compute[73078]:   <devices>
Aug 14 18:35:21 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:35:21 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:35:21 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk"/>
Aug 14 18:35:21 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:35:21 user nova-compute[73078]:     </disk>
Aug 14 18:35:21 user nova-compute[73078]:     <disk type="block" device="disk">
Aug 14 18:35:21 user nova-compute[73078]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:35:21 user nova-compute[73078]:       <source dev="/dev/sdc"/>
Aug 14 18:35:21 user nova-compute[73078]:       <target dev="vdb" bus="virtio"/>
Aug 14 18:35:21 user nova-compute[73078]:       <serial>27eae141-3fe8-455c-9697-6bcfe0fefb99</serial>
Aug 14 18:35:21 user nova-compute[73078]:     </disk>
Aug 14 18:35:21 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:35:21 user nova-compute[73078]:       <mac address="fa:16:3e:62:78:e2"/>
Aug 14 18:35:21 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:35:21 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:35:21 user nova-compute[73078]:       <target dev="tap2dd60866-9e"/>
Aug 14 18:35:21 user nova-compute[73078]:     </interface>
Aug 14 18:35:21 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:35:21 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/console.log" append="off"/>
Aug 14 18:35:21 user nova-compute[73078]:     </serial>
Aug 14 18:35:21 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:35:21 user nova-compute[73078]:     <video>
Aug 14 18:35:21 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:35:21 user nova-compute[73078]:     </video>
Aug 14 18:35:21 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:35:21 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:35:21 user nova-compute[73078]:     </rng>
Aug 14 18:35:21 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:35:21 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:35:21 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:35:21 user nova-compute[73078]:     </memballoon>
Aug 14 18:35:21 user nova-compute[73078]:   </devices>
Aug 14 18:35:21 user nova-compute[73078]: </domain>
Aug 14 18:35:21 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:35:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:21 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:35:21 user nova-compute[73078]: DEBUG nova.objects.instance [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lazy-loading 'trusted_certs' on Instance uuid 16a18fae-165b-487b-bfd5-20097eac0a8e {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:35:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.180s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:21 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:35:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:21 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Cannot resize image /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:35:21 user nova-compute[73078]: DEBUG nova.objects.instance [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lazy-loading 'migration_context' on Instance uuid 16a18fae-165b-487b-bfd5-20097eac0a8e {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:35:21 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:31:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1523618791',display_name='tempest-AttachVolumeTestJSON-server-1523618791',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1523618791',id=41,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGt0IZUR45BoJPTktrLR+OSUIGX16DeSC3GRnxH2CMKh+NvhLefmy7aiMx94bvaYe2eBuYWP6rvvpzTkrEkuFVyTl4uoHzIOYqmCyqn8E4fpKgZ5Lep2EZjGHAoZGcIfQ==',key_name='tempest-keypair-1506094444',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:31:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='8c717b7be2814591a20db3c81bc5ba89',ramdisk_id='',reservation_id='r-j7btfmht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-120525527',owner_user_name='tempest-AttachVolumeTestJSON-120525527-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:33:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc0adf66a66f4f4fb698706b5d3294cd',uuid=16a18fae-165b-487b-bfd5-20097eac0a8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2dd60866-9ed8-4840-a797-893d81ab2b65", "address": "fa:16:3e:62:78:e2", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd60866-9e", "ovs_interfaceid": "2dd60866-9ed8-4840-a797-893d81ab2b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:35:21 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Converting VIF {"id": "2dd60866-9ed8-4840-a797-893d81ab2b65", "address": "fa:16:3e:62:78:e2", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd60866-9e", "ovs_interfaceid": "2dd60866-9ed8-4840-a797-893d81ab2b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:35:21 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:78:e2,bridge_name='br-int',has_traffic_filtering=True,id=2dd60866-9ed8-4840-a797-893d81ab2b65,network=Network(0e58d249-c00c-45c4-bc46-9d975b128a0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd60866-9e') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:35:21 user nova-compute[73078]: DEBUG os_vif [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:78:e2,bridge_name='br-int',has_traffic_filtering=True,id=2dd60866-9ed8-4840-a797-893d81ab2b65,network=Network(0e58d249-c00c-45c4-bc46-9d975b128a0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd60866-9e') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:35:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:35:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:35:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2dd60866-9e, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:35:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2dd60866-9e, col_values=(('external_ids', {'iface-id': '2dd60866-9ed8-4840-a797-893d81ab2b65', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:78:e2', 'vm-uuid': '16a18fae-165b-487b-bfd5-20097eac0a8e'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:35:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:35:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:21 user nova-compute[73078]: INFO os_vif [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:78:e2,bridge_name='br-int',has_traffic_filtering=True,id=2dd60866-9ed8-4840-a797-893d81ab2b65,network=Network(0e58d249-c00c-45c4-bc46-9d975b128a0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd60866-9e')
Aug 14 18:35:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:23 user nova-compute[73078]: DEBUG nova.compute.manager [req-6204b2ab-faca-46e7-8768-fc4de5fe2e4a req-29c1ed9d-30b5-4f0d-8c7a-5da1c04382e5 service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Received event network-vif-plugged-2dd60866-9ed8-4840-a797-893d81ab2b65 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:35:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6204b2ab-faca-46e7-8768-fc4de5fe2e4a req-29c1ed9d-30b5-4f0d-8c7a-5da1c04382e5 service nova] Acquiring lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:35:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6204b2ab-faca-46e7-8768-fc4de5fe2e4a req-29c1ed9d-30b5-4f0d-8c7a-5da1c04382e5 service nova] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:35:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6204b2ab-faca-46e7-8768-fc4de5fe2e4a req-29c1ed9d-30b5-4f0d-8c7a-5da1c04382e5 service nova] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:35:23 user nova-compute[73078]: DEBUG nova.compute.manager [req-6204b2ab-faca-46e7-8768-fc4de5fe2e4a req-29c1ed9d-30b5-4f0d-8c7a-5da1c04382e5 service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] No waiting events found dispatching network-vif-plugged-2dd60866-9ed8-4840-a797-893d81ab2b65 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:35:23 user nova-compute[73078]: WARNING nova.compute.manager [req-6204b2ab-faca-46e7-8768-fc4de5fe2e4a req-29c1ed9d-30b5-4f0d-8c7a-5da1c04382e5 service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Received unexpected event network-vif-plugged-2dd60866-9ed8-4840-a797-893d81ab2b65 for instance with vm_state stopped and task_state powering-on.
Aug 14 18:35:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:24 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692038109.3467126, 2f960239-8deb-4d9f-9cab-eea0274aca38 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:35:24 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] VM Stopped (Lifecycle Event)
Aug 14 18:35:24 user nova-compute[73078]: DEBUG nova.compute.manager [None req-67541074-7ecd-4be2-887a-62d60e9a5467 None None] [instance: 2f960239-8deb-4d9f-9cab-eea0274aca38] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:35:25 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692038125.3782847, 16a18fae-165b-487b-bfd5-20097eac0a8e => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:35:25 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] VM Resumed (Lifecycle Event)
Aug 14 18:35:25 user nova-compute[73078]: DEBUG nova.compute.manager [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:35:25 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Instance rebooted successfully.
Aug 14 18:35:25 user nova-compute[73078]: DEBUG nova.compute.manager [None req-32c623c4-491f-487a-a291-5cbc5cb3bfff tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:35:25 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:35:25 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:35:25 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 14 18:35:25 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692038125.3813727, 16a18fae-165b-487b-bfd5-20097eac0a8e => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:35:25 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] VM Started (Lifecycle Event)
Aug 14 18:35:25 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:35:25 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:35:25 user nova-compute[73078]: DEBUG nova.compute.manager [req-3a3dcd26-dac5-4f22-a029-54b31dcc4aac req-3b5d311f-dd03-406b-bd65-018547517651 service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Received event network-vif-plugged-2dd60866-9ed8-4840-a797-893d81ab2b65 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:35:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3a3dcd26-dac5-4f22-a029-54b31dcc4aac req-3b5d311f-dd03-406b-bd65-018547517651 service nova] Acquiring lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:35:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3a3dcd26-dac5-4f22-a029-54b31dcc4aac req-3b5d311f-dd03-406b-bd65-018547517651 service nova] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:35:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3a3dcd26-dac5-4f22-a029-54b31dcc4aac req-3b5d311f-dd03-406b-bd65-018547517651 service nova] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:35:25 user nova-compute[73078]: DEBUG nova.compute.manager [req-3a3dcd26-dac5-4f22-a029-54b31dcc4aac req-3b5d311f-dd03-406b-bd65-018547517651 service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] No waiting events found dispatching network-vif-plugged-2dd60866-9ed8-4840-a797-893d81ab2b65 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:35:25 user nova-compute[73078]: WARNING nova.compute.manager [req-3a3dcd26-dac5-4f22-a029-54b31dcc4aac req-3b5d311f-dd03-406b-bd65-018547517651 service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Received unexpected event network-vif-plugged-2dd60866-9ed8-4840-a797-893d81ab2b65 for instance with vm_state active and task_state None.
Aug 14 18:35:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:27 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692038112.1540694, 8bb1bc98-12ee-4a5b-91db-6e66966c482f => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:35:27 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] VM Stopped (Lifecycle Event)
Aug 14 18:35:27 user nova-compute[73078]: DEBUG nova.compute.manager [None req-556b837f-8a47-4abf-8101-15b3cafbfcec None None] [instance: 8bb1bc98-12ee-4a5b-91db-6e66966c482f] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:35:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "a4f1ae2d-5927-4931-bddf-5f503c4a94c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:35:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "a4f1ae2d-5927-4931-bddf-5f503c4a94c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:35:32 user nova-compute[73078]: DEBUG nova.compute.manager [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:35:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:35:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:35:32 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:35:32 user nova-compute[73078]: INFO nova.compute.claims [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Claim successful on node user
Aug 14 18:35:33 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:35:33 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:35:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.300s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:35:33 user nova-compute[73078]: DEBUG nova.compute.manager [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:35:33 user nova-compute[73078]: DEBUG nova.compute.manager [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:35:33 user nova-compute[73078]: DEBUG nova.network.neutron [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:35:33 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:35:33 user nova-compute[73078]: DEBUG nova.compute.manager [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:35:33 user nova-compute[73078]: INFO nova.virt.block_device [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Booting with volume 70705684-d58a-4b0f-82c9-6285bf674aa9 at /dev/vda
Aug 14 18:35:33 user nova-compute[73078]: DEBUG nova.policy [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe79455616584e0fb80e6007edf0b706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7142101014c4defa7261a34fb9f28e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:35:33 user nova-compute[73078]: DEBUG os_brick.utils [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:35:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:33 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e41755-c8a5-4c99-a0cb-f0f53fb4ffdd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:35:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:33 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[590bfa5c-2e34-4c4a-ada7-e23926d2c456]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:35:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:33 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a7e2ba-6ae3-49ed-986e-a34552258793]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:35:33 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c23e051-1d3d-4437-af83-dd3f3adfd51a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:35:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:35:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:35:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:35:33 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:35:33 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6088cb-e1ca-49a5-bc7b-91f498ea8089]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:35:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:35:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:35:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:35:33 user nova-compute[73078]: DEBUG os_brick.utils [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:35:33 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Updating existing volume attachment record: ff131fa1-04d9-4448-a047-0f7459f156b5 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:35:34 user nova-compute[73078]: DEBUG nova.network.neutron [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Successfully created port: a6d271b4-5e17-46ed-b704-9b7a84ab1c95 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:35:34 user nova-compute[73078]: DEBUG nova.network.neutron [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Successfully updated port: a6d271b4-5e17-46ed-b704-9b7a84ab1c95 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:35:34 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "refresh_cache-a4f1ae2d-5927-4931-bddf-5f503c4a94c7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:35:34 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquired lock "refresh_cache-a4f1ae2d-5927-4931-bddf-5f503c4a94c7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:35:34 user nova-compute[73078]: DEBUG nova.network.neutron [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:35:34 user nova-compute[73078]: DEBUG nova.compute.manager [req-cb3f3ba5-3cc5-42f3-83a8-89a59bb5f196 req-63dd23f6-3c59-427e-8704-5f0ab048931c service nova] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Received event network-changed-a6d271b4-5e17-46ed-b704-9b7a84ab1c95 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:35:34 user nova-compute[73078]: DEBUG nova.compute.manager [req-cb3f3ba5-3cc5-42f3-83a8-89a59bb5f196 req-63dd23f6-3c59-427e-8704-5f0ab048931c service nova] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Refreshing instance network info cache due to event network-changed-a6d271b4-5e17-46ed-b704-9b7a84ab1c95. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:35:34 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-cb3f3ba5-3cc5-42f3-83a8-89a59bb5f196 req-63dd23f6-3c59-427e-8704-5f0ab048931c service nova] Acquiring lock "refresh_cache-a4f1ae2d-5927-4931-bddf-5f503c4a94c7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:35:34 user nova-compute[73078]: DEBUG nova.network.neutron [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:35:35 user nova-compute[73078]: DEBUG nova.network.neutron [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Updating instance_info_cache with network_info: [{"id": "a6d271b4-5e17-46ed-b704-9b7a84ab1c95", "address": "fa:16:3e:28:7f:6d", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d271b4-5e", "ovs_interfaceid": "a6d271b4-5e17-46ed-b704-9b7a84ab1c95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:35:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Releasing lock "refresh_cache-a4f1ae2d-5927-4931-bddf-5f503c4a94c7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:35:35 user nova-compute[73078]: DEBUG nova.compute.manager [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Instance network_info: |[{"id": "a6d271b4-5e17-46ed-b704-9b7a84ab1c95", "address": "fa:16:3e:28:7f:6d", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d271b4-5e", "ovs_interfaceid": "a6d271b4-5e17-46ed-b704-9b7a84ab1c95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:35:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-cb3f3ba5-3cc5-42f3-83a8-89a59bb5f196 req-63dd23f6-3c59-427e-8704-5f0ab048931c service nova] Acquired lock "refresh_cache-a4f1ae2d-5927-4931-bddf-5f503c4a94c7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:35:35 user nova-compute[73078]: DEBUG nova.network.neutron [req-cb3f3ba5-3cc5-42f3-83a8-89a59bb5f196 req-63dd23f6-3c59-427e-8704-5f0ab048931c service nova] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Refreshing network info cache for port a6d271b4-5e17-46ed-b704-9b7a84ab1c95 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:35:35 user nova-compute[73078]: DEBUG nova.network.neutron [req-cb3f3ba5-3cc5-42f3-83a8-89a59bb5f196 req-63dd23f6-3c59-427e-8704-5f0ab048931c service nova] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Updated VIF entry in instance network info cache for port a6d271b4-5e17-46ed-b704-9b7a84ab1c95. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:35:35 user nova-compute[73078]: DEBUG nova.network.neutron [req-cb3f3ba5-3cc5-42f3-83a8-89a59bb5f196 req-63dd23f6-3c59-427e-8704-5f0ab048931c service nova] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Updating instance_info_cache with network_info: [{"id": "a6d271b4-5e17-46ed-b704-9b7a84ab1c95", "address": "fa:16:3e:28:7f:6d", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d271b4-5e", "ovs_interfaceid": "a6d271b4-5e17-46ed-b704-9b7a84ab1c95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:35:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-cb3f3ba5-3cc5-42f3-83a8-89a59bb5f196 req-63dd23f6-3c59-427e-8704-5f0ab048931c service nova] Releasing lock "refresh_cache-a4f1ae2d-5927-4931-bddf-5f503c4a94c7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:35:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG nova.compute.manager [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:35:42 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Creating image(s)
Aug 14 18:35:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Did not create local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Ensure instance console log exists: /opt/stack/data/nova/instances/a4f1ae2d-5927-4931-bddf-5f503c4a94c7/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Start _get_guest_xml network_info=[{"id": "a6d271b4-5e17-46ed-b704-9b7a84ab1c95", "address": "fa:16:3e:28:7f:6d", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d271b4-5e", "ovs_interfaceid": "a6d271b4-5e17-46ed-b704-9b7a84ab1c95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'ff131fa1-04d9-4448-a047-0f7459f156b5', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lEybjUpx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a4f1ae2d-5927-4931-bddf-5f503c4a94c7', 'attached_at': '', 'detached_at': '', 'volume_id': '70705684-d58a-4b0f-82c9-6285bf674aa9', 'serial': '70705684-d58a-4b0f-82c9-6285bf674aa9'}, 'volume_type': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:35:42 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:35:42 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:35:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lEybjUpx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:35:42 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:35:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:35:42 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:35:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:35:42 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:35:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[35673da3-1646-4281-96a3-e5fec61882dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:35:42 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c7b0ed-08fc-4712-9370-1145ecb7e6bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9] added
Aug 14 18:35:42 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1550cd-b28a-4b68-9dce-47d9fb7ac39b]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbaebc6f-a432-4260-a48c-a6a064eb1930]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lEybjUpx {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lEybjUpx" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c760a37-835b-4587-a83d-c41c8ee3b76d]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lEybjUpx'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.106s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[95eb6b00-10a1-4152-9cde-ff4f98de5379]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[56862c2b-629f-4908-8b88-455cc7d49d60]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:35:42 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:35:42 user nova-compute[73078]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)
Aug 14 18:35:42 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:35:42 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:35:42 user nova-compute[73078]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)
Aug 14 18:35:42 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[58908572-4662-48b8-bc38-795fe609148f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9, portal: 172.16.0.220,3260]
Aug 14 18:35:42 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9, portal: 172.16.0.220,3260] successful.
Aug 14 18:35:42 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9576c7-6fa3-4e70-bfc7-622c8f906e9f]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[345ac6b5-1784-4957-a8eb-1086ee4d2834]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:35:42 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:35:42 user nova-compute[73078]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)
Aug 14 18:35:42 user nova-compute[73078]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:35:42 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:35:42 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:35:42 user nova-compute[73078]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)
Aug 14 18:35:42 user nova-compute[73078]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:35:42 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] HCTL ('36', '-', '-', 0) found on session 56 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:35:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[24584768-b1bf-45bb-aced-bb4c52a93e25]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:35:43 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Searching for a device in session 56 and hctl ['36', '*', '*', 0] yield: None {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:35:43 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:43 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Searching for a device in session 56 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:35:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lEybjUpx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:35:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:35:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '23231393536303265', 'path': '/dev/sde'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:35:43 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231393536303265', 'path': '/dev/sde'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:35:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:35:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1988570499',display_name='tempest-TestVolumeBootPattern-server-1988570499',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1988570499',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU8q8wtxkW9pROl2j0NkoRwpKKcmziB/20QEkNRAKEXt/Sm0AgtPtqW4EQeZ9Nz+9SI3khJoGje9+NMiFY56dE76HSwv/RbWY1Ab2OSscMaXE4ftFHwz3mwUt13yK/iVg==',key_name='tempest-TestVolumeBootPattern-511986969',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7142101014c4defa7261a34fb9f28e4',ramdisk_id='',reservation_id='r-enisliqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1889877750',owner_user_name='tempest-TestVolumeBootPattern-1889877750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:35:33Z,user_data=None,user_id='fe79455616584e0fb80e6007edf0b706',uuid=a4f1ae2d-5927-4931-bddf-5f503c4a94c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6d271b4-5e17-46ed-b704-9b7a84ab1c95", "address": "fa:16:3e:28:7f:6d", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d271b4-5e", "ovs_interfaceid": "a6d271b4-5e17-46ed-b704-9b7a84ab1c95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:35:44 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Converting VIF {"id": "a6d271b4-5e17-46ed-b704-9b7a84ab1c95", "address": "fa:16:3e:28:7f:6d", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d271b4-5e", "ovs_interfaceid": "a6d271b4-5e17-46ed-b704-9b7a84ab1c95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:35:44 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:7f:6d,bridge_name='br-int',has_traffic_filtering=True,id=a6d271b4-5e17-46ed-b704-9b7a84ab1c95,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6d271b4-5e') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:35:44 user nova-compute[73078]: DEBUG nova.objects.instance [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lazy-loading 'pci_devices' on Instance uuid a4f1ae2d-5927-4931-bddf-5f503c4a94c7 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:35:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:35:44 user nova-compute[73078]:   <uuid>a4f1ae2d-5927-4931-bddf-5f503c4a94c7</uuid>
Aug 14 18:35:44 user nova-compute[73078]:   <name>instance-0000002d</name>
Aug 14 18:35:44 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:35:44 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:35:44 user nova-compute[73078]:   <metadata>
Aug 14 18:35:44 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:35:44 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:35:44 user nova-compute[73078]:       <nova:name>tempest-TestVolumeBootPattern-server-1988570499</nova:name>
Aug 14 18:35:44 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:35:42</nova:creationTime>
Aug 14 18:35:44 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:35:44 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:35:44 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:35:44 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:35:44 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:35:44 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:35:44 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:35:44 user nova-compute[73078]:       <nova:owner>
Aug 14 18:35:44 user nova-compute[73078]:         <nova:user uuid="fe79455616584e0fb80e6007edf0b706">tempest-TestVolumeBootPattern-1889877750-project-member</nova:user>
Aug 14 18:35:44 user nova-compute[73078]:         <nova:project uuid="e7142101014c4defa7261a34fb9f28e4">tempest-TestVolumeBootPattern-1889877750</nova:project>
Aug 14 18:35:44 user nova-compute[73078]:       </nova:owner>
Aug 14 18:35:44 user nova-compute[73078]:       <nova:ports>
Aug 14 18:35:44 user nova-compute[73078]:         <nova:port uuid="a6d271b4-5e17-46ed-b704-9b7a84ab1c95">
Aug 14 18:35:44 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 14 18:35:44 user nova-compute[73078]:         </nova:port>
Aug 14 18:35:44 user nova-compute[73078]:       </nova:ports>
Aug 14 18:35:44 user nova-compute[73078]:     </nova:instance>
Aug 14 18:35:44 user nova-compute[73078]:   </metadata>
Aug 14 18:35:44 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:35:44 user nova-compute[73078]:     <system>
Aug 14 18:35:44 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:35:44 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:35:44 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:35:44 user nova-compute[73078]:       <entry name="serial">a4f1ae2d-5927-4931-bddf-5f503c4a94c7</entry>
Aug 14 18:35:44 user nova-compute[73078]:       <entry name="uuid">a4f1ae2d-5927-4931-bddf-5f503c4a94c7</entry>
Aug 14 18:35:44 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:35:44 user nova-compute[73078]:     </system>
Aug 14 18:35:44 user nova-compute[73078]:   </sysinfo>
Aug 14 18:35:44 user nova-compute[73078]:   <os>
Aug 14 18:35:44 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:35:44 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:35:44 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:35:44 user nova-compute[73078]:   </os>
Aug 14 18:35:44 user nova-compute[73078]:   <features>
Aug 14 18:35:44 user nova-compute[73078]:     <acpi/>
Aug 14 18:35:44 user nova-compute[73078]:     <apic/>
Aug 14 18:35:44 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:35:44 user nova-compute[73078]:   </features>
Aug 14 18:35:44 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:35:44 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:35:44 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:35:44 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:35:44 user nova-compute[73078]:   </clock>
Aug 14 18:35:44 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:35:44 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:35:44 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:35:44 user nova-compute[73078]:   </cpu>
Aug 14 18:35:44 user nova-compute[73078]:   <devices>
Aug 14 18:35:44 user nova-compute[73078]:     <disk type="block" device="disk">
Aug 14 18:35:44 user nova-compute[73078]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:35:44 user nova-compute[73078]:       <source dev="/dev/sde"/>
Aug 14 18:35:44 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:35:44 user nova-compute[73078]:       <serial>70705684-d58a-4b0f-82c9-6285bf674aa9</serial>
Aug 14 18:35:44 user nova-compute[73078]:     </disk>
Aug 14 18:35:44 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:35:44 user nova-compute[73078]:       <mac address="fa:16:3e:28:7f:6d"/>
Aug 14 18:35:44 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:35:44 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:35:44 user nova-compute[73078]:       <target dev="tapa6d271b4-5e"/>
Aug 14 18:35:44 user nova-compute[73078]:     </interface>
Aug 14 18:35:44 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:35:44 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/a4f1ae2d-5927-4931-bddf-5f503c4a94c7/console.log" append="off"/>
Aug 14 18:35:44 user nova-compute[73078]:     </serial>
Aug 14 18:35:44 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:35:44 user nova-compute[73078]:     <video>
Aug 14 18:35:44 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:35:44 user nova-compute[73078]:     </video>
Aug 14 18:35:44 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:35:44 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:35:44 user nova-compute[73078]:     </rng>
Aug 14 18:35:44 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:35:44 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:35:44 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:35:44 user nova-compute[73078]:     </memballoon>
Aug 14 18:35:44 user nova-compute[73078]:   </devices>
Aug 14 18:35:44 user nova-compute[73078]: </domain>
Aug 14 18:35:44 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:35:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:35:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1988570499',display_name='tempest-TestVolumeBootPattern-server-1988570499',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1988570499',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU8q8wtxkW9pROl2j0NkoRwpKKcmziB/20QEkNRAKEXt/Sm0AgtPtqW4EQeZ9Nz+9SI3khJoGje9+NMiFY56dE76HSwv/RbWY1Ab2OSscMaXE4ftFHwz3mwUt13yK/iVg==',key_name='tempest-TestVolumeBootPattern-511986969',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7142101014c4defa7261a34fb9f28e4',ramdisk_id='',reservation_id='r-enisliqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1889877750',owner_user_name='tempest-TestVolumeBootPattern-1889877750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:35:33Z,user_data=None,user_id='fe79455616584e0fb80e6007edf0b706',uuid=a4f1ae2d-5927-4931-bddf-5f503c4a94c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6d271b4-5e17-46ed-b704-9b7a84ab1c95", "address": "fa:16:3e:28:7f:6d", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d271b4-5e", "ovs_interfaceid": "a6d271b4-5e17-46ed-b704-9b7a84ab1c95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:35:44 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Converting VIF {"id": "a6d271b4-5e17-46ed-b704-9b7a84ab1c95", "address": "fa:16:3e:28:7f:6d", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d271b4-5e", "ovs_interfaceid": "a6d271b4-5e17-46ed-b704-9b7a84ab1c95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:35:44 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:7f:6d,bridge_name='br-int',has_traffic_filtering=True,id=a6d271b4-5e17-46ed-b704-9b7a84ab1c95,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6d271b4-5e') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:35:44 user nova-compute[73078]: DEBUG os_vif [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:7f:6d,bridge_name='br-int',has_traffic_filtering=True,id=a6d271b4-5e17-46ed-b704-9b7a84ab1c95,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6d271b4-5e') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:35:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:35:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:35:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6d271b4-5e, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:35:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa6d271b4-5e, col_values=(('external_ids', {'iface-id': 'a6d271b4-5e17-46ed-b704-9b7a84ab1c95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:7f:6d', 'vm-uuid': 'a4f1ae2d-5927-4931-bddf-5f503c4a94c7'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:35:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:35:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:44 user nova-compute[73078]: INFO os_vif [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:7f:6d,bridge_name='br-int',has_traffic_filtering=True,id=a6d271b4-5e17-46ed-b704-9b7a84ab1c95,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6d271b4-5e')
Aug 14 18:35:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:35:44 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] No VIF found with MAC fa:16:3e:28:7f:6d, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:35:45 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:45 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:45 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:45 user nova-compute[73078]: DEBUG nova.compute.manager [req-8ff5b3a6-c0f2-4631-a2b8-5766dae2c480 req-9dfc1b2e-ee32-4a4d-ab43-7ff5eec70cf7 service nova] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Received event network-vif-plugged-a6d271b4-5e17-46ed-b704-9b7a84ab1c95 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:35:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-8ff5b3a6-c0f2-4631-a2b8-5766dae2c480 req-9dfc1b2e-ee32-4a4d-ab43-7ff5eec70cf7 service nova] Acquiring lock "a4f1ae2d-5927-4931-bddf-5f503c4a94c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:35:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-8ff5b3a6-c0f2-4631-a2b8-5766dae2c480 req-9dfc1b2e-ee32-4a4d-ab43-7ff5eec70cf7 service nova] Lock "a4f1ae2d-5927-4931-bddf-5f503c4a94c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:35:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-8ff5b3a6-c0f2-4631-a2b8-5766dae2c480 req-9dfc1b2e-ee32-4a4d-ab43-7ff5eec70cf7 service nova] Lock "a4f1ae2d-5927-4931-bddf-5f503c4a94c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:35:45 user nova-compute[73078]: DEBUG nova.compute.manager [req-8ff5b3a6-c0f2-4631-a2b8-5766dae2c480 req-9dfc1b2e-ee32-4a4d-ab43-7ff5eec70cf7 service nova] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] No waiting events found dispatching network-vif-plugged-a6d271b4-5e17-46ed-b704-9b7a84ab1c95 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:35:45 user nova-compute[73078]: WARNING nova.compute.manager [req-8ff5b3a6-c0f2-4631-a2b8-5766dae2c480 req-9dfc1b2e-ee32-4a4d-ab43-7ff5eec70cf7 service nova] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Received unexpected event network-vif-plugged-a6d271b4-5e17-46ed-b704-9b7a84ab1c95 for instance with vm_state building and task_state spawning.
Aug 14 18:35:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:47 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692038147.4718945, a4f1ae2d-5927-4931-bddf-5f503c4a94c7 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:35:47 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] VM Resumed (Lifecycle Event)
Aug 14 18:35:47 user nova-compute[73078]: DEBUG nova.compute.manager [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:35:47 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:35:47 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Instance spawned successfully.
Aug 14 18:35:47 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:35:47 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:35:47 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:35:47 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:35:47 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:35:47 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:35:47 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:35:47 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:35:47 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:35:47 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:35:47 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692038147.4754095, a4f1ae2d-5927-4931-bddf-5f503c4a94c7 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:35:47 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] VM Started (Lifecycle Event)
Aug 14 18:35:47 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:35:47 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:35:47 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:35:47 user nova-compute[73078]: INFO nova.compute.manager [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Took 5.03 seconds to spawn the instance on the hypervisor.
Aug 14 18:35:47 user nova-compute[73078]: DEBUG nova.compute.manager [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:35:47 user nova-compute[73078]: INFO nova.compute.manager [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Took 14.73 seconds to build instance.
Aug 14 18:35:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-43be309b-5502-4898-93fd-02c864d95e11 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "a4f1ae2d-5927-4931-bddf-5f503c4a94c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.835s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:35:47 user nova-compute[73078]: DEBUG nova.compute.manager [req-3b063f0d-7149-4676-8acc-6f06be2c8082 req-1c9c0189-eb44-40ae-8c73-b956139ae285 service nova] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Received event network-vif-plugged-a6d271b4-5e17-46ed-b704-9b7a84ab1c95 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:35:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3b063f0d-7149-4676-8acc-6f06be2c8082 req-1c9c0189-eb44-40ae-8c73-b956139ae285 service nova] Acquiring lock "a4f1ae2d-5927-4931-bddf-5f503c4a94c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:35:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3b063f0d-7149-4676-8acc-6f06be2c8082 req-1c9c0189-eb44-40ae-8c73-b956139ae285 service nova] Lock "a4f1ae2d-5927-4931-bddf-5f503c4a94c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:35:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3b063f0d-7149-4676-8acc-6f06be2c8082 req-1c9c0189-eb44-40ae-8c73-b956139ae285 service nova] Lock "a4f1ae2d-5927-4931-bddf-5f503c4a94c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:35:47 user nova-compute[73078]: DEBUG nova.compute.manager [req-3b063f0d-7149-4676-8acc-6f06be2c8082 req-1c9c0189-eb44-40ae-8c73-b956139ae285 service nova] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] No waiting events found dispatching network-vif-plugged-a6d271b4-5e17-46ed-b704-9b7a84ab1c95 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:35:47 user nova-compute[73078]: WARNING nova.compute.manager [req-3b063f0d-7149-4676-8acc-6f06be2c8082 req-1c9c0189-eb44-40ae-8c73-b956139ae285 service nova] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Received unexpected event network-vif-plugged-a6d271b4-5e17-46ed-b704-9b7a84ab1c95 for instance with vm_state active and task_state None.
Aug 14 18:35:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:35:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:02 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:36:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:36:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:36:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:36:02 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:36:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:36:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:36:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:36:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:36:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:36:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:36:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:36:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:36:02 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:36:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:36:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:36:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:36:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:36:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:36:03 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:36:03 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:36:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7d44f5-3616-4dba-a851-b6f7dddbad32/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:36:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7d44f5-3616-4dba-a851-b6f7dddbad32/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:36:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7d44f5-3616-4dba-a851-b6f7dddbad32/disk.rescue --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:36:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc7d44f5-3616-4dba-a851-b6f7dddbad32/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:36:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:04 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:36:04 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:36:04 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=8043MB free_disk=24.877281188964844GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:36:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:36:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:36:04 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 61dfe42b-c943-4617-bf8e-745eaf1a1bb8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:36:04 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 3088da30-65b7-4801-b425-93df4fca6ad8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:36:04 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance ebbaec07-9843-4cc0-bcb6-f993e62d88c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:36:04 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 16a18fae-165b-487b-bfd5-20097eac0a8e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:36:04 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance fc7d44f5-3616-4dba-a851-b6f7dddbad32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:36:04 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance a4f1ae2d-5927-4931-bddf-5f503c4a94c7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:36:04 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:36:04 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:36:04 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:36:04 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:36:04 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:36:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.439s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:36:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "6777b9e0-9d18-4d13-951c-fafc510455f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:36:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "6777b9e0-9d18-4d13-951c-fafc510455f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:36:06 user nova-compute[73078]: DEBUG nova.compute.manager [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:36:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:36:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:36:06 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:36:06 user nova-compute[73078]: INFO nova.compute.claims [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Claim successful on node user
Aug 14 18:36:06 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:36:06 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:36:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.332s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:36:06 user nova-compute[73078]: DEBUG nova.compute.manager [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:36:06 user nova-compute[73078]: DEBUG nova.compute.manager [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:36:06 user nova-compute[73078]: DEBUG nova.network.neutron [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:36:06 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:36:06 user nova-compute[73078]: DEBUG nova.compute.manager [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:36:06 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:36:06 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:36:06 user nova-compute[73078]: DEBUG nova.policy [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a3c5d292e9594e4aadad9ac72b9455ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1391a0a2167745348384e5890e6c22db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:36:06 user nova-compute[73078]: DEBUG nova.compute.manager [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:36:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:36:06 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Creating image(s)
Aug 14 18:36:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "/opt/stack/data/nova/instances/6777b9e0-9d18-4d13-951c-fafc510455f0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:36:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "/opt/stack/data/nova/instances/6777b9e0-9d18-4d13-951c-fafc510455f0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:36:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "/opt/stack/data/nova/instances/6777b9e0-9d18-4d13-951c-fafc510455f0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:36:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:36:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-16a18fae-165b-487b-bfd5-20097eac0a8e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:36:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-16a18fae-165b-487b-bfd5-20097eac0a8e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:36:06 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:36:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.231s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:36:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:36:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:36:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:36:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.206s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:36:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/6777b9e0-9d18-4d13-951c-fafc510455f0/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:36:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/6777b9e0-9d18-4d13-951c-fafc510455f0/disk 1073741824" returned: 0 in 0.049s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:36:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:36:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:36:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.244s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:36:07 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6777b9e0-9d18-4d13-951c-fafc510455f0/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:36:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6777b9e0-9d18-4d13-951c-fafc510455f0/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:36:07 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Updating instance_info_cache with network_info: [{"id": "2dd60866-9ed8-4840-a797-893d81ab2b65", "address": "fa:16:3e:62:78:e2", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd60866-9e", "ovs_interfaceid": "2dd60866-9ed8-4840-a797-893d81ab2b65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:36:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-16a18fae-165b-487b-bfd5-20097eac0a8e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:36:07 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:36:07 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:36:07 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:36:07 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:36:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6777b9e0-9d18-4d13-951c-fafc510455f0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:36:07 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Cannot resize image /opt/stack/data/nova/instances/6777b9e0-9d18-4d13-951c-fafc510455f0/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:36:07 user nova-compute[73078]: DEBUG nova.objects.instance [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lazy-loading 'migration_context' on Instance uuid 6777b9e0-9d18-4d13-951c-fafc510455f0 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:36:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:36:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Ensure instance console log exists: /opt/stack/data/nova/instances/6777b9e0-9d18-4d13-951c-fafc510455f0/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:36:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:36:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:36:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:36:07 user nova-compute[73078]: DEBUG nova.network.neutron [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Successfully created port: e0ff7e14-ffa9-4b21-952f-e0ccba875282 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:36:08 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:36:08 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:36:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:08 user nova-compute[73078]: DEBUG nova.network.neutron [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Successfully updated port: e0ff7e14-ffa9-4b21-952f-e0ccba875282 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:36:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "refresh_cache-6777b9e0-9d18-4d13-951c-fafc510455f0" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:36:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquired lock "refresh_cache-6777b9e0-9d18-4d13-951c-fafc510455f0" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:36:08 user nova-compute[73078]: DEBUG nova.network.neutron [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:36:08 user nova-compute[73078]: DEBUG nova.compute.manager [req-da332294-895c-4b45-a2dd-8dc52c38560f req-823e9de0-8ae5-4342-9892-8d038cdc459e service nova] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Received event network-changed-e0ff7e14-ffa9-4b21-952f-e0ccba875282 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:36:08 user nova-compute[73078]: DEBUG nova.compute.manager [req-da332294-895c-4b45-a2dd-8dc52c38560f req-823e9de0-8ae5-4342-9892-8d038cdc459e service nova] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Refreshing instance network info cache due to event network-changed-e0ff7e14-ffa9-4b21-952f-e0ccba875282. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:36:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-da332294-895c-4b45-a2dd-8dc52c38560f req-823e9de0-8ae5-4342-9892-8d038cdc459e service nova] Acquiring lock "refresh_cache-6777b9e0-9d18-4d13-951c-fafc510455f0" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:36:08 user nova-compute[73078]: DEBUG nova.network.neutron [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG nova.network.neutron [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Updating instance_info_cache with network_info: [{"id": "e0ff7e14-ffa9-4b21-952f-e0ccba875282", "address": "fa:16:3e:6f:82:6c", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ff7e14-ff", "ovs_interfaceid": "e0ff7e14-ffa9-4b21-952f-e0ccba875282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Releasing lock "refresh_cache-6777b9e0-9d18-4d13-951c-fafc510455f0" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG nova.compute.manager [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Instance network_info: |[{"id": "e0ff7e14-ffa9-4b21-952f-e0ccba875282", "address": "fa:16:3e:6f:82:6c", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ff7e14-ff", "ovs_interfaceid": "e0ff7e14-ffa9-4b21-952f-e0ccba875282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-da332294-895c-4b45-a2dd-8dc52c38560f req-823e9de0-8ae5-4342-9892-8d038cdc459e service nova] Acquired lock "refresh_cache-6777b9e0-9d18-4d13-951c-fafc510455f0" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG nova.network.neutron [req-da332294-895c-4b45-a2dd-8dc52c38560f req-823e9de0-8ae5-4342-9892-8d038cdc459e service nova] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Refreshing network info cache for port e0ff7e14-ffa9-4b21-952f-e0ccba875282 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Start _get_guest_xml network_info=[{"id": "e0ff7e14-ffa9-4b21-952f-e0ccba875282", "address": "fa:16:3e:6f:82:6c", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ff7e14-ff", "ovs_interfaceid": "e0ff7e14-ffa9-4b21-952f-e0ccba875282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:36:09 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:36:09 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:36:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:36:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1196654936',display_name='tempest-AttachVolumeNegativeTest-server-1196654936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1196654936',id=46,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrvEmHWXecaxLbRJ3TmKwkerkY+E2by6Bss6FNHwqACqgdOaqzTiLKpNH1TIfdeiR3FZAxHwhzhiioXjp5+W/xDT8SuQ5FjRy6lFJIwYh8P1JZqwXlz3TtCf7Yf1yJNLQ==',key_name='tempest-keypair-1427128972',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1391a0a2167745348384e5890e6c22db',ramdisk_id='',reservation_id='r-ehwousd4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1671295372',owner_user_name='tempest-AttachVolumeNegativeTest-1671295372-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:36:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3c5d292e9594e4aadad9ac72b9455ed',uuid=6777b9e0-9d18-4d13-951c-fafc510455f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0ff7e14-ffa9-4b21-952f-e0ccba875282", "address": "fa:16:3e:6f:82:6c", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ff7e14-ff", "ovs_interfaceid": "e0ff7e14-ffa9-4b21-952f-e0ccba875282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Converting VIF {"id": "e0ff7e14-ffa9-4b21-952f-e0ccba875282", "address": "fa:16:3e:6f:82:6c", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ff7e14-ff", "ovs_interfaceid": "e0ff7e14-ffa9-4b21-952f-e0ccba875282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:82:6c,bridge_name='br-int',has_traffic_filtering=True,id=e0ff7e14-ffa9-4b21-952f-e0ccba875282,network=Network(88e922e4-ec89-460a-954d-aff20a41293c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0ff7e14-ff') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG nova.objects.instance [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lazy-loading 'pci_devices' on Instance uuid 6777b9e0-9d18-4d13-951c-fafc510455f0 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:36:09 user nova-compute[73078]:   <uuid>6777b9e0-9d18-4d13-951c-fafc510455f0</uuid>
Aug 14 18:36:09 user nova-compute[73078]:   <name>instance-0000002e</name>
Aug 14 18:36:09 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:36:09 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:36:09 user nova-compute[73078]:   <metadata>
Aug 14 18:36:09 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:36:09 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:36:09 user nova-compute[73078]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1196654936</nova:name>
Aug 14 18:36:09 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:36:09</nova:creationTime>
Aug 14 18:36:09 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:36:09 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:36:09 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:36:09 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:36:09 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:36:09 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:36:09 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:36:09 user nova-compute[73078]:       <nova:owner>
Aug 14 18:36:09 user nova-compute[73078]:         <nova:user uuid="a3c5d292e9594e4aadad9ac72b9455ed">tempest-AttachVolumeNegativeTest-1671295372-project-member</nova:user>
Aug 14 18:36:09 user nova-compute[73078]:         <nova:project uuid="1391a0a2167745348384e5890e6c22db">tempest-AttachVolumeNegativeTest-1671295372</nova:project>
Aug 14 18:36:09 user nova-compute[73078]:       </nova:owner>
Aug 14 18:36:09 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:36:09 user nova-compute[73078]:       <nova:ports>
Aug 14 18:36:09 user nova-compute[73078]:         <nova:port uuid="e0ff7e14-ffa9-4b21-952f-e0ccba875282">
Aug 14 18:36:09 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 18:36:09 user nova-compute[73078]:         </nova:port>
Aug 14 18:36:09 user nova-compute[73078]:       </nova:ports>
Aug 14 18:36:09 user nova-compute[73078]:     </nova:instance>
Aug 14 18:36:09 user nova-compute[73078]:   </metadata>
Aug 14 18:36:09 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:36:09 user nova-compute[73078]:     <system>
Aug 14 18:36:09 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:36:09 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:36:09 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:36:09 user nova-compute[73078]:       <entry name="serial">6777b9e0-9d18-4d13-951c-fafc510455f0</entry>
Aug 14 18:36:09 user nova-compute[73078]:       <entry name="uuid">6777b9e0-9d18-4d13-951c-fafc510455f0</entry>
Aug 14 18:36:09 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:36:09 user nova-compute[73078]:     </system>
Aug 14 18:36:09 user nova-compute[73078]:   </sysinfo>
Aug 14 18:36:09 user nova-compute[73078]:   <os>
Aug 14 18:36:09 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:36:09 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:36:09 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:36:09 user nova-compute[73078]:   </os>
Aug 14 18:36:09 user nova-compute[73078]:   <features>
Aug 14 18:36:09 user nova-compute[73078]:     <acpi/>
Aug 14 18:36:09 user nova-compute[73078]:     <apic/>
Aug 14 18:36:09 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:36:09 user nova-compute[73078]:   </features>
Aug 14 18:36:09 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:36:09 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:36:09 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:36:09 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:36:09 user nova-compute[73078]:   </clock>
Aug 14 18:36:09 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:36:09 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:36:09 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:36:09 user nova-compute[73078]:   </cpu>
Aug 14 18:36:09 user nova-compute[73078]:   <devices>
Aug 14 18:36:09 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:36:09 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:36:09 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/6777b9e0-9d18-4d13-951c-fafc510455f0/disk"/>
Aug 14 18:36:09 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:36:09 user nova-compute[73078]:     </disk>
Aug 14 18:36:09 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:36:09 user nova-compute[73078]:       <mac address="fa:16:3e:6f:82:6c"/>
Aug 14 18:36:09 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:36:09 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:36:09 user nova-compute[73078]:       <target dev="tape0ff7e14-ff"/>
Aug 14 18:36:09 user nova-compute[73078]:     </interface>
Aug 14 18:36:09 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:36:09 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/6777b9e0-9d18-4d13-951c-fafc510455f0/console.log" append="off"/>
Aug 14 18:36:09 user nova-compute[73078]:     </serial>
Aug 14 18:36:09 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:36:09 user nova-compute[73078]:     <video>
Aug 14 18:36:09 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:36:09 user nova-compute[73078]:     </video>
Aug 14 18:36:09 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:36:09 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:36:09 user nova-compute[73078]:     </rng>
Aug 14 18:36:09 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:36:09 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:36:09 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:36:09 user nova-compute[73078]:     </memballoon>
Aug 14 18:36:09 user nova-compute[73078]:   </devices>
Aug 14 18:36:09 user nova-compute[73078]: </domain>
Aug 14 18:36:09 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:36:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1196654936',display_name='tempest-AttachVolumeNegativeTest-server-1196654936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1196654936',id=46,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrvEmHWXecaxLbRJ3TmKwkerkY+E2by6Bss6FNHwqACqgdOaqzTiLKpNH1TIfdeiR3FZAxHwhzhiioXjp5+W/xDT8SuQ5FjRy6lFJIwYh8P1JZqwXlz3TtCf7Yf1yJNLQ==',key_name='tempest-keypair-1427128972',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1391a0a2167745348384e5890e6c22db',ramdisk_id='',reservation_id='r-ehwousd4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1671295372',owner_user_name='tempest-AttachVolumeNegativeTest-1671295372-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:36:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3c5d292e9594e4aadad9ac72b9455ed',uuid=6777b9e0-9d18-4d13-951c-fafc510455f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0ff7e14-ffa9-4b21-952f-e0ccba875282", "address": "fa:16:3e:6f:82:6c", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ff7e14-ff", "ovs_interfaceid": "e0ff7e14-ffa9-4b21-952f-e0ccba875282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Converting VIF {"id": "e0ff7e14-ffa9-4b21-952f-e0ccba875282", "address": "fa:16:3e:6f:82:6c", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ff7e14-ff", "ovs_interfaceid": "e0ff7e14-ffa9-4b21-952f-e0ccba875282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:82:6c,bridge_name='br-int',has_traffic_filtering=True,id=e0ff7e14-ffa9-4b21-952f-e0ccba875282,network=Network(88e922e4-ec89-460a-954d-aff20a41293c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0ff7e14-ff') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG os_vif [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:82:6c,bridge_name='br-int',has_traffic_filtering=True,id=e0ff7e14-ffa9-4b21-952f-e0ccba875282,network=Network(88e922e4-ec89-460a-954d-aff20a41293c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0ff7e14-ff') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0ff7e14-ff, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape0ff7e14-ff, col_values=(('external_ids', {'iface-id': 'e0ff7e14-ffa9-4b21-952f-e0ccba875282', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:82:6c', 'vm-uuid': '6777b9e0-9d18-4d13-951c-fafc510455f0'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:09 user nova-compute[73078]: INFO os_vif [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:82:6c,bridge_name='br-int',has_traffic_filtering=True,id=e0ff7e14-ffa9-4b21-952f-e0ccba875282,network=Network(88e922e4-ec89-460a-954d-aff20a41293c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0ff7e14-ff')
Aug 14 18:36:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] No VIF found with MAC fa:16:3e:6f:82:6c, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG nova.network.neutron [req-da332294-895c-4b45-a2dd-8dc52c38560f req-823e9de0-8ae5-4342-9892-8d038cdc459e service nova] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Updated VIF entry in instance network info cache for port e0ff7e14-ffa9-4b21-952f-e0ccba875282. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG nova.network.neutron [req-da332294-895c-4b45-a2dd-8dc52c38560f req-823e9de0-8ae5-4342-9892-8d038cdc459e service nova] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Updating instance_info_cache with network_info: [{"id": "e0ff7e14-ffa9-4b21-952f-e0ccba875282", "address": "fa:16:3e:6f:82:6c", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ff7e14-ff", "ovs_interfaceid": "e0ff7e14-ffa9-4b21-952f-e0ccba875282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:36:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-da332294-895c-4b45-a2dd-8dc52c38560f req-823e9de0-8ae5-4342-9892-8d038cdc459e service nova] Releasing lock "refresh_cache-6777b9e0-9d18-4d13-951c-fafc510455f0" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:36:10 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:36:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:10 user nova-compute[73078]: DEBUG nova.compute.manager [req-2420c7e3-9833-425b-9826-c59b35659d5e req-faefb79f-7bbe-48f5-9d19-2a5b79e9ae13 service nova] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Received event network-vif-plugged-e0ff7e14-ffa9-4b21-952f-e0ccba875282 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:36:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-2420c7e3-9833-425b-9826-c59b35659d5e req-faefb79f-7bbe-48f5-9d19-2a5b79e9ae13 service nova] Acquiring lock "6777b9e0-9d18-4d13-951c-fafc510455f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:36:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-2420c7e3-9833-425b-9826-c59b35659d5e req-faefb79f-7bbe-48f5-9d19-2a5b79e9ae13 service nova] Lock "6777b9e0-9d18-4d13-951c-fafc510455f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:36:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-2420c7e3-9833-425b-9826-c59b35659d5e req-faefb79f-7bbe-48f5-9d19-2a5b79e9ae13 service nova] Lock "6777b9e0-9d18-4d13-951c-fafc510455f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:36:10 user nova-compute[73078]: DEBUG nova.compute.manager [req-2420c7e3-9833-425b-9826-c59b35659d5e req-faefb79f-7bbe-48f5-9d19-2a5b79e9ae13 service nova] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] No waiting events found dispatching network-vif-plugged-e0ff7e14-ffa9-4b21-952f-e0ccba875282 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:36:10 user nova-compute[73078]: WARNING nova.compute.manager [req-2420c7e3-9833-425b-9826-c59b35659d5e req-faefb79f-7bbe-48f5-9d19-2a5b79e9ae13 service nova] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Received unexpected event network-vif-plugged-e0ff7e14-ffa9-4b21-952f-e0ccba875282 for instance with vm_state building and task_state spawning.
Aug 14 18:36:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:12 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692038172.6560102, 6777b9e0-9d18-4d13-951c-fafc510455f0 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:36:12 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] VM Resumed (Lifecycle Event)
Aug 14 18:36:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:36:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:36:12 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Instance spawned successfully.
Aug 14 18:36:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:36:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:36:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:36:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:36:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:36:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:36:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:36:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:36:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:36:12 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:36:12 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692038172.6561847, 6777b9e0-9d18-4d13-951c-fafc510455f0 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:36:12 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] VM Started (Lifecycle Event)
Aug 14 18:36:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:36:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:36:12 user nova-compute[73078]: DEBUG nova.compute.manager [req-5382ba6b-f9f9-47b0-bc0d-68edacf956fa req-8a4763c9-9cae-4cdb-98ca-39c2cfc3ecd8 service nova] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Received event network-vif-plugged-e0ff7e14-ffa9-4b21-952f-e0ccba875282 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:36:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5382ba6b-f9f9-47b0-bc0d-68edacf956fa req-8a4763c9-9cae-4cdb-98ca-39c2cfc3ecd8 service nova] Acquiring lock "6777b9e0-9d18-4d13-951c-fafc510455f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:36:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5382ba6b-f9f9-47b0-bc0d-68edacf956fa req-8a4763c9-9cae-4cdb-98ca-39c2cfc3ecd8 service nova] Lock "6777b9e0-9d18-4d13-951c-fafc510455f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:36:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5382ba6b-f9f9-47b0-bc0d-68edacf956fa req-8a4763c9-9cae-4cdb-98ca-39c2cfc3ecd8 service nova] Lock "6777b9e0-9d18-4d13-951c-fafc510455f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:36:12 user nova-compute[73078]: DEBUG nova.compute.manager [req-5382ba6b-f9f9-47b0-bc0d-68edacf956fa req-8a4763c9-9cae-4cdb-98ca-39c2cfc3ecd8 service nova] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] No waiting events found dispatching network-vif-plugged-e0ff7e14-ffa9-4b21-952f-e0ccba875282 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:36:12 user nova-compute[73078]: WARNING nova.compute.manager [req-5382ba6b-f9f9-47b0-bc0d-68edacf956fa req-8a4763c9-9cae-4cdb-98ca-39c2cfc3ecd8 service nova] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Received unexpected event network-vif-plugged-e0ff7e14-ffa9-4b21-952f-e0ccba875282 for instance with vm_state building and task_state spawning.
Aug 14 18:36:12 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:36:12 user nova-compute[73078]: INFO nova.compute.manager [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Took 6.01 seconds to spawn the instance on the hypervisor.
Aug 14 18:36:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:36:12 user nova-compute[73078]: INFO nova.compute.manager [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Took 6.72 seconds to build instance.
Aug 14 18:36:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-996004fe-bb89-4639-8967-f6de0bc4564c tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "6777b9e0-9d18-4d13-951c-fafc510455f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.826s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:36:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:30 user nova-compute[73078]: INFO nova.compute.manager [None req-6193a8e2-62d0-486b-a5bf-8b64fd7b90cd tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Unrescuing
Aug 14 18:36:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-6193a8e2-62d0-486b-a5bf-8b64fd7b90cd tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "refresh_cache-fc7d44f5-3616-4dba-a851-b6f7dddbad32" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:36:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-6193a8e2-62d0-486b-a5bf-8b64fd7b90cd tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquired lock "refresh_cache-fc7d44f5-3616-4dba-a851-b6f7dddbad32" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:36:30 user nova-compute[73078]: DEBUG nova.network.neutron [None req-6193a8e2-62d0-486b-a5bf-8b64fd7b90cd tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:36:31 user nova-compute[73078]: DEBUG nova.network.neutron [None req-6193a8e2-62d0-486b-a5bf-8b64fd7b90cd tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Updating instance_info_cache with network_info: [{"id": "c9ff8bc1-a391-4c5f-826f-a533290f2a98", "address": "fa:16:3e:e7:4a:6c", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ff8bc1-a3", "ovs_interfaceid": "c9ff8bc1-a391-4c5f-826f-a533290f2a98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:36:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-6193a8e2-62d0-486b-a5bf-8b64fd7b90cd tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Releasing lock "refresh_cache-fc7d44f5-3616-4dba-a851-b6f7dddbad32" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:36:31 user nova-compute[73078]: DEBUG nova.objects.instance [None req-6193a8e2-62d0-486b-a5bf-8b64fd7b90cd tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lazy-loading 'flavor' on Instance uuid fc7d44f5-3616-4dba-a851-b6f7dddbad32 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:36:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:31 user nova-compute[73078]: DEBUG nova.compute.manager [req-185e37b0-d65c-4a8f-947d-de7f4d9596f0 req-d053c2de-6f29-450c-a852-1c08fd3a3637 service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Received event network-vif-unplugged-c9ff8bc1-a391-4c5f-826f-a533290f2a98 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:36:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-185e37b0-d65c-4a8f-947d-de7f4d9596f0 req-d053c2de-6f29-450c-a852-1c08fd3a3637 service nova] Acquiring lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:36:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-185e37b0-d65c-4a8f-947d-de7f4d9596f0 req-d053c2de-6f29-450c-a852-1c08fd3a3637 service nova] Lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:36:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-185e37b0-d65c-4a8f-947d-de7f4d9596f0 req-d053c2de-6f29-450c-a852-1c08fd3a3637 service nova] Lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:36:31 user nova-compute[73078]: DEBUG nova.compute.manager [req-185e37b0-d65c-4a8f-947d-de7f4d9596f0 req-d053c2de-6f29-450c-a852-1c08fd3a3637 service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] No waiting events found dispatching network-vif-unplugged-c9ff8bc1-a391-4c5f-826f-a533290f2a98 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:36:31 user nova-compute[73078]: WARNING nova.compute.manager [req-185e37b0-d65c-4a8f-947d-de7f4d9596f0 req-d053c2de-6f29-450c-a852-1c08fd3a3637 service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Received unexpected event network-vif-unplugged-c9ff8bc1-a391-4c5f-826f-a533290f2a98 for instance with vm_state rescued and task_state unrescuing.
Aug 14 18:36:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:32 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Instance destroyed successfully.
Aug 14 18:36:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:33 user nova-compute[73078]: DEBUG nova.compute.manager [req-4359ccfe-ccf0-43c1-92e8-0f2c6dc930d5 req-1b26bd73-eee4-434e-add0-6f66ee520986 service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Received event network-vif-plugged-c9ff8bc1-a391-4c5f-826f-a533290f2a98 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:36:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4359ccfe-ccf0-43c1-92e8-0f2c6dc930d5 req-1b26bd73-eee4-434e-add0-6f66ee520986 service nova] Acquiring lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:36:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4359ccfe-ccf0-43c1-92e8-0f2c6dc930d5 req-1b26bd73-eee4-434e-add0-6f66ee520986 service nova] Lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:36:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4359ccfe-ccf0-43c1-92e8-0f2c6dc930d5 req-1b26bd73-eee4-434e-add0-6f66ee520986 service nova] Lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:36:33 user nova-compute[73078]: DEBUG nova.compute.manager [req-4359ccfe-ccf0-43c1-92e8-0f2c6dc930d5 req-1b26bd73-eee4-434e-add0-6f66ee520986 service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] No waiting events found dispatching network-vif-plugged-c9ff8bc1-a391-4c5f-826f-a533290f2a98 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:36:33 user nova-compute[73078]: WARNING nova.compute.manager [req-4359ccfe-ccf0-43c1-92e8-0f2c6dc930d5 req-1b26bd73-eee4-434e-add0-6f66ee520986 service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Received unexpected event network-vif-plugged-c9ff8bc1-a391-4c5f-826f-a533290f2a98 for instance with vm_state rescued and task_state unrescuing.
Aug 14 18:36:33 user nova-compute[73078]: DEBUG nova.compute.manager [req-4359ccfe-ccf0-43c1-92e8-0f2c6dc930d5 req-1b26bd73-eee4-434e-add0-6f66ee520986 service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Received event network-vif-plugged-c9ff8bc1-a391-4c5f-826f-a533290f2a98 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:36:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4359ccfe-ccf0-43c1-92e8-0f2c6dc930d5 req-1b26bd73-eee4-434e-add0-6f66ee520986 service nova] Acquiring lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:36:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4359ccfe-ccf0-43c1-92e8-0f2c6dc930d5 req-1b26bd73-eee4-434e-add0-6f66ee520986 service nova] Lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:36:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4359ccfe-ccf0-43c1-92e8-0f2c6dc930d5 req-1b26bd73-eee4-434e-add0-6f66ee520986 service nova] Lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:36:33 user nova-compute[73078]: DEBUG nova.compute.manager [req-4359ccfe-ccf0-43c1-92e8-0f2c6dc930d5 req-1b26bd73-eee4-434e-add0-6f66ee520986 service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] No waiting events found dispatching network-vif-plugged-c9ff8bc1-a391-4c5f-826f-a533290f2a98 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:36:33 user nova-compute[73078]: WARNING nova.compute.manager [req-4359ccfe-ccf0-43c1-92e8-0f2c6dc930d5 req-1b26bd73-eee4-434e-add0-6f66ee520986 service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Received unexpected event network-vif-plugged-c9ff8bc1-a391-4c5f-826f-a533290f2a98 for instance with vm_state rescued and task_state unrescuing.
Aug 14 18:36:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:35 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Removed pending event for fc7d44f5-3616-4dba-a851-b6f7dddbad32 due to event {{(pid=73078) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 18:36:35 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692038195.5446823, fc7d44f5-3616-4dba-a851-b6f7dddbad32 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:36:35 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] VM Resumed (Lifecycle Event)
Aug 14 18:36:35 user nova-compute[73078]: DEBUG nova.compute.manager [None req-6193a8e2-62d0-486b-a5bf-8b64fd7b90cd tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:36:35 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:36:35 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:36:35 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 18:36:35 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692038195.5499415, fc7d44f5-3616-4dba-a851-b6f7dddbad32 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:36:35 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] VM Started (Lifecycle Event)
Aug 14 18:36:35 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:36:35 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:36:35 user nova-compute[73078]: DEBUG nova.compute.manager [req-68298259-cb32-454b-af16-7751baa96ca2 req-28a68358-0e13-4788-8be4-039c030f780e service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Received event network-vif-plugged-c9ff8bc1-a391-4c5f-826f-a533290f2a98 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:36:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-68298259-cb32-454b-af16-7751baa96ca2 req-28a68358-0e13-4788-8be4-039c030f780e service nova] Acquiring lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:36:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-68298259-cb32-454b-af16-7751baa96ca2 req-28a68358-0e13-4788-8be4-039c030f780e service nova] Lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:36:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-68298259-cb32-454b-af16-7751baa96ca2 req-28a68358-0e13-4788-8be4-039c030f780e service nova] Lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:36:35 user nova-compute[73078]: DEBUG nova.compute.manager [req-68298259-cb32-454b-af16-7751baa96ca2 req-28a68358-0e13-4788-8be4-039c030f780e service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] No waiting events found dispatching network-vif-plugged-c9ff8bc1-a391-4c5f-826f-a533290f2a98 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:36:35 user nova-compute[73078]: WARNING nova.compute.manager [req-68298259-cb32-454b-af16-7751baa96ca2 req-28a68358-0e13-4788-8be4-039c030f780e service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Received unexpected event network-vif-plugged-c9ff8bc1-a391-4c5f-826f-a533290f2a98 for instance with vm_state active and task_state None.
Aug 14 18:36:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:43 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:58 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:36:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:36:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:37:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:37:04 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:37:04 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:37:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:37:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:37:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:37:04 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:37:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:37:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:37:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6777b9e0-9d18-4d13-951c-fafc510455f0/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:37:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6777b9e0-9d18-4d13-951c-fafc510455f0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:37:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6777b9e0-9d18-4d13-951c-fafc510455f0/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:37:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6777b9e0-9d18-4d13-951c-fafc510455f0/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:37:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:37:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:37:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:37:05 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:37:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:37:05 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:37:05 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:37:05 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:37:05 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:37:05 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:37:05 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:37:05 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:37:05 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:37:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:37:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:37:06 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:37:06 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:37:06 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=8039MB free_disk=24.840003967285156GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:37:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:37:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:37:06 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 61dfe42b-c943-4617-bf8e-745eaf1a1bb8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:37:06 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 3088da30-65b7-4801-b425-93df4fca6ad8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:37:06 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance ebbaec07-9843-4cc0-bcb6-f993e62d88c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:37:06 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 16a18fae-165b-487b-bfd5-20097eac0a8e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:37:06 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance fc7d44f5-3616-4dba-a851-b6f7dddbad32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:37:06 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance a4f1ae2d-5927-4931-bddf-5f503c4a94c7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:37:06 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 6777b9e0-9d18-4d13-951c-fafc510455f0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:37:06 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:37:06 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:37:06 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Refreshing inventories for resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 18:37:06 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Updating ProviderTree inventory for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 18:37:06 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Updating inventory in ProviderTree for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 18:37:06 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Refreshing aggregate associations for resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b, aggregates: None {{(pid=73078) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 18:37:06 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Refreshing trait associations for resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV {{(pid=73078) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 18:37:06 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:37:07 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:37:07 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:37:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.617s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Rebuilding the list of instances to heal {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-61dfe42b-c943-4617-bf8e-745eaf1a1bb8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-61dfe42b-c943-4617-bf8e-745eaf1a1bb8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG nova.objects.instance [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lazy-loading 'info_cache' on Instance uuid 61dfe42b-c943-4617-bf8e-745eaf1a1bb8 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Updating instance_info_cache with network_info: [{"id": "d801cd85-be91-4f26-9750-c2ce847cb33c", "address": "fa:16:3e:87:55:89", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd801cd85-be", "ovs_interfaceid": "d801cd85-be91-4f26-9750-c2ce847cb33c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-61dfe42b-c943-4617-bf8e-745eaf1a1bb8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Triggering sync for uuid 61dfe42b-c943-4617-bf8e-745eaf1a1bb8 {{(pid=73078) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Triggering sync for uuid 3088da30-65b7-4801-b425-93df4fca6ad8 {{(pid=73078) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Triggering sync for uuid ebbaec07-9843-4cc0-bcb6-f993e62d88c1 {{(pid=73078) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Triggering sync for uuid 16a18fae-165b-487b-bfd5-20097eac0a8e {{(pid=73078) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Triggering sync for uuid fc7d44f5-3616-4dba-a851-b6f7dddbad32 {{(pid=73078) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Triggering sync for uuid a4f1ae2d-5927-4931-bddf-5f503c4a94c7 {{(pid=73078) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Triggering sync for uuid 6777b9e0-9d18-4d13-951c-fafc510455f0 {{(pid=73078) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "61dfe42b-c943-4617-bf8e-745eaf1a1bb8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "61dfe42b-c943-4617-bf8e-745eaf1a1bb8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "3088da30-65b7-4801-b425-93df4fca6ad8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "3088da30-65b7-4801-b425-93df4fca6ad8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "ebbaec07-9843-4cc0-bcb6-f993e62d88c1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "ebbaec07-9843-4cc0-bcb6-f993e62d88c1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "16a18fae-165b-487b-bfd5-20097eac0a8e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "a4f1ae2d-5927-4931-bddf-5f503c4a94c7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "a4f1ae2d-5927-4931-bddf-5f503c4a94c7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "6777b9e0-9d18-4d13-951c-fafc510455f0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "6777b9e0-9d18-4d13-951c-fafc510455f0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "ebbaec07-9843-4cc0-bcb6-f993e62d88c1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "3088da30-65b7-4801-b425-93df4fca6ad8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "61dfe42b-c943-4617-bf8e-745eaf1a1bb8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "a4f1ae2d-5927-4931-bddf-5f503c4a94c7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:37:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "6777b9e0-9d18-4d13-951c-fafc510455f0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:37:09 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:37:09 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:37:09 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:37:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-dc3043da-764e-4321-b114-83d0d664acf6 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "16a18fae-165b-487b-bfd5-20097eac0a8e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-dc3043da-764e-4321-b114-83d0d664acf6 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:37:10 user nova-compute[73078]: INFO nova.compute.manager [None req-dc3043da-764e-4321-b114-83d0d664acf6 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Detaching volume 27eae141-3fe8-455c-9697-6bcfe0fefb99
Aug 14 18:37:10 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:37:10 user nova-compute[73078]: INFO nova.virt.block_device [None req-dc3043da-764e-4321-b114-83d0d664acf6 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Attempting to driver detach volume 27eae141-3fe8-455c-9697-6bcfe0fefb99 from mountpoint /dev/vdb
Aug 14 18:37:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-dc3043da-764e-4321-b114-83d0d664acf6 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Attempting to detach device vdb from instance 16a18fae-165b-487b-bfd5-20097eac0a8e from the persistent domain config. {{(pid=73078) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-dc3043da-764e-4321-b114-83d0d664acf6 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:37:10 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:37:10 user nova-compute[73078]:   <source dev="/dev/sdc"/>
Aug 14 18:37:10 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:37:10 user nova-compute[73078]:   <serial>27eae141-3fe8-455c-9697-6bcfe0fefb99</serial>
Aug 14 18:37:10 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 18:37:10 user nova-compute[73078]: </disk>
Aug 14 18:37:10 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:37:10 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-dc3043da-764e-4321-b114-83d0d664acf6 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Successfully detached device vdb from instance 16a18fae-165b-487b-bfd5-20097eac0a8e from the persistent domain config.
Aug 14 18:37:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-dc3043da-764e-4321-b114-83d0d664acf6 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 16a18fae-165b-487b-bfd5-20097eac0a8e from the live domain config. {{(pid=73078) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-dc3043da-764e-4321-b114-83d0d664acf6 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:37:10 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:37:10 user nova-compute[73078]:   <source dev="/dev/sdc"/>
Aug 14 18:37:10 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:37:10 user nova-compute[73078]:   <serial>27eae141-3fe8-455c-9697-6bcfe0fefb99</serial>
Aug 14 18:37:10 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 18:37:10 user nova-compute[73078]: </disk>
Aug 14 18:37:10 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Received event <DeviceRemovedEvent: 1692038230.6427844, 16a18fae-165b-487b-bfd5-20097eac0a8e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73078) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-dc3043da-764e-4321-b114-83d0d664acf6 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 16a18fae-165b-487b-bfd5-20097eac0a8e {{(pid=73078) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 18:37:10 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-dc3043da-764e-4321-b114-83d0d664acf6 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Successfully detached device vdb from instance 16a18fae-165b-487b-bfd5-20097eac0a8e from the live domain config.
Aug 14 18:37:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc3043da-764e-4321-b114-83d0d664acf6 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3043da-764e-4321-b114-83d0d664acf6 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uwHovVQj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:37:10 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-dc3043da-764e-4321-b114-83d0d664acf6 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:37:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-dc3043da-764e-4321-b114-83d0d664acf6 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-dc3043da-764e-4321-b114-83d0d664acf6 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3043da-764e-4321-b114-83d0d664acf6 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0367600-4929-4f30-9308-ae53f0af3f9d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[400dc570-0254-4a28-b12c-62addfadcba8]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3043da-764e-4321-b114-83d0d664acf6 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:37:10 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:37:10 user nova-compute[73078]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)
Aug 14 18:37:10 user nova-compute[73078]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:37:10 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3043da-764e-4321-b114-83d0d664acf6 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:37:10 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:37:10 user nova-compute[73078]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 (non-flash)
Aug 14 18:37:10 user nova-compute[73078]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:37:10 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3043da-764e-4321-b114-83d0d664acf6 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe97828f7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99'): ({'sdc'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-dc3043da-764e-4321-b114-83d0d664acf6 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Removing single pathed devices sdc {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff53f77-1145-4dab-a87c-a0445523cf51]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2034f94c-9a8a-4a24-b7c0-c8bc7305647a]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-dc3043da-764e-4321-b114-83d0d664acf6 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Flushing IO for device /dev/sdc {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa64585-530a-447f-bdab-02952fd8ab09]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-dc3043da-764e-4321-b114-83d0d664acf6 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4354b9dc-7e01-4ec4-b3b0-23b4c67a6a26]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-dc3043da-764e-4321-b114-83d0d664acf6 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-dc3043da-764e-4321-b114-83d0d664acf6 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] SCSI volumes sdc have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3043da-764e-4321-b114-83d0d664acf6 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8366e9b-8d6a-428a-b868-2bbe1fcda88c]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3043da-764e-4321-b114-83d0d664acf6 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[020c8eb3-6ef1-4980-9014-e43dc1dcc144]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3043da-764e-4321-b114-83d0d664acf6 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99, portal: 172.16.0.220,3260]
Aug 14 18:37:10 user nova-compute[73078]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99, portal: 172.16.0.220,3260] successful.
Aug 14 18:37:10 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27eae141-3fe8-455c-9697-6bcfe0fefb99 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54d2762-c57c-4465-8740-57101195f52a]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3043da-764e-4321-b114-83d0d664acf6 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-dc3043da-764e-4321-b114-83d0d664acf6 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3043da-764e-4321-b114-83d0d664acf6 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] <== disconnect_volume: return (291ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:37:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc3043da-764e-4321-b114-83d0d664acf6 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:37:11 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:37:11 user nova-compute[73078]: DEBUG nova.objects.instance [None req-dc3043da-764e-4321-b114-83d0d664acf6 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lazy-loading 'flavor' on Instance uuid 16a18fae-165b-487b-bfd5-20097eac0a8e {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:37:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-dc3043da-764e-4321-b114-83d0d664acf6 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.666s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:37:12 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:37:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Cleaning up deleted instances {{(pid=73078) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 18:37:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] There are 0 instances to clean {{(pid=73078) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 18:37:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73626240-7ee7-451a-bb69-9e37afd82a28 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "16a18fae-165b-487b-bfd5-20097eac0a8e" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:37:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73626240-7ee7-451a-bb69-9e37afd82a28 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:37:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73626240-7ee7-451a-bb69-9e37afd82a28 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:37:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73626240-7ee7-451a-bb69-9e37afd82a28 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73078) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 14 18:37:12 user nova-compute[73078]: DEBUG nova.objects.instance [None req-73626240-7ee7-451a-bb69-9e37afd82a28 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lazy-loading 'flavor' on Instance uuid 16a18fae-165b-487b-bfd5-20097eac0a8e {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:37:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:37:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:37:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:37:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:37:12 user nova-compute[73078]: DEBUG nova.compute.manager [req-a77969da-ed4a-4cf6-b371-e95cc1d44203 req-5fd5d01e-71a4-49fe-ad2e-8e702ed59933 service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Received event network-vif-unplugged-2dd60866-9ed8-4840-a797-893d81ab2b65 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:37:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a77969da-ed4a-4cf6-b371-e95cc1d44203 req-5fd5d01e-71a4-49fe-ad2e-8e702ed59933 service nova] Acquiring lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:37:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a77969da-ed4a-4cf6-b371-e95cc1d44203 req-5fd5d01e-71a4-49fe-ad2e-8e702ed59933 service nova] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:37:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a77969da-ed4a-4cf6-b371-e95cc1d44203 req-5fd5d01e-71a4-49fe-ad2e-8e702ed59933 service nova] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:37:12 user nova-compute[73078]: DEBUG nova.compute.manager [req-a77969da-ed4a-4cf6-b371-e95cc1d44203 req-5fd5d01e-71a4-49fe-ad2e-8e702ed59933 service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] No waiting events found dispatching network-vif-unplugged-2dd60866-9ed8-4840-a797-893d81ab2b65 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:37:12 user nova-compute[73078]: WARNING nova.compute.manager [req-a77969da-ed4a-4cf6-b371-e95cc1d44203 req-5fd5d01e-71a4-49fe-ad2e-8e702ed59933 service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Received unexpected event network-vif-unplugged-2dd60866-9ed8-4840-a797-893d81ab2b65 for instance with vm_state active and task_state powering-off.
Aug 14 18:37:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:37:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:37:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:37:13 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Instance destroyed successfully.
Aug 14 18:37:13 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73626240-7ee7-451a-bb69-9e37afd82a28 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:37:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73626240-7ee7-451a-bb69-9e37afd82a28 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.840s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:37:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:37:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:37:14 user nova-compute[73078]: DEBUG nova.compute.manager [req-2f3dccd8-11ec-4ef1-ab80-6e6ae8bea8ef req-25dc04e0-8c35-4e89-9a84-54f3ffe27594 service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Received event network-vif-plugged-2dd60866-9ed8-4840-a797-893d81ab2b65 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:37:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-2f3dccd8-11ec-4ef1-ab80-6e6ae8bea8ef req-25dc04e0-8c35-4e89-9a84-54f3ffe27594 service nova] Acquiring lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:37:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-2f3dccd8-11ec-4ef1-ab80-6e6ae8bea8ef req-25dc04e0-8c35-4e89-9a84-54f3ffe27594 service nova] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:37:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-2f3dccd8-11ec-4ef1-ab80-6e6ae8bea8ef req-25dc04e0-8c35-4e89-9a84-54f3ffe27594 service nova] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:37:14 user nova-compute[73078]: DEBUG nova.compute.manager [req-2f3dccd8-11ec-4ef1-ab80-6e6ae8bea8ef req-25dc04e0-8c35-4e89-9a84-54f3ffe27594 service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] No waiting events found dispatching network-vif-plugged-2dd60866-9ed8-4840-a797-893d81ab2b65 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:37:14 user nova-compute[73078]: WARNING nova.compute.manager [req-2f3dccd8-11ec-4ef1-ab80-6e6ae8bea8ef req-25dc04e0-8c35-4e89-9a84-54f3ffe27594 service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Received unexpected event network-vif-plugged-2dd60866-9ed8-4840-a797-893d81ab2b65 for instance with vm_state stopped and task_state None.
Aug 14 18:37:18 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:37:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:37:20 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:37:20 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73078) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 18:37:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:37:25 user nova-compute[73078]: DEBUG nova.compute.manager [req-83aef353-e7b1-468a-877a-501b369b3032 req-62f57e27-33cf-471f-98a0-d4c571d3d4b1 service nova] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Received event network-changed-a6d271b4-5e17-46ed-b704-9b7a84ab1c95 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:37:25 user nova-compute[73078]: DEBUG nova.compute.manager [req-83aef353-e7b1-468a-877a-501b369b3032 req-62f57e27-33cf-471f-98a0-d4c571d3d4b1 service nova] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Refreshing instance network info cache due to event network-changed-a6d271b4-5e17-46ed-b704-9b7a84ab1c95. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:37:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-83aef353-e7b1-468a-877a-501b369b3032 req-62f57e27-33cf-471f-98a0-d4c571d3d4b1 service nova] Acquiring lock "refresh_cache-a4f1ae2d-5927-4931-bddf-5f503c4a94c7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:37:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-83aef353-e7b1-468a-877a-501b369b3032 req-62f57e27-33cf-471f-98a0-d4c571d3d4b1 service nova] Acquired lock "refresh_cache-a4f1ae2d-5927-4931-bddf-5f503c4a94c7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:37:25 user nova-compute[73078]: DEBUG nova.network.neutron [req-83aef353-e7b1-468a-877a-501b369b3032 req-62f57e27-33cf-471f-98a0-d4c571d3d4b1 service nova] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Refreshing network info cache for port a6d271b4-5e17-46ed-b704-9b7a84ab1c95 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:37:25 user nova-compute[73078]: DEBUG nova.network.neutron [req-83aef353-e7b1-468a-877a-501b369b3032 req-62f57e27-33cf-471f-98a0-d4c571d3d4b1 service nova] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Updated VIF entry in instance network info cache for port a6d271b4-5e17-46ed-b704-9b7a84ab1c95. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:37:25 user nova-compute[73078]: DEBUG nova.network.neutron [req-83aef353-e7b1-468a-877a-501b369b3032 req-62f57e27-33cf-471f-98a0-d4c571d3d4b1 service nova] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Updating instance_info_cache with network_info: [{"id": "a6d271b4-5e17-46ed-b704-9b7a84ab1c95", "address": "fa:16:3e:28:7f:6d", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d271b4-5e", "ovs_interfaceid": "a6d271b4-5e17-46ed-b704-9b7a84ab1c95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:37:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-83aef353-e7b1-468a-877a-501b369b3032 req-62f57e27-33cf-471f-98a0-d4c571d3d4b1 service nova] Releasing lock "refresh_cache-a4f1ae2d-5927-4931-bddf-5f503c4a94c7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:37:28 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692038233.086203, 16a18fae-165b-487b-bfd5-20097eac0a8e => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:37:28 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] VM Stopped (Lifecycle Event)
Aug 14 18:37:28 user nova-compute[73078]: DEBUG nova.compute.manager [None req-d63da188-dfda-411d-807f-ac4ffb20c2cc None None] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:37:28 user nova-compute[73078]: DEBUG nova.compute.manager [None req-d63da188-dfda-411d-807f-ac4ffb20c2cc None None] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:37:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:37:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:37:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:37:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:37:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "70bcb548-3cd4-4885-b0e0-b3cd3d14986e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:37:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "70bcb548-3cd4-4885-b0e0-b3cd3d14986e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:37:37 user nova-compute[73078]: DEBUG nova.compute.manager [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:37:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:37:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:37:37 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:37:37 user nova-compute[73078]: INFO nova.compute.claims [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Claim successful on node user
Aug 14 18:37:38 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:37:38 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:37:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.329s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:37:38 user nova-compute[73078]: DEBUG nova.compute.manager [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:37:38 user nova-compute[73078]: DEBUG nova.compute.manager [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:37:38 user nova-compute[73078]: DEBUG nova.network.neutron [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:37:38 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:37:38 user nova-compute[73078]: DEBUG nova.compute.manager [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:37:38 user nova-compute[73078]: INFO nova.virt.block_device [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Booting with volume 6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 at /dev/vda
Aug 14 18:37:38 user nova-compute[73078]: DEBUG nova.policy [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe79455616584e0fb80e6007edf0b706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7142101014c4defa7261a34fb9f28e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:37:38 user nova-compute[73078]: DEBUG os_brick.utils [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:37:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:37:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:37:38 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0a5c86-c8f9-4647-9fa8-ba9ab0888c0e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:37:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:37:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:37:38 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da40a5f-eed7-4956-baa3-53fe20dcfed6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:37:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:37:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:37:38 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90fb0af-6056-4fcd-be0c-ecbda33a0942]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:37:38 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d85bd74-719f-4e07-9f7b-66a98109ed9f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:37:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:37:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:37:38 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:37:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:37:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:37:38 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:37:38 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c00625-9e08-4675-a3d3-897424bdc36b]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:37:38 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:37:38 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:37:38 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:37:38 user nova-compute[73078]: DEBUG os_brick.utils [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:37:38 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Updating existing volume attachment record: 1258cdcd-8171-4790-96c4-7afa37111b33 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:37:38 user nova-compute[73078]: DEBUG nova.network.neutron [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Successfully created port: b0f702c7-f5b1-4610-a26b-d82df3b12ed5 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:37:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:37:39 user nova-compute[73078]: DEBUG nova.network.neutron [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Successfully updated port: b0f702c7-f5b1-4610-a26b-d82df3b12ed5 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:37:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "refresh_cache-70bcb548-3cd4-4885-b0e0-b3cd3d14986e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:37:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquired lock "refresh_cache-70bcb548-3cd4-4885-b0e0-b3cd3d14986e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:37:39 user nova-compute[73078]: DEBUG nova.network.neutron [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:37:39 user nova-compute[73078]: DEBUG nova.compute.manager [req-f33fc8c0-cd77-4b91-8785-554cceba5aef req-5bd84b1b-90c9-4484-a618-efe7287145c7 service nova] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Received event network-changed-b0f702c7-f5b1-4610-a26b-d82df3b12ed5 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:37:39 user nova-compute[73078]: DEBUG nova.compute.manager [req-f33fc8c0-cd77-4b91-8785-554cceba5aef req-5bd84b1b-90c9-4484-a618-efe7287145c7 service nova] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Refreshing instance network info cache due to event network-changed-b0f702c7-f5b1-4610-a26b-d82df3b12ed5. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:37:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-f33fc8c0-cd77-4b91-8785-554cceba5aef req-5bd84b1b-90c9-4484-a618-efe7287145c7 service nova] Acquiring lock "refresh_cache-70bcb548-3cd4-4885-b0e0-b3cd3d14986e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:37:39 user nova-compute[73078]: DEBUG nova.network.neutron [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:37:39 user nova-compute[73078]: DEBUG nova.network.neutron [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Updating instance_info_cache with network_info: [{"id": "b0f702c7-f5b1-4610-a26b-d82df3b12ed5", "address": "fa:16:3e:35:1f:5e", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f702c7-f5", "ovs_interfaceid": "b0f702c7-f5b1-4610-a26b-d82df3b12ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:37:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Releasing lock "refresh_cache-70bcb548-3cd4-4885-b0e0-b3cd3d14986e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:37:39 user nova-compute[73078]: DEBUG nova.compute.manager [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Instance network_info: |[{"id": "b0f702c7-f5b1-4610-a26b-d82df3b12ed5", "address": "fa:16:3e:35:1f:5e", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f702c7-f5", "ovs_interfaceid": "b0f702c7-f5b1-4610-a26b-d82df3b12ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:37:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-f33fc8c0-cd77-4b91-8785-554cceba5aef req-5bd84b1b-90c9-4484-a618-efe7287145c7 service nova] Acquired lock "refresh_cache-70bcb548-3cd4-4885-b0e0-b3cd3d14986e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:37:39 user nova-compute[73078]: DEBUG nova.network.neutron [req-f33fc8c0-cd77-4b91-8785-554cceba5aef req-5bd84b1b-90c9-4484-a618-efe7287145c7 service nova] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Refreshing network info cache for port b0f702c7-f5b1-4610-a26b-d82df3b12ed5 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:37:40 user nova-compute[73078]: DEBUG nova.network.neutron [req-f33fc8c0-cd77-4b91-8785-554cceba5aef req-5bd84b1b-90c9-4484-a618-efe7287145c7 service nova] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Updated VIF entry in instance network info cache for port b0f702c7-f5b1-4610-a26b-d82df3b12ed5. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:37:40 user nova-compute[73078]: DEBUG nova.network.neutron [req-f33fc8c0-cd77-4b91-8785-554cceba5aef req-5bd84b1b-90c9-4484-a618-efe7287145c7 service nova] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Updating instance_info_cache with network_info: [{"id": "b0f702c7-f5b1-4610-a26b-d82df3b12ed5", "address": "fa:16:3e:35:1f:5e", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f702c7-f5", "ovs_interfaceid": "b0f702c7-f5b1-4610-a26b-d82df3b12ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:37:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-f33fc8c0-cd77-4b91-8785-554cceba5aef req-5bd84b1b-90c9-4484-a618-efe7287145c7 service nova] Releasing lock "refresh_cache-70bcb548-3cd4-4885-b0e0-b3cd3d14986e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:37:43 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:37:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG nova.compute.manager [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:37:47 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Creating image(s)
Aug 14 18:37:47 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Did not create local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Ensure instance console log exists: /opt/stack/data/nova/instances/70bcb548-3cd4-4885-b0e0-b3cd3d14986e/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Start _get_guest_xml network_info=[{"id": "b0f702c7-f5b1-4610-a26b-d82df3b12ed5", "address": "fa:16:3e:35:1f:5e", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f702c7-f5", "ovs_interfaceid": "b0f702c7-f5b1-4610-a26b-d82df3b12ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '1258cdcd-8171-4790-96c4-7afa37111b33', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XBKtwDzb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '70bcb548-3cd4-4885-b0e0-b3cd3d14986e', 'attached_at': '', 'detached_at': '', 'volume_id': '6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4', 'serial': '6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4'}, 'volume_type': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:37:47 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:37:47 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:37:47 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XBKtwDzb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:37:47 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:37:47 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:37:47 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:37:47 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:37:47 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:37:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1660b29e-3126-4d2f-a6de-f20e2fd0260a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:37:47 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c958a64-a75e-4a0f-8a1d-dfc95881b0a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4] added
Aug 14 18:37:47 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b76141-8c64-417a-aca2-7ee599288e61]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[28539055-277f-47ca-9c48-ccdc086308a7]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XBKtwDzb {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XBKtwDzb" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[314342c2-d93a-4c11-9a78-afcbd34127f1]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XBKtwDzb'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a41da02-5c39-4e0d-8faa-3a15ed210833]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b442cc-2020-484a-a892-8063552be489]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:37:47 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:37:47 user nova-compute[73078]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:37:47 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:37:47 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:37:47 user nova-compute[73078]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:37:47 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ef491a-8838-43c4-9a5e-69fd356e031d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4, portal: 172.16.0.220,3260]
Aug 14 18:37:47 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4, portal: 172.16.0.220,3260] successful.
Aug 14 18:37:47 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48d297f-4192-409d-9e29-2bf4278db63f]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9863efa4-61f8-4fbe-b5c3-8cc28513d15e]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:37:47 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:37:47 user nova-compute[73078]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:37:47 user nova-compute[73078]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 (non-flash)
Aug 14 18:37:47 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:37:47 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:37:47 user nova-compute[73078]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:37:47 user nova-compute[73078]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 (non-flash)
Aug 14 18:37:47 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc3bd70-19d7-4657-a7ab-b4d863078201]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:37:47 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XBKtwDzb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:37:48 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:37:48 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23639373835396662', 'path': '/dev/sdc'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:37:48 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639373835396662', 'path': '/dev/sdc'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:37:48 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:37:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-423613483',display_name='tempest-TestVolumeBootPattern-server-423613483',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-423613483',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU8q8wtxkW9pROl2j0NkoRwpKKcmziB/20QEkNRAKEXt/Sm0AgtPtqW4EQeZ9Nz+9SI3khJoGje9+NMiFY56dE76HSwv/RbWY1Ab2OSscMaXE4ftFHwz3mwUt13yK/iVg==',key_name='tempest-TestVolumeBootPattern-511986969',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7142101014c4defa7261a34fb9f28e4',ramdisk_id='',reservation_id='r-v58xtc0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1889877750',owner_user_name='tempest-TestVolumeBootPattern-1889877750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:37:38Z,user_data=None,user_id='fe79455616584e0fb80e6007edf0b706',uuid=70bcb548-3cd4-4885-b0e0-b3cd3d14986e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0f702c7-f5b1-4610-a26b-d82df3b12ed5", "address": "fa:16:3e:35:1f:5e", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f702c7-f5", "ovs_interfaceid": "b0f702c7-f5b1-4610-a26b-d82df3b12ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:37:48 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Converting VIF {"id": "b0f702c7-f5b1-4610-a26b-d82df3b12ed5", "address": "fa:16:3e:35:1f:5e", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f702c7-f5", "ovs_interfaceid": "b0f702c7-f5b1-4610-a26b-d82df3b12ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:37:48 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:1f:5e,bridge_name='br-int',has_traffic_filtering=True,id=b0f702c7-f5b1-4610-a26b-d82df3b12ed5,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0f702c7-f5') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:37:48 user nova-compute[73078]: DEBUG nova.objects.instance [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lazy-loading 'pci_devices' on Instance uuid 70bcb548-3cd4-4885-b0e0-b3cd3d14986e {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:37:48 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:37:48 user nova-compute[73078]:   <uuid>70bcb548-3cd4-4885-b0e0-b3cd3d14986e</uuid>
Aug 14 18:37:48 user nova-compute[73078]:   <name>instance-0000002f</name>
Aug 14 18:37:48 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:37:48 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:37:48 user nova-compute[73078]:   <metadata>
Aug 14 18:37:48 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:37:48 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:37:48 user nova-compute[73078]:       <nova:name>tempest-TestVolumeBootPattern-server-423613483</nova:name>
Aug 14 18:37:48 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:37:47</nova:creationTime>
Aug 14 18:37:48 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:37:48 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:37:48 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:37:48 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:37:48 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:37:48 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:37:48 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:37:48 user nova-compute[73078]:       <nova:owner>
Aug 14 18:37:48 user nova-compute[73078]:         <nova:user uuid="fe79455616584e0fb80e6007edf0b706">tempest-TestVolumeBootPattern-1889877750-project-member</nova:user>
Aug 14 18:37:48 user nova-compute[73078]:         <nova:project uuid="e7142101014c4defa7261a34fb9f28e4">tempest-TestVolumeBootPattern-1889877750</nova:project>
Aug 14 18:37:48 user nova-compute[73078]:       </nova:owner>
Aug 14 18:37:48 user nova-compute[73078]:       <nova:ports>
Aug 14 18:37:48 user nova-compute[73078]:         <nova:port uuid="b0f702c7-f5b1-4610-a26b-d82df3b12ed5">
Aug 14 18:37:48 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 18:37:48 user nova-compute[73078]:         </nova:port>
Aug 14 18:37:48 user nova-compute[73078]:       </nova:ports>
Aug 14 18:37:48 user nova-compute[73078]:     </nova:instance>
Aug 14 18:37:48 user nova-compute[73078]:   </metadata>
Aug 14 18:37:48 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:37:48 user nova-compute[73078]:     <system>
Aug 14 18:37:48 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:37:48 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:37:48 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:37:48 user nova-compute[73078]:       <entry name="serial">70bcb548-3cd4-4885-b0e0-b3cd3d14986e</entry>
Aug 14 18:37:48 user nova-compute[73078]:       <entry name="uuid">70bcb548-3cd4-4885-b0e0-b3cd3d14986e</entry>
Aug 14 18:37:48 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:37:48 user nova-compute[73078]:     </system>
Aug 14 18:37:48 user nova-compute[73078]:   </sysinfo>
Aug 14 18:37:48 user nova-compute[73078]:   <os>
Aug 14 18:37:48 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:37:48 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:37:48 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:37:48 user nova-compute[73078]:   </os>
Aug 14 18:37:48 user nova-compute[73078]:   <features>
Aug 14 18:37:48 user nova-compute[73078]:     <acpi/>
Aug 14 18:37:48 user nova-compute[73078]:     <apic/>
Aug 14 18:37:48 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:37:48 user nova-compute[73078]:   </features>
Aug 14 18:37:48 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:37:48 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:37:48 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:37:48 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:37:48 user nova-compute[73078]:   </clock>
Aug 14 18:37:48 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:37:48 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:37:48 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:37:48 user nova-compute[73078]:   </cpu>
Aug 14 18:37:48 user nova-compute[73078]:   <devices>
Aug 14 18:37:48 user nova-compute[73078]:     <disk type="block" device="disk">
Aug 14 18:37:48 user nova-compute[73078]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:37:48 user nova-compute[73078]:       <source dev="/dev/sdc"/>
Aug 14 18:37:48 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:37:48 user nova-compute[73078]:       <serial>6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4</serial>
Aug 14 18:37:48 user nova-compute[73078]:     </disk>
Aug 14 18:37:48 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:37:48 user nova-compute[73078]:       <mac address="fa:16:3e:35:1f:5e"/>
Aug 14 18:37:48 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:37:48 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:37:48 user nova-compute[73078]:       <target dev="tapb0f702c7-f5"/>
Aug 14 18:37:48 user nova-compute[73078]:     </interface>
Aug 14 18:37:48 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:37:48 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/70bcb548-3cd4-4885-b0e0-b3cd3d14986e/console.log" append="off"/>
Aug 14 18:37:48 user nova-compute[73078]:     </serial>
Aug 14 18:37:48 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:37:48 user nova-compute[73078]:     <video>
Aug 14 18:37:48 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:37:48 user nova-compute[73078]:     </video>
Aug 14 18:37:48 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:37:48 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:37:48 user nova-compute[73078]:     </rng>
Aug 14 18:37:48 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:37:48 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:37:48 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:37:48 user nova-compute[73078]:     </memballoon>
Aug 14 18:37:48 user nova-compute[73078]:   </devices>
Aug 14 18:37:48 user nova-compute[73078]: </domain>
Aug 14 18:37:48 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:37:48 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:37:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-423613483',display_name='tempest-TestVolumeBootPattern-server-423613483',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-423613483',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU8q8wtxkW9pROl2j0NkoRwpKKcmziB/20QEkNRAKEXt/Sm0AgtPtqW4EQeZ9Nz+9SI3khJoGje9+NMiFY56dE76HSwv/RbWY1Ab2OSscMaXE4ftFHwz3mwUt13yK/iVg==',key_name='tempest-TestVolumeBootPattern-511986969',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7142101014c4defa7261a34fb9f28e4',ramdisk_id='',reservation_id='r-v58xtc0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1889877750',owner_user_name='tempest-TestVolumeBootPattern-1889877750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:37:38Z,user_data=None,user_id='fe79455616584e0fb80e6007edf0b706',uuid=70bcb548-3cd4-4885-b0e0-b3cd3d14986e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0f702c7-f5b1-4610-a26b-d82df3b12ed5", "address": "fa:16:3e:35:1f:5e", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f702c7-f5", "ovs_interfaceid": "b0f702c7-f5b1-4610-a26b-d82df3b12ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:37:48 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Converting VIF {"id": "b0f702c7-f5b1-4610-a26b-d82df3b12ed5", "address": "fa:16:3e:35:1f:5e", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f702c7-f5", "ovs_interfaceid": "b0f702c7-f5b1-4610-a26b-d82df3b12ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:37:48 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:1f:5e,bridge_name='br-int',has_traffic_filtering=True,id=b0f702c7-f5b1-4610-a26b-d82df3b12ed5,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0f702c7-f5') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:37:48 user nova-compute[73078]: DEBUG os_vif [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:1f:5e,bridge_name='br-int',has_traffic_filtering=True,id=b0f702c7-f5b1-4610-a26b-d82df3b12ed5,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0f702c7-f5') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:37:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:37:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:37:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:37:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:37:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0f702c7-f5, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:37:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb0f702c7-f5, col_values=(('external_ids', {'iface-id': 'b0f702c7-f5b1-4610-a26b-d82df3b12ed5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:1f:5e', 'vm-uuid': '70bcb548-3cd4-4885-b0e0-b3cd3d14986e'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:37:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:37:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:37:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:37:48 user nova-compute[73078]: INFO os_vif [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:1f:5e,bridge_name='br-int',has_traffic_filtering=True,id=b0f702c7-f5b1-4610-a26b-d82df3b12ed5,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0f702c7-f5')
Aug 14 18:37:48 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:37:48 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] No VIF found with MAC fa:16:3e:35:1f:5e, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:37:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:37:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:37:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:37:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:37:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:37:50 user nova-compute[73078]: DEBUG nova.compute.manager [req-967e57e2-0289-4525-8d06-47ee18a2b6cb req-7f076b07-550d-4cd4-ae3d-f3db48c24412 service nova] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Received event network-vif-plugged-b0f702c7-f5b1-4610-a26b-d82df3b12ed5 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:37:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-967e57e2-0289-4525-8d06-47ee18a2b6cb req-7f076b07-550d-4cd4-ae3d-f3db48c24412 service nova] Acquiring lock "70bcb548-3cd4-4885-b0e0-b3cd3d14986e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:37:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-967e57e2-0289-4525-8d06-47ee18a2b6cb req-7f076b07-550d-4cd4-ae3d-f3db48c24412 service nova] Lock "70bcb548-3cd4-4885-b0e0-b3cd3d14986e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:37:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-967e57e2-0289-4525-8d06-47ee18a2b6cb req-7f076b07-550d-4cd4-ae3d-f3db48c24412 service nova] Lock "70bcb548-3cd4-4885-b0e0-b3cd3d14986e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:37:50 user nova-compute[73078]: DEBUG nova.compute.manager [req-967e57e2-0289-4525-8d06-47ee18a2b6cb req-7f076b07-550d-4cd4-ae3d-f3db48c24412 service nova] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] No waiting events found dispatching network-vif-plugged-b0f702c7-f5b1-4610-a26b-d82df3b12ed5 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:37:50 user nova-compute[73078]: WARNING nova.compute.manager [req-967e57e2-0289-4525-8d06-47ee18a2b6cb req-7f076b07-550d-4cd4-ae3d-f3db48c24412 service nova] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Received unexpected event network-vif-plugged-b0f702c7-f5b1-4610-a26b-d82df3b12ed5 for instance with vm_state building and task_state spawning.
Aug 14 18:37:52 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692038272.1338165, 70bcb548-3cd4-4885-b0e0-b3cd3d14986e => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:37:52 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] VM Resumed (Lifecycle Event)
Aug 14 18:37:52 user nova-compute[73078]: DEBUG nova.compute.manager [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:37:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:37:52 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Instance spawned successfully.
Aug 14 18:37:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:37:52 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:37:52 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:37:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:37:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:37:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:37:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:37:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:37:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:37:52 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:37:52 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692038272.135269, 70bcb548-3cd4-4885-b0e0-b3cd3d14986e => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:37:52 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] VM Started (Lifecycle Event)
Aug 14 18:37:52 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:37:52 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:37:52 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:37:52 user nova-compute[73078]: INFO nova.compute.manager [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Took 5.06 seconds to spawn the instance on the hypervisor.
Aug 14 18:37:52 user nova-compute[73078]: DEBUG nova.compute.manager [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:37:52 user nova-compute[73078]: INFO nova.compute.manager [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Took 14.63 seconds to build instance.
Aug 14 18:37:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-68d67e90-6f8d-4f1b-a428-5b79089a1307 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "70bcb548-3cd4-4885-b0e0-b3cd3d14986e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.715s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:37:52 user nova-compute[73078]: DEBUG nova.compute.manager [req-42853eef-a174-422b-8397-242d7cf21d26 req-f12106d0-9ef3-493b-96ed-84da159e4655 service nova] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Received event network-vif-plugged-b0f702c7-f5b1-4610-a26b-d82df3b12ed5 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:37:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-42853eef-a174-422b-8397-242d7cf21d26 req-f12106d0-9ef3-493b-96ed-84da159e4655 service nova] Acquiring lock "70bcb548-3cd4-4885-b0e0-b3cd3d14986e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:37:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-42853eef-a174-422b-8397-242d7cf21d26 req-f12106d0-9ef3-493b-96ed-84da159e4655 service nova] Lock "70bcb548-3cd4-4885-b0e0-b3cd3d14986e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:37:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-42853eef-a174-422b-8397-242d7cf21d26 req-f12106d0-9ef3-493b-96ed-84da159e4655 service nova] Lock "70bcb548-3cd4-4885-b0e0-b3cd3d14986e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:37:52 user nova-compute[73078]: DEBUG nova.compute.manager [req-42853eef-a174-422b-8397-242d7cf21d26 req-f12106d0-9ef3-493b-96ed-84da159e4655 service nova] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] No waiting events found dispatching network-vif-plugged-b0f702c7-f5b1-4610-a26b-d82df3b12ed5 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:37:52 user nova-compute[73078]: WARNING nova.compute.manager [req-42853eef-a174-422b-8397-242d7cf21d26 req-f12106d0-9ef3-493b-96ed-84da159e4655 service nova] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Received unexpected event network-vif-plugged-b0f702c7-f5b1-4610-a26b-d82df3b12ed5 for instance with vm_state active and task_state None.
Aug 14 18:37:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:37:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:37:57 user nova-compute[73078]: DEBUG nova.compute.manager [req-eeac4fb1-7b1c-4066-8247-9fec744993ea req-a109c904-dfb4-4d43-93de-e900a3f4dfe7 service nova] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Received event network-changed-e0ff7e14-ffa9-4b21-952f-e0ccba875282 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:37:57 user nova-compute[73078]: DEBUG nova.compute.manager [req-eeac4fb1-7b1c-4066-8247-9fec744993ea req-a109c904-dfb4-4d43-93de-e900a3f4dfe7 service nova] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Refreshing instance network info cache due to event network-changed-e0ff7e14-ffa9-4b21-952f-e0ccba875282. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:37:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-eeac4fb1-7b1c-4066-8247-9fec744993ea req-a109c904-dfb4-4d43-93de-e900a3f4dfe7 service nova] Acquiring lock "refresh_cache-6777b9e0-9d18-4d13-951c-fafc510455f0" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:37:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-eeac4fb1-7b1c-4066-8247-9fec744993ea req-a109c904-dfb4-4d43-93de-e900a3f4dfe7 service nova] Acquired lock "refresh_cache-6777b9e0-9d18-4d13-951c-fafc510455f0" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:37:57 user nova-compute[73078]: DEBUG nova.network.neutron [req-eeac4fb1-7b1c-4066-8247-9fec744993ea req-a109c904-dfb4-4d43-93de-e900a3f4dfe7 service nova] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Refreshing network info cache for port e0ff7e14-ffa9-4b21-952f-e0ccba875282 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:37:58 user nova-compute[73078]: DEBUG nova.network.neutron [req-eeac4fb1-7b1c-4066-8247-9fec744993ea req-a109c904-dfb4-4d43-93de-e900a3f4dfe7 service nova] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Updated VIF entry in instance network info cache for port e0ff7e14-ffa9-4b21-952f-e0ccba875282. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:37:58 user nova-compute[73078]: DEBUG nova.network.neutron [req-eeac4fb1-7b1c-4066-8247-9fec744993ea req-a109c904-dfb4-4d43-93de-e900a3f4dfe7 service nova] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Updating instance_info_cache with network_info: [{"id": "e0ff7e14-ffa9-4b21-952f-e0ccba875282", "address": "fa:16:3e:6f:82:6c", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ff7e14-ff", "ovs_interfaceid": "e0ff7e14-ffa9-4b21-952f-e0ccba875282", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:37:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-eeac4fb1-7b1c-4066-8247-9fec744993ea req-a109c904-dfb4-4d43-93de-e900a3f4dfe7 service nova] Releasing lock "refresh_cache-6777b9e0-9d18-4d13-951c-fafc510455f0" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:37:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:37:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:38:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "6777b9e0-9d18-4d13-951c-fafc510455f0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:38:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "6777b9e0-9d18-4d13-951c-fafc510455f0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:38:01 user nova-compute[73078]: DEBUG nova.objects.instance [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lazy-loading 'flavor' on Instance uuid 6777b9e0-9d18-4d13-951c-fafc510455f0 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:38:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "6777b9e0-9d18-4d13-951c-fafc510455f0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:38:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "6777b9e0-9d18-4d13-951c-fafc510455f0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:38:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "6777b9e0-9d18-4d13-951c-fafc510455f0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:38:01 user nova-compute[73078]: INFO nova.compute.manager [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Attaching volume a4e8eb20-fbbb-4873-8331-26054e80db94 to /dev/vdb
Aug 14 18:38:01 user nova-compute[73078]: DEBUG os_brick.utils [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:38:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:01 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[25500ffe-ad11-4db6-a1ab-831a29786b72]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:38:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:01 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbf0aa5-476b-4178-9437-4ffb190bfb59]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:38:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:01 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55d87f4-ba6b-4bb6-b174-38603908a436]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:38:01 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4387f60a-3e67-4b34-9a07-59a1ae56eefb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:38:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:38:01 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:38:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:38:01 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:38:01 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f70e30d-f5a6-4ebd-aa93-1b314897cd01]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:38:01 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:38:01 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:38:01 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:38:01 user nova-compute[73078]: DEBUG os_brick.utils [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:38:01 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Updating existing volume attachment record: 3e1d5b4a-8618-42fc-9be4-ef2a97d64788 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:38:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:38:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:38:06 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:38:06 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:38:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-3088da30-65b7-4801-b425-93df4fca6ad8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:38:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-3088da30-65b7-4801-b425-93df4fca6ad8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:38:06 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:38:06 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Updating instance_info_cache with network_info: [{"id": "52e93284-9b32-4191-8f06-ab9c4497579c", "address": "fa:16:3e:ec:04:07", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e93284-9b", "ovs_interfaceid": "52e93284-9b32-4191-8f06-ab9c4497579c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:38:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-3088da30-65b7-4801-b425-93df4fca6ad8" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:38:06 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:38:06 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:38:06 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:38:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:38:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:38:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:38:06 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:38:06 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:38:06 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6777b9e0-9d18-4d13-951c-fafc510455f0/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6777b9e0-9d18-4d13-951c-fafc510455f0/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6777b9e0-9d18-4d13-951c-fafc510455f0/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6777b9e0-9d18-4d13-951c-fafc510455f0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:38:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:38:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:38:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:38:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:38:08 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:38:08 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:38:08 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=8130MB free_disk=24.837554931640625GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:38:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:38:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:38:08 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 61dfe42b-c943-4617-bf8e-745eaf1a1bb8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:38:08 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 3088da30-65b7-4801-b425-93df4fca6ad8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:38:08 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance ebbaec07-9843-4cc0-bcb6-f993e62d88c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:38:08 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 16a18fae-165b-487b-bfd5-20097eac0a8e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:38:08 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance fc7d44f5-3616-4dba-a851-b6f7dddbad32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:38:08 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance a4f1ae2d-5927-4931-bddf-5f503c4a94c7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:38:08 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 6777b9e0-9d18-4d13-951c-fafc510455f0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:38:08 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 70bcb548-3cd4-4885-b0e0-b3cd3d14986e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:38:08 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:38:08 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:38:09 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:38:09 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:38:09 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:38:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.374s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:38:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:38:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ntWsigES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:38:10 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:38:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:38:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:38:10 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:38:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:38:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:38:10 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:38:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:10 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8f3e1d-ee31-4235-88ca-3ee9a4297faf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:38:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:38:10 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:38:10 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62642c0-a2f7-42a3-ba0d-7661617d4c6a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94] added
Aug 14 18:38:11 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2d2b1d-29f7-4a65-8e93-4cd267e1bb69]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e0b345-606b-4602-8d6d-b9a861ca593d]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ntWsigES {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ntWsigES" returned: 0 in 0.028s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e444a8-c858-4ead-a76d-36048a91ecdf]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ntWsigES'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[797fa35e-70ca-4a58-9476-7bdc884d29ea]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4deb45d3-9a92-4783-b1b7-b50141428de6]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:38:11 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:38:11 user nova-compute[73078]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:38:11 user nova-compute[73078]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 (non-flash)
Aug 14 18:38:11 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:38:11 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:38:11 user nova-compute[73078]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:38:11 user nova-compute[73078]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 (non-flash)
Aug 14 18:38:11 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd393130-e2c7-4221-8f3e-8a9431b683db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94, portal: 172.16.0.220,3260]
Aug 14 18:38:11 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94, portal: 172.16.0.220,3260] successful.
Aug 14 18:38:11 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb17b759-aa48-4816-867f-ee396de4152b]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0054e677-284c-4963-a2ba-457032ebe521]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:38:11 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:38:11 user nova-compute[73078]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:38:11 user nova-compute[73078]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 (non-flash)
Aug 14 18:38:11 user nova-compute[73078]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94 (non-flash)
Aug 14 18:38:11 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:38:11 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:38:11 user nova-compute[73078]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:38:11 user nova-compute[73078]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 (non-flash)
Aug 14 18:38:11 user nova-compute[73078]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94 (non-flash)
Aug 14 18:38:11 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] HCTL ('37', '-', '-', 0) found on session 58 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1a1f28-3466-418d-9e5f-c0b4347c1c20]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Searching for a device in session 58 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ntWsigES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:38:11 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:38:12 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:38:12 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:38:12 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:38:12 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23239393239333965', 'path': '/dev/sdf'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:38:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239393239333965', 'path': '/dev/sdf'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:38:12 user nova-compute[73078]: DEBUG nova.objects.instance [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lazy-loading 'flavor' on Instance uuid 6777b9e0-9d18-4d13-951c-fafc510455f0 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:38:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 18:38:12 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:38:12 user nova-compute[73078]:   <source dev="/dev/sdf"/>
Aug 14 18:38:12 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:38:12 user nova-compute[73078]:   <serial>a4e8eb20-fbbb-4873-8331-26054e80db94</serial>
Aug 14 18:38:12 user nova-compute[73078]: </disk>
Aug 14 18:38:12 user nova-compute[73078]:  {{(pid=73078) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 18:38:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:38:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:38:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] No VIF found with MAC fa:16:3e:6f:82:6c, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:38:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9efc8611-f47c-455d-88dd-64521979f250 tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "6777b9e0-9d18-4d13-951c-fafc510455f0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.196s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:38:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:38:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-86cba75b-a6db-4ea3-a9e0-2375caf3944e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "6777b9e0-9d18-4d13-951c-fafc510455f0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:38:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-86cba75b-a6db-4ea3-a9e0-2375caf3944e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "6777b9e0-9d18-4d13-951c-fafc510455f0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:38:13 user nova-compute[73078]: INFO nova.compute.manager [None req-86cba75b-a6db-4ea3-a9e0-2375caf3944e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Detaching volume a4e8eb20-fbbb-4873-8331-26054e80db94
Aug 14 18:38:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:38:13 user nova-compute[73078]: INFO nova.virt.block_device [None req-86cba75b-a6db-4ea3-a9e0-2375caf3944e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Attempting to driver detach volume a4e8eb20-fbbb-4873-8331-26054e80db94 from mountpoint /dev/vdb
Aug 14 18:38:13 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-86cba75b-a6db-4ea3-a9e0-2375caf3944e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Attempting to detach device vdb from instance 6777b9e0-9d18-4d13-951c-fafc510455f0 from the persistent domain config. {{(pid=73078) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 18:38:13 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-86cba75b-a6db-4ea3-a9e0-2375caf3944e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:38:13 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:38:13 user nova-compute[73078]:   <source dev="/dev/sdf"/>
Aug 14 18:38:13 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:38:13 user nova-compute[73078]:   <serial>a4e8eb20-fbbb-4873-8331-26054e80db94</serial>
Aug 14 18:38:13 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:38:13 user nova-compute[73078]: </disk>
Aug 14 18:38:13 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:38:13 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-86cba75b-a6db-4ea3-a9e0-2375caf3944e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Successfully detached device vdb from instance 6777b9e0-9d18-4d13-951c-fafc510455f0 from the persistent domain config.
Aug 14 18:38:13 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-86cba75b-a6db-4ea3-a9e0-2375caf3944e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6777b9e0-9d18-4d13-951c-fafc510455f0 from the live domain config. {{(pid=73078) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 18:38:13 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-86cba75b-a6db-4ea3-a9e0-2375caf3944e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:38:13 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:38:13 user nova-compute[73078]:   <source dev="/dev/sdf"/>
Aug 14 18:38:13 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:38:13 user nova-compute[73078]:   <serial>a4e8eb20-fbbb-4873-8331-26054e80db94</serial>
Aug 14 18:38:13 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:38:13 user nova-compute[73078]: </disk>
Aug 14 18:38:13 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Received event <DeviceRemovedEvent: 1692038294.293494, 6777b9e0-9d18-4d13-951c-fafc510455f0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73078) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-86cba75b-a6db-4ea3-a9e0-2375caf3944e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6777b9e0-9d18-4d13-951c-fafc510455f0 {{(pid=73078) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 18:38:14 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-86cba75b-a6db-4ea3-a9e0-2375caf3944e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Successfully detached device vdb from instance 6777b9e0-9d18-4d13-951c-fafc510455f0 from the live domain config.
Aug 14 18:38:14 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86cba75b-a6db-4ea3-a9e0-2375caf3944e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-86cba75b-a6db-4ea3-a9e0-2375caf3944e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ntWsigES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:38:14 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-86cba75b-a6db-4ea3-a9e0-2375caf3944e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:38:14 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-86cba75b-a6db-4ea3-a9e0-2375caf3944e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-86cba75b-a6db-4ea3-a9e0-2375caf3944e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-86cba75b-a6db-4ea3-a9e0-2375caf3944e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84e3050-c830-4c1f-b300-0c966f2daa53]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1759ffa-238e-47a0-bb52-77d9ccc2b443]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-86cba75b-a6db-4ea3-a9e0-2375caf3944e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:38:14 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:38:14 user nova-compute[73078]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:38:14 user nova-compute[73078]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 (non-flash)
Aug 14 18:38:14 user nova-compute[73078]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94 (non-flash)
Aug 14 18:38:14 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-86cba75b-a6db-4ea3-a9e0-2375caf3944e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:38:14 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:38:14 user nova-compute[73078]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:38:14 user nova-compute[73078]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 (non-flash)
Aug 14 18:38:14 user nova-compute[73078]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94 (non-flash)
Aug 14 18:38:14 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-86cba75b-a6db-4ea3-a9e0-2375caf3944e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe98820e170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94'): ({'sdf'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-86cba75b-a6db-4ea3-a9e0-2375caf3944e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Removing single pathed devices sdf {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f6ae67-2a99-4959-a654-dfe719277625]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[82efad15-23fd-4ca1-82f4-f5d315ab367e]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-86cba75b-a6db-4ea3-a9e0-2375caf3944e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Flushing IO for device /dev/sdf {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edf9836-1a02-4dbf-aceb-3a38c1df3262]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-86cba75b-a6db-4ea3-a9e0-2375caf3944e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a105dc3b-ade0-49aa-a842-44dd9a26ca37]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-86cba75b-a6db-4ea3-a9e0-2375caf3944e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-86cba75b-a6db-4ea3-a9e0-2375caf3944e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] SCSI volumes sdf have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-86cba75b-a6db-4ea3-a9e0-2375caf3944e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2559e6-57b9-42a7-8739-46dac73ea400]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-86cba75b-a6db-4ea3-a9e0-2375caf3944e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[432cfb2f-59c5-4b09-9bc9-1fad1b486a81]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-86cba75b-a6db-4ea3-a9e0-2375caf3944e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94, portal: 172.16.0.220,3260]
Aug 14 18:38:14 user nova-compute[73078]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94, portal: 172.16.0.220,3260] successful.
Aug 14 18:38:14 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4e8eb20-fbbb-4873-8331-26054e80db94 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a412d21a-fb15-45d5-b94b-228d93eb0196]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-86cba75b-a6db-4ea3-a9e0-2375caf3944e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-86cba75b-a6db-4ea3-a9e0-2375caf3944e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-86cba75b-a6db-4ea3-a9e0-2375caf3944e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] <== disconnect_volume: return (302ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:38:14 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86cba75b-a6db-4ea3-a9e0-2375caf3944e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:38:15 user nova-compute[73078]: DEBUG nova.objects.instance [None req-86cba75b-a6db-4ea3-a9e0-2375caf3944e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lazy-loading 'flavor' on Instance uuid 6777b9e0-9d18-4d13-951c-fafc510455f0 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:38:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-86cba75b-a6db-4ea3-a9e0-2375caf3944e tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "6777b9e0-9d18-4d13-951c-fafc510455f0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.593s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:38:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:38:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:38:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:38:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:38:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:38:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:38:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:38:21 user nova-compute[73078]: INFO nova.compute.manager [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Terminating instance
Aug 14 18:38:21 user nova-compute[73078]: DEBUG nova.compute.manager [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:38:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:38:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG nova.compute.manager [req-6e9d2ad8-fef5-4929-97fc-345f761c335d req-1d4907ca-62d3-45c6-9520-f9bf03883402 service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Received event network-vif-unplugged-c9ff8bc1-a391-4c5f-826f-a533290f2a98 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6e9d2ad8-fef5-4929-97fc-345f761c335d req-1d4907ca-62d3-45c6-9520-f9bf03883402 service nova] Acquiring lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6e9d2ad8-fef5-4929-97fc-345f761c335d req-1d4907ca-62d3-45c6-9520-f9bf03883402 service nova] Lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6e9d2ad8-fef5-4929-97fc-345f761c335d req-1d4907ca-62d3-45c6-9520-f9bf03883402 service nova] Lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG nova.compute.manager [req-6e9d2ad8-fef5-4929-97fc-345f761c335d req-1d4907ca-62d3-45c6-9520-f9bf03883402 service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] No waiting events found dispatching network-vif-unplugged-c9ff8bc1-a391-4c5f-826f-a533290f2a98 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG nova.compute.manager [req-6e9d2ad8-fef5-4929-97fc-345f761c335d req-1d4907ca-62d3-45c6-9520-f9bf03883402 service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Received event network-vif-unplugged-c9ff8bc1-a391-4c5f-826f-a533290f2a98 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:38:22 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Instance destroyed successfully.
Aug 14 18:38:22 user nova-compute[73078]: DEBUG nova.objects.instance [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lazy-loading 'resources' on Instance uuid fc7d44f5-3616-4dba-a851-b6f7dddbad32 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:32:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-502950209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-502950209',id=44,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:34:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16e938ed650845d0a64b49273c9f6287',ramdisk_id='',reservation_id='r-p6wrvd40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1267883434',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:36:36Z,user_data=None,user_id='0bff079d90d942bb8ab3ba53fb007125',uuid=fc7d44f5-3616-4dba-a851-b6f7dddbad32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9ff8bc1-a391-4c5f-826f-a533290f2a98", "address": "fa:16:3e:e7:4a:6c", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ff8bc1-a3", "ovs_interfaceid": "c9ff8bc1-a391-4c5f-826f-a533290f2a98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Converting VIF {"id": "c9ff8bc1-a391-4c5f-826f-a533290f2a98", "address": "fa:16:3e:e7:4a:6c", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ff8bc1-a3", "ovs_interfaceid": "c9ff8bc1-a391-4c5f-826f-a533290f2a98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:4a:6c,bridge_name='br-int',has_traffic_filtering=True,id=c9ff8bc1-a391-4c5f-826f-a533290f2a98,network=Network(98a29135-c5de-46a6-a2bf-46c90b4e255b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9ff8bc1-a3') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG os_vif [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:4a:6c,bridge_name='br-int',has_traffic_filtering=True,id=c9ff8bc1-a391-4c5f-826f-a533290f2a98,network=Network(98a29135-c5de-46a6-a2bf-46c90b4e255b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9ff8bc1-a3') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9ff8bc1-a3, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:38:22 user nova-compute[73078]: INFO os_vif [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:4a:6c,bridge_name='br-int',has_traffic_filtering=True,id=c9ff8bc1-a391-4c5f-826f-a533290f2a98,network=Network(98a29135-c5de-46a6-a2bf-46c90b4e255b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9ff8bc1-a3')
Aug 14 18:38:22 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oMItkiKx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:38:22 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:38:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e876d48-376d-42ed-bf66-2dc13d5da345]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e36a62-3edc-4ff7-9016-b86154f0a926]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:38:22 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:38:22 user nova-compute[73078]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:38:22 user nova-compute[73078]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 (non-flash)
Aug 14 18:38:22 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:38:22 user nova-compute[73078]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc (non-flash)
Aug 14 18:38:22 user nova-compute[73078]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:38:22 user nova-compute[73078]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 (non-flash)
Aug 14 18:38:22 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe98820f760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc'): ({'sdd'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Removing single pathed devices sdd {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2356724a-cbd1-4618-ac77-3337e7764f28]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7c3b1a-c4e0-41aa-bfe8-830d19a8ef01]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Flushing IO for device /dev/sdd {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48ca186-7d3c-4a8a-89ab-10945ed0cb06]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0641702-1cdf-4871-98c6-478e82f7c917]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] SCSI volumes sdd have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOfc51c4c-1d7b454cc3cee84c', '/dev/disk/by-id/scsi-23164376234353463', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_fc51c4c') {{(pid=84732) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 18:38:22 user nova-compute[73078]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOfc51c4c-1d7b454cc3cee84c
Aug 14 18:38:22 user nova-compute[73078]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23164376234353463
Aug 14 18:38:22 user nova-compute[73078]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_fc51c4c
Aug 14 18:38:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac517464-bdb0-4c96-9601-8518df679fbd]: (4, None) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4b2540-87c2-4e0b-9b75-6fab9671a131]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[765be06c-54bc-478b-8879-093b640fc3cf]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc, portal: 172.16.0.220,3260]
Aug 14 18:38:22 user nova-compute[73078]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc, portal: 172.16.0.220,3260] successful.
Aug 14 18:38:22 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:365d0bf8-ac18-49e0-a595-f9cda5d0c3dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc7c576-f226-4d87-af64-0dc8a8dcc35f]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] <== disconnect_volume: return (293ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:38:22 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Deleting instance files /opt/stack/data/nova/instances/fc7d44f5-3616-4dba-a851-b6f7dddbad32_del
Aug 14 18:38:22 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Deletion of /opt/stack/data/nova/instances/fc7d44f5-3616-4dba-a851-b6f7dddbad32_del complete
Aug 14 18:38:22 user nova-compute[73078]: INFO nova.compute.manager [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 14 18:38:22 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:38:22 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:38:23 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:38:23 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Took 0.52 seconds to deallocate network for instance.
Aug 14 18:38:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:38:24 user nova-compute[73078]: DEBUG nova.compute.manager [req-6840712b-cc51-45a0-bc73-5dd9760d3849 req-d856db8e-db96-43d8-b96e-5e761e399b5a service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Received event network-vif-plugged-c9ff8bc1-a391-4c5f-826f-a533290f2a98 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:38:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6840712b-cc51-45a0-bc73-5dd9760d3849 req-d856db8e-db96-43d8-b96e-5e761e399b5a service nova] Acquiring lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:38:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6840712b-cc51-45a0-bc73-5dd9760d3849 req-d856db8e-db96-43d8-b96e-5e761e399b5a service nova] Lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:38:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6840712b-cc51-45a0-bc73-5dd9760d3849 req-d856db8e-db96-43d8-b96e-5e761e399b5a service nova] Lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:38:24 user nova-compute[73078]: DEBUG nova.compute.manager [req-6840712b-cc51-45a0-bc73-5dd9760d3849 req-d856db8e-db96-43d8-b96e-5e761e399b5a service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] No waiting events found dispatching network-vif-plugged-c9ff8bc1-a391-4c5f-826f-a533290f2a98 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:38:24 user nova-compute[73078]: WARNING nova.compute.manager [req-6840712b-cc51-45a0-bc73-5dd9760d3849 req-d856db8e-db96-43d8-b96e-5e761e399b5a service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Received unexpected event network-vif-plugged-c9ff8bc1-a391-4c5f-826f-a533290f2a98 for instance with vm_state active and task_state deleting.
Aug 14 18:38:24 user nova-compute[73078]: DEBUG nova.compute.manager [req-6840712b-cc51-45a0-bc73-5dd9760d3849 req-d856db8e-db96-43d8-b96e-5e761e399b5a service nova] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Received event network-vif-deleted-c9ff8bc1-a391-4c5f-826f-a533290f2a98 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:38:24 user nova-compute[73078]: INFO nova.compute.manager [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Took 0.74 seconds to detach 1 volumes for instance.
Aug 14 18:38:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:38:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:38:24 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:38:24 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:38:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:38:24 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Deleted allocations for instance fc7d44f5-3616-4dba-a851-b6f7dddbad32
Aug 14 18:38:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-da7432eb-edd2-4ef1-b3a0-6474784ec558 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "fc7d44f5-3616-4dba-a851-b6f7dddbad32" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.820s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:38:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:38:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:38:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:38:37 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692038302.5384376, fc7d44f5-3616-4dba-a851-b6f7dddbad32 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:38:37 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] VM Stopped (Lifecycle Event)
Aug 14 18:38:37 user nova-compute[73078]: DEBUG nova.compute.manager [None req-1de73b3f-b09b-4aa3-903f-031eb424c864 None None] [instance: fc7d44f5-3616-4dba-a851-b6f7dddbad32] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:38:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:38:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:38:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:38:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:38:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:38:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:38:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:38:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:38:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:38:57 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG nova.objects.instance [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lazy-loading 'flavor' on Instance uuid 16a18fae-165b-487b-bfd5-20097eac0a8e {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "refresh_cache-16a18fae-165b-487b-bfd5-20097eac0a8e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquired lock "refresh_cache-16a18fae-165b-487b-bfd5-20097eac0a8e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG nova.network.neutron [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG nova.objects.instance [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lazy-loading 'info_cache' on Instance uuid 16a18fae-165b-487b-bfd5-20097eac0a8e {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG nova.network.neutron [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Updating instance_info_cache with network_info: [{"id": "2dd60866-9ed8-4840-a797-893d81ab2b65", "address": "fa:16:3e:62:78:e2", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd60866-9e", "ovs_interfaceid": "2dd60866-9ed8-4840-a797-893d81ab2b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Releasing lock "refresh_cache-16a18fae-165b-487b-bfd5-20097eac0a8e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:39:03 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Instance destroyed successfully.
Aug 14 18:39:03 user nova-compute[73078]: DEBUG nova.objects.instance [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lazy-loading 'resources' on Instance uuid 16a18fae-165b-487b-bfd5-20097eac0a8e {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:31:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1523618791',display_name='tempest-AttachVolumeTestJSON-server-1523618791',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1523618791',id=41,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGt0IZUR45BoJPTktrLR+OSUIGX16DeSC3GRnxH2CMKh+NvhLefmy7aiMx94bvaYe2eBuYWP6rvvpzTkrEkuFVyTl4uoHzIOYqmCyqn8E4fpKgZ5Lep2EZjGHAoZGcIfQ==',key_name='tempest-keypair-1506094444',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:31:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8c717b7be2814591a20db3c81bc5ba89',ramdisk_id='',reservation_id='r-j7btfmht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-120525527',owner_user_name='tempest-AttachVolumeTestJSON-120525527-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:37:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc0adf66a66f4f4fb698706b5d3294cd',uuid=16a18fae-165b-487b-bfd5-20097eac0a8e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2dd60866-9ed8-4840-a797-893d81ab2b65", "address": "fa:16:3e:62:78:e2", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd60866-9e", "ovs_interfaceid": "2dd60866-9ed8-4840-a797-893d81ab2b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Converting VIF {"id": "2dd60866-9ed8-4840-a797-893d81ab2b65", "address": "fa:16:3e:62:78:e2", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd60866-9e", "ovs_interfaceid": "2dd60866-9ed8-4840-a797-893d81ab2b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:78:e2,bridge_name='br-int',has_traffic_filtering=True,id=2dd60866-9ed8-4840-a797-893d81ab2b65,network=Network(0e58d249-c00c-45c4-bc46-9d975b128a0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd60866-9e') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG os_vif [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:78:e2,bridge_name='br-int',has_traffic_filtering=True,id=2dd60866-9ed8-4840-a797-893d81ab2b65,network=Network(0e58d249-c00c-45c4-bc46-9d975b128a0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd60866-9e') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2dd60866-9e, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:39:03 user nova-compute[73078]: INFO os_vif [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:78:e2,bridge_name='br-int',has_traffic_filtering=True,id=2dd60866-9ed8-4840-a797-893d81ab2b65,network=Network(0e58d249-c00c-45c4-bc46-9d975b128a0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd60866-9e')
Aug 14 18:39:03 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Start _get_guest_xml network_info=[{"id": "2dd60866-9ed8-4840-a797-893d81ab2b65", "address": "fa:16:3e:62:78:e2", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd60866-9e", "ovs_interfaceid": "2dd60866-9ed8-4840-a797-893d81ab2b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG nova.objects.instance [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lazy-loading 'numa_topology' on Instance uuid 16a18fae-165b-487b-bfd5-20097eac0a8e {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:39:03 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:39:03 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:39:03 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG nova.objects.instance [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lazy-loading 'vcpu_model' on Instance uuid 16a18fae-165b-487b-bfd5-20097eac0a8e {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:31:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1523618791',display_name='tempest-AttachVolumeTestJSON-server-1523618791',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1523618791',id=41,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGt0IZUR45BoJPTktrLR+OSUIGX16DeSC3GRnxH2CMKh+NvhLefmy7aiMx94bvaYe2eBuYWP6rvvpzTkrEkuFVyTl4uoHzIOYqmCyqn8E4fpKgZ5Lep2EZjGHAoZGcIfQ==',key_name='tempest-keypair-1506094444',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:31:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8c717b7be2814591a20db3c81bc5ba89',ramdisk_id='',reservation_id='r-j7btfmht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-120525527',owner_user_name='tempest-AttachVolumeTestJSON-120525527-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:37:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc0adf66a66f4f4fb698706b5d3294cd',uuid=16a18fae-165b-487b-bfd5-20097eac0a8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2dd60866-9ed8-4840-a797-893d81ab2b65", "address": "fa:16:3e:62:78:e2", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd60866-9e", "ovs_interfaceid": "2dd60866-9ed8-4840-a797-893d81ab2b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Converting VIF {"id": "2dd60866-9ed8-4840-a797-893d81ab2b65", "address": "fa:16:3e:62:78:e2", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd60866-9e", "ovs_interfaceid": "2dd60866-9ed8-4840-a797-893d81ab2b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:78:e2,bridge_name='br-int',has_traffic_filtering=True,id=2dd60866-9ed8-4840-a797-893d81ab2b65,network=Network(0e58d249-c00c-45c4-bc46-9d975b128a0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd60866-9e') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG nova.objects.instance [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lazy-loading 'pci_devices' on Instance uuid 16a18fae-165b-487b-bfd5-20097eac0a8e {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:39:03 user nova-compute[73078]:   <uuid>16a18fae-165b-487b-bfd5-20097eac0a8e</uuid>
Aug 14 18:39:03 user nova-compute[73078]:   <name>instance-00000029</name>
Aug 14 18:39:03 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:39:03 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:39:03 user nova-compute[73078]:   <metadata>
Aug 14 18:39:03 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:39:03 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:39:03 user nova-compute[73078]:       <nova:name>tempest-AttachVolumeTestJSON-server-1523618791</nova:name>
Aug 14 18:39:03 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:39:03</nova:creationTime>
Aug 14 18:39:03 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:39:03 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:39:03 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:39:03 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:39:03 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:39:03 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:39:03 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:39:03 user nova-compute[73078]:       <nova:owner>
Aug 14 18:39:03 user nova-compute[73078]:         <nova:user uuid="cc0adf66a66f4f4fb698706b5d3294cd">tempest-AttachVolumeTestJSON-120525527-project-member</nova:user>
Aug 14 18:39:03 user nova-compute[73078]:         <nova:project uuid="8c717b7be2814591a20db3c81bc5ba89">tempest-AttachVolumeTestJSON-120525527</nova:project>
Aug 14 18:39:03 user nova-compute[73078]:       </nova:owner>
Aug 14 18:39:03 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:39:03 user nova-compute[73078]:       <nova:ports>
Aug 14 18:39:03 user nova-compute[73078]:         <nova:port uuid="2dd60866-9ed8-4840-a797-893d81ab2b65">
Aug 14 18:39:03 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 18:39:03 user nova-compute[73078]:         </nova:port>
Aug 14 18:39:03 user nova-compute[73078]:       </nova:ports>
Aug 14 18:39:03 user nova-compute[73078]:     </nova:instance>
Aug 14 18:39:03 user nova-compute[73078]:   </metadata>
Aug 14 18:39:03 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:39:03 user nova-compute[73078]:     <system>
Aug 14 18:39:03 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:39:03 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:39:03 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:39:03 user nova-compute[73078]:       <entry name="serial">16a18fae-165b-487b-bfd5-20097eac0a8e</entry>
Aug 14 18:39:03 user nova-compute[73078]:       <entry name="uuid">16a18fae-165b-487b-bfd5-20097eac0a8e</entry>
Aug 14 18:39:03 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:39:03 user nova-compute[73078]:     </system>
Aug 14 18:39:03 user nova-compute[73078]:   </sysinfo>
Aug 14 18:39:03 user nova-compute[73078]:   <os>
Aug 14 18:39:03 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:39:03 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:39:03 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:39:03 user nova-compute[73078]:   </os>
Aug 14 18:39:03 user nova-compute[73078]:   <features>
Aug 14 18:39:03 user nova-compute[73078]:     <acpi/>
Aug 14 18:39:03 user nova-compute[73078]:     <apic/>
Aug 14 18:39:03 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:39:03 user nova-compute[73078]:   </features>
Aug 14 18:39:03 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:39:03 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:39:03 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:39:03 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:39:03 user nova-compute[73078]:   </clock>
Aug 14 18:39:03 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:39:03 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:39:03 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:39:03 user nova-compute[73078]:   </cpu>
Aug 14 18:39:03 user nova-compute[73078]:   <devices>
Aug 14 18:39:03 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:39:03 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:39:03 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk"/>
Aug 14 18:39:03 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:39:03 user nova-compute[73078]:     </disk>
Aug 14 18:39:03 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:39:03 user nova-compute[73078]:       <mac address="fa:16:3e:62:78:e2"/>
Aug 14 18:39:03 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:39:03 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:39:03 user nova-compute[73078]:       <target dev="tap2dd60866-9e"/>
Aug 14 18:39:03 user nova-compute[73078]:     </interface>
Aug 14 18:39:03 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:39:03 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/console.log" append="off"/>
Aug 14 18:39:03 user nova-compute[73078]:     </serial>
Aug 14 18:39:03 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:39:03 user nova-compute[73078]:     <video>
Aug 14 18:39:03 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:39:03 user nova-compute[73078]:     </video>
Aug 14 18:39:03 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:39:03 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:39:03 user nova-compute[73078]:     </rng>
Aug 14 18:39:03 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:39:03 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:39:03 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:39:03 user nova-compute[73078]:     </memballoon>
Aug 14 18:39:03 user nova-compute[73078]:   </devices>
Aug 14 18:39:03 user nova-compute[73078]: </domain>
Aug 14 18:39:03 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:39:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:39:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e945893f-2365-4306-a3b1-fe34291ef10a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "6777b9e0-9d18-4d13-951c-fafc510455f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:39:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e945893f-2365-4306-a3b1-fe34291ef10a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "6777b9e0-9d18-4d13-951c-fafc510455f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:39:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e945893f-2365-4306-a3b1-fe34291ef10a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "6777b9e0-9d18-4d13-951c-fafc510455f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:39:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e945893f-2365-4306-a3b1-fe34291ef10a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "6777b9e0-9d18-4d13-951c-fafc510455f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:39:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e945893f-2365-4306-a3b1-fe34291ef10a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "6777b9e0-9d18-4d13-951c-fafc510455f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:39:04 user nova-compute[73078]: INFO nova.compute.manager [None req-e945893f-2365-4306-a3b1-fe34291ef10a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Terminating instance
Aug 14 18:39:04 user nova-compute[73078]: DEBUG nova.compute.manager [None req-e945893f-2365-4306-a3b1-fe34291ef10a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:39:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:39:04 user nova-compute[73078]: DEBUG nova.objects.instance [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lazy-loading 'trusted_certs' on Instance uuid 16a18fae-165b-487b-bfd5-20097eac0a8e {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:39:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:39:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:04 user nova-compute[73078]: DEBUG nova.compute.manager [req-6452f192-b559-43cd-8576-9a1d985dd62d req-44952ae6-c879-459d-a9e4-1e211c59c186 service nova] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Received event network-vif-unplugged-e0ff7e14-ffa9-4b21-952f-e0ccba875282 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:39:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6452f192-b559-43cd-8576-9a1d985dd62d req-44952ae6-c879-459d-a9e4-1e211c59c186 service nova] Acquiring lock "6777b9e0-9d18-4d13-951c-fafc510455f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:39:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6452f192-b559-43cd-8576-9a1d985dd62d req-44952ae6-c879-459d-a9e4-1e211c59c186 service nova] Lock "6777b9e0-9d18-4d13-951c-fafc510455f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:39:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6452f192-b559-43cd-8576-9a1d985dd62d req-44952ae6-c879-459d-a9e4-1e211c59c186 service nova] Lock "6777b9e0-9d18-4d13-951c-fafc510455f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:39:04 user nova-compute[73078]: DEBUG nova.compute.manager [req-6452f192-b559-43cd-8576-9a1d985dd62d req-44952ae6-c879-459d-a9e4-1e211c59c186 service nova] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] No waiting events found dispatching network-vif-unplugged-e0ff7e14-ffa9-4b21-952f-e0ccba875282 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:39:04 user nova-compute[73078]: DEBUG nova.compute.manager [req-6452f192-b559-43cd-8576-9a1d985dd62d req-44952ae6-c879-459d-a9e4-1e211c59c186 service nova] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Received event network-vif-unplugged-e0ff7e14-ffa9-4b21-952f-e0ccba875282 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:39:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.200s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:39:04 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:39:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:39:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:39:04 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Cannot resize image /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:39:04 user nova-compute[73078]: DEBUG nova.objects.instance [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lazy-loading 'migration_context' on Instance uuid 16a18fae-165b-487b-bfd5-20097eac0a8e {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:39:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:31:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1523618791',display_name='tempest-AttachVolumeTestJSON-server-1523618791',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1523618791',id=41,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGt0IZUR45BoJPTktrLR+OSUIGX16DeSC3GRnxH2CMKh+NvhLefmy7aiMx94bvaYe2eBuYWP6rvvpzTkrEkuFVyTl4uoHzIOYqmCyqn8E4fpKgZ5Lep2EZjGHAoZGcIfQ==',key_name='tempest-keypair-1506094444',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:31:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='8c717b7be2814591a20db3c81bc5ba89',ramdisk_id='',reservation_id='r-j7btfmht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-120525527',owner_user_name='tempest-AttachVolumeTestJSON-120525527-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:37:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc0adf66a66f4f4fb698706b5d3294cd',uuid=16a18fae-165b-487b-bfd5-20097eac0a8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2dd60866-9ed8-4840-a797-893d81ab2b65", "address": "fa:16:3e:62:78:e2", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd60866-9e", "ovs_interfaceid": "2dd60866-9ed8-4840-a797-893d81ab2b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:39:04 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Converting VIF {"id": "2dd60866-9ed8-4840-a797-893d81ab2b65", "address": "fa:16:3e:62:78:e2", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd60866-9e", "ovs_interfaceid": "2dd60866-9ed8-4840-a797-893d81ab2b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:39:04 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:78:e2,bridge_name='br-int',has_traffic_filtering=True,id=2dd60866-9ed8-4840-a797-893d81ab2b65,network=Network(0e58d249-c00c-45c4-bc46-9d975b128a0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd60866-9e') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:39:04 user nova-compute[73078]: DEBUG os_vif [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:78:e2,bridge_name='br-int',has_traffic_filtering=True,id=2dd60866-9ed8-4840-a797-893d81ab2b65,network=Network(0e58d249-c00c-45c4-bc46-9d975b128a0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd60866-9e') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:39:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:39:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:39:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2dd60866-9e, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:39:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2dd60866-9e, col_values=(('external_ids', {'iface-id': '2dd60866-9ed8-4840-a797-893d81ab2b65', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:78:e2', 'vm-uuid': '16a18fae-165b-487b-bfd5-20097eac0a8e'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:39:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:39:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:04 user nova-compute[73078]: INFO os_vif [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:78:e2,bridge_name='br-int',has_traffic_filtering=True,id=2dd60866-9ed8-4840-a797-893d81ab2b65,network=Network(0e58d249-c00c-45c4-bc46-9d975b128a0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd60866-9e')
Aug 14 18:39:05 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Instance destroyed successfully.
Aug 14 18:39:05 user nova-compute[73078]: DEBUG nova.objects.instance [None req-e945893f-2365-4306-a3b1-fe34291ef10a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lazy-loading 'resources' on Instance uuid 6777b9e0-9d18-4d13-951c-fafc510455f0 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:39:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-e945893f-2365-4306-a3b1-fe34291ef10a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:36:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1196654936',display_name='tempest-AttachVolumeNegativeTest-server-1196654936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1196654936',id=46,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrvEmHWXecaxLbRJ3TmKwkerkY+E2by6Bss6FNHwqACqgdOaqzTiLKpNH1TIfdeiR3FZAxHwhzhiioXjp5+W/xDT8SuQ5FjRy6lFJIwYh8P1JZqwXlz3TtCf7Yf1yJNLQ==',key_name='tempest-keypair-1427128972',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:36:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1391a0a2167745348384e5890e6c22db',ramdisk_id='',reservation_id='r-ehwousd4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1671295372',owner_user_name='tempest-AttachVolumeNegativeTest-1671295372-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:36:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3c5d292e9594e4aadad9ac72b9455ed',uuid=6777b9e0-9d18-4d13-951c-fafc510455f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0ff7e14-ffa9-4b21-952f-e0ccba875282", "address": "fa:16:3e:6f:82:6c", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ff7e14-ff", "ovs_interfaceid": "e0ff7e14-ffa9-4b21-952f-e0ccba875282", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:39:05 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-e945893f-2365-4306-a3b1-fe34291ef10a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Converting VIF {"id": "e0ff7e14-ffa9-4b21-952f-e0ccba875282", "address": "fa:16:3e:6f:82:6c", "network": {"id": "88e922e4-ec89-460a-954d-aff20a41293c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-713275090-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1391a0a2167745348384e5890e6c22db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ff7e14-ff", "ovs_interfaceid": "e0ff7e14-ffa9-4b21-952f-e0ccba875282", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:39:05 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-e945893f-2365-4306-a3b1-fe34291ef10a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:82:6c,bridge_name='br-int',has_traffic_filtering=True,id=e0ff7e14-ffa9-4b21-952f-e0ccba875282,network=Network(88e922e4-ec89-460a-954d-aff20a41293c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0ff7e14-ff') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:39:05 user nova-compute[73078]: DEBUG os_vif [None req-e945893f-2365-4306-a3b1-fe34291ef10a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:82:6c,bridge_name='br-int',has_traffic_filtering=True,id=e0ff7e14-ffa9-4b21-952f-e0ccba875282,network=Network(88e922e4-ec89-460a-954d-aff20a41293c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0ff7e14-ff') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:39:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0ff7e14-ff, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:39:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:39:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:05 user nova-compute[73078]: INFO os_vif [None req-e945893f-2365-4306-a3b1-fe34291ef10a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:82:6c,bridge_name='br-int',has_traffic_filtering=True,id=e0ff7e14-ffa9-4b21-952f-e0ccba875282,network=Network(88e922e4-ec89-460a-954d-aff20a41293c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0ff7e14-ff')
Aug 14 18:39:05 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-e945893f-2365-4306-a3b1-fe34291ef10a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Deleting instance files /opt/stack/data/nova/instances/6777b9e0-9d18-4d13-951c-fafc510455f0_del
Aug 14 18:39:05 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-e945893f-2365-4306-a3b1-fe34291ef10a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Deletion of /opt/stack/data/nova/instances/6777b9e0-9d18-4d13-951c-fafc510455f0_del complete
Aug 14 18:39:05 user nova-compute[73078]: INFO nova.compute.manager [None req-e945893f-2365-4306-a3b1-fe34291ef10a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Took 1.28 seconds to destroy the instance on the hypervisor.
Aug 14 18:39:05 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-e945893f-2365-4306-a3b1-fe34291ef10a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:39:05 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:39:05 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:39:06 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:39:06 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:39:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-ebbaec07-9843-4cc0-bcb6-f993e62d88c1" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:39:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-ebbaec07-9843-4cc0-bcb6-f993e62d88c1" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:39:06 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:39:06 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:39:06 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Took 0.89 seconds to deallocate network for instance.
Aug 14 18:39:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:06 user nova-compute[73078]: DEBUG nova.compute.manager [req-ee869db9-ba4a-4ea3-a135-b22d1e5f3271 req-f21025d8-76ec-4d6f-ae97-51cdd4074a1c service nova] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Received event network-vif-deleted-e0ff7e14-ffa9-4b21-952f-e0ccba875282 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:39:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e945893f-2365-4306-a3b1-fe34291ef10a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:39:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e945893f-2365-4306-a3b1-fe34291ef10a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:39:06 user nova-compute[73078]: DEBUG nova.compute.manager [req-0a2026d5-a5ce-4d45-a2b2-0c244c6d0c33 req-d696139e-3520-41d0-963c-cd7fefbefb87 service nova] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Received event network-vif-plugged-e0ff7e14-ffa9-4b21-952f-e0ccba875282 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:39:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0a2026d5-a5ce-4d45-a2b2-0c244c6d0c33 req-d696139e-3520-41d0-963c-cd7fefbefb87 service nova] Acquiring lock "6777b9e0-9d18-4d13-951c-fafc510455f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:39:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0a2026d5-a5ce-4d45-a2b2-0c244c6d0c33 req-d696139e-3520-41d0-963c-cd7fefbefb87 service nova] Lock "6777b9e0-9d18-4d13-951c-fafc510455f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:39:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0a2026d5-a5ce-4d45-a2b2-0c244c6d0c33 req-d696139e-3520-41d0-963c-cd7fefbefb87 service nova] Lock "6777b9e0-9d18-4d13-951c-fafc510455f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:39:06 user nova-compute[73078]: DEBUG nova.compute.manager [req-0a2026d5-a5ce-4d45-a2b2-0c244c6d0c33 req-d696139e-3520-41d0-963c-cd7fefbefb87 service nova] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] No waiting events found dispatching network-vif-plugged-e0ff7e14-ffa9-4b21-952f-e0ccba875282 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:39:06 user nova-compute[73078]: WARNING nova.compute.manager [req-0a2026d5-a5ce-4d45-a2b2-0c244c6d0c33 req-d696139e-3520-41d0-963c-cd7fefbefb87 service nova] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Received unexpected event network-vif-plugged-e0ff7e14-ffa9-4b21-952f-e0ccba875282 for instance with vm_state deleted and task_state None.
Aug 14 18:39:06 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-e945893f-2365-4306-a3b1-fe34291ef10a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:39:06 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-e945893f-2365-4306-a3b1-fe34291ef10a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:39:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e945893f-2365-4306-a3b1-fe34291ef10a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:39:06 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-e945893f-2365-4306-a3b1-fe34291ef10a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Deleted allocations for instance 6777b9e0-9d18-4d13-951c-fafc510455f0
Aug 14 18:39:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-e945893f-2365-4306-a3b1-fe34291ef10a tempest-AttachVolumeNegativeTest-1671295372 tempest-AttachVolumeNegativeTest-1671295372-project-member] Lock "6777b9e0-9d18-4d13-951c-fafc510455f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.807s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:39:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:07 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Updating instance_info_cache with network_info: [{"id": "f4b39d8b-c9a2-4747-88ba-834f2542b617", "address": "fa:16:3e:7d:d8:49", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b39d8b-c9", "ovs_interfaceid": "f4b39d8b-c9a2-4747-88ba-834f2542b617", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:39:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-ebbaec07-9843-4cc0-bcb6-f993e62d88c1" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:39:07 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:39:07 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:39:07 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:39:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:39:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:39:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:39:07 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:39:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:39:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:39:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:39:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:39:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:39:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:39:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:39:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:39:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:39:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:39:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:39:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:39:08 user nova-compute[73078]: DEBUG nova.compute.manager [req-13de56d6-f6f5-4ae7-a719-8f8c5294b81e req-00651a15-fed4-4219-a079-ae622466df05 service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Received event network-vif-plugged-2dd60866-9ed8-4840-a797-893d81ab2b65 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:39:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-13de56d6-f6f5-4ae7-a719-8f8c5294b81e req-00651a15-fed4-4219-a079-ae622466df05 service nova] Acquiring lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:39:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-13de56d6-f6f5-4ae7-a719-8f8c5294b81e req-00651a15-fed4-4219-a079-ae622466df05 service nova] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:39:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-13de56d6-f6f5-4ae7-a719-8f8c5294b81e req-00651a15-fed4-4219-a079-ae622466df05 service nova] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:39:08 user nova-compute[73078]: DEBUG nova.compute.manager [req-13de56d6-f6f5-4ae7-a719-8f8c5294b81e req-00651a15-fed4-4219-a079-ae622466df05 service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] No waiting events found dispatching network-vif-plugged-2dd60866-9ed8-4840-a797-893d81ab2b65 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:39:08 user nova-compute[73078]: WARNING nova.compute.manager [req-13de56d6-f6f5-4ae7-a719-8f8c5294b81e req-00651a15-fed4-4219-a079-ae622466df05 service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Received unexpected event network-vif-plugged-2dd60866-9ed8-4840-a797-893d81ab2b65 for instance with vm_state stopped and task_state powering-on.
Aug 14 18:39:08 user nova-compute[73078]: DEBUG nova.compute.manager [req-13de56d6-f6f5-4ae7-a719-8f8c5294b81e req-00651a15-fed4-4219-a079-ae622466df05 service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Received event network-vif-plugged-2dd60866-9ed8-4840-a797-893d81ab2b65 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:39:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-13de56d6-f6f5-4ae7-a719-8f8c5294b81e req-00651a15-fed4-4219-a079-ae622466df05 service nova] Acquiring lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:39:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-13de56d6-f6f5-4ae7-a719-8f8c5294b81e req-00651a15-fed4-4219-a079-ae622466df05 service nova] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:39:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-13de56d6-f6f5-4ae7-a719-8f8c5294b81e req-00651a15-fed4-4219-a079-ae622466df05 service nova] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:39:08 user nova-compute[73078]: DEBUG nova.compute.manager [req-13de56d6-f6f5-4ae7-a719-8f8c5294b81e req-00651a15-fed4-4219-a079-ae622466df05 service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] No waiting events found dispatching network-vif-plugged-2dd60866-9ed8-4840-a797-893d81ab2b65 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:39:08 user nova-compute[73078]: WARNING nova.compute.manager [req-13de56d6-f6f5-4ae7-a719-8f8c5294b81e req-00651a15-fed4-4219-a079-ae622466df05 service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Received unexpected event network-vif-plugged-2dd60866-9ed8-4840-a797-893d81ab2b65 for instance with vm_state stopped and task_state powering-on.
Aug 14 18:39:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:39:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:39:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:39:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:08 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692038348.523118, 16a18fae-165b-487b-bfd5-20097eac0a8e => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:39:08 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] VM Resumed (Lifecycle Event)
Aug 14 18:39:08 user nova-compute[73078]: DEBUG nova.compute.manager [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:39:08 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:39:08 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:39:08 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=8258MB free_disk=24.863872528076172GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:39:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:39:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:39:08 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Instance rebooted successfully.
Aug 14 18:39:08 user nova-compute[73078]: DEBUG nova.compute.manager [None req-659d5889-0f93-431b-befe-e949c8084c71 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:39:08 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:39:08 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:39:08 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 14 18:39:08 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692038348.5244472, 16a18fae-165b-487b-bfd5-20097eac0a8e => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:39:08 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] VM Started (Lifecycle Event)
Aug 14 18:39:08 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:39:08 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:39:09 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 61dfe42b-c943-4617-bf8e-745eaf1a1bb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:39:09 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 3088da30-65b7-4801-b425-93df4fca6ad8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:39:09 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance ebbaec07-9843-4cc0-bcb6-f993e62d88c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:39:09 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 16a18fae-165b-487b-bfd5-20097eac0a8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:39:09 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance a4f1ae2d-5927-4931-bddf-5f503c4a94c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:39:09 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 70bcb548-3cd4-4885-b0e0-b3cd3d14986e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:39:09 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:39:09 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:39:09 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:39:09 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:39:09 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:39:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.347s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:39:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:11 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:39:11 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:39:11 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:39:11 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:39:12 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:39:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-918da274-ad2c-4e36-b314-77c56d541981 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "ebbaec07-9843-4cc0-bcb6-f993e62d88c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:39:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-918da274-ad2c-4e36-b314-77c56d541981 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "ebbaec07-9843-4cc0-bcb6-f993e62d88c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:39:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-918da274-ad2c-4e36-b314-77c56d541981 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "ebbaec07-9843-4cc0-bcb6-f993e62d88c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:39:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-918da274-ad2c-4e36-b314-77c56d541981 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "ebbaec07-9843-4cc0-bcb6-f993e62d88c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:39:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-918da274-ad2c-4e36-b314-77c56d541981 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "ebbaec07-9843-4cc0-bcb6-f993e62d88c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:39:12 user nova-compute[73078]: INFO nova.compute.manager [None req-918da274-ad2c-4e36-b314-77c56d541981 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Terminating instance
Aug 14 18:39:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-918da274-ad2c-4e36-b314-77c56d541981 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:39:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:12 user nova-compute[73078]: DEBUG nova.compute.manager [req-9caf08e2-15b8-44d9-965e-b24c7b636ba5 req-74889079-bd0c-4063-9bcc-c5605ff4bff5 service nova] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Received event network-vif-unplugged-f4b39d8b-c9a2-4747-88ba-834f2542b617 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:39:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9caf08e2-15b8-44d9-965e-b24c7b636ba5 req-74889079-bd0c-4063-9bcc-c5605ff4bff5 service nova] Acquiring lock "ebbaec07-9843-4cc0-bcb6-f993e62d88c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:39:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9caf08e2-15b8-44d9-965e-b24c7b636ba5 req-74889079-bd0c-4063-9bcc-c5605ff4bff5 service nova] Lock "ebbaec07-9843-4cc0-bcb6-f993e62d88c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:39:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-9caf08e2-15b8-44d9-965e-b24c7b636ba5 req-74889079-bd0c-4063-9bcc-c5605ff4bff5 service nova] Lock "ebbaec07-9843-4cc0-bcb6-f993e62d88c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:39:12 user nova-compute[73078]: DEBUG nova.compute.manager [req-9caf08e2-15b8-44d9-965e-b24c7b636ba5 req-74889079-bd0c-4063-9bcc-c5605ff4bff5 service nova] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] No waiting events found dispatching network-vif-unplugged-f4b39d8b-c9a2-4747-88ba-834f2542b617 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:39:12 user nova-compute[73078]: DEBUG nova.compute.manager [req-9caf08e2-15b8-44d9-965e-b24c7b636ba5 req-74889079-bd0c-4063-9bcc-c5605ff4bff5 service nova] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Received event network-vif-unplugged-f4b39d8b-c9a2-4747-88ba-834f2542b617 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:39:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:13 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:39:13 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Instance destroyed successfully.
Aug 14 18:39:13 user nova-compute[73078]: DEBUG nova.objects.instance [None req-918da274-ad2c-4e36-b314-77c56d541981 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lazy-loading 'resources' on Instance uuid ebbaec07-9843-4cc0-bcb6-f993e62d88c1 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:39:13 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-918da274-ad2c-4e36-b314-77c56d541981 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:29:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1399755996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1399755996',id=40,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:29:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16e938ed650845d0a64b49273c9f6287',ramdisk_id='',reservation_id='r-we05iq9j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1267883434',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:31:47Z,user_data=None,user_id='0bff079d90d942bb8ab3ba53fb007125',uuid=ebbaec07-9843-4cc0-bcb6-f993e62d88c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4b39d8b-c9a2-4747-88ba-834f2542b617", "address": "fa:16:3e:7d:d8:49", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b39d8b-c9", "ovs_interfaceid": "f4b39d8b-c9a2-4747-88ba-834f2542b617", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:39:13 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-918da274-ad2c-4e36-b314-77c56d541981 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Converting VIF {"id": "f4b39d8b-c9a2-4747-88ba-834f2542b617", "address": "fa:16:3e:7d:d8:49", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b39d8b-c9", "ovs_interfaceid": "f4b39d8b-c9a2-4747-88ba-834f2542b617", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:39:13 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-918da274-ad2c-4e36-b314-77c56d541981 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:d8:49,bridge_name='br-int',has_traffic_filtering=True,id=f4b39d8b-c9a2-4747-88ba-834f2542b617,network=Network(98a29135-c5de-46a6-a2bf-46c90b4e255b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4b39d8b-c9') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:39:13 user nova-compute[73078]: DEBUG os_vif [None req-918da274-ad2c-4e36-b314-77c56d541981 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:d8:49,bridge_name='br-int',has_traffic_filtering=True,id=f4b39d8b-c9a2-4747-88ba-834f2542b617,network=Network(98a29135-c5de-46a6-a2bf-46c90b4e255b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4b39d8b-c9') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:39:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4b39d8b-c9, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:39:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:39:13 user nova-compute[73078]: INFO os_vif [None req-918da274-ad2c-4e36-b314-77c56d541981 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:d8:49,bridge_name='br-int',has_traffic_filtering=True,id=f4b39d8b-c9a2-4747-88ba-834f2542b617,network=Network(98a29135-c5de-46a6-a2bf-46c90b4e255b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4b39d8b-c9')
Aug 14 18:39:13 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-918da274-ad2c-4e36-b314-77c56d541981 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Deleting instance files /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1_del
Aug 14 18:39:13 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-918da274-ad2c-4e36-b314-77c56d541981 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Deletion of /opt/stack/data/nova/instances/ebbaec07-9843-4cc0-bcb6-f993e62d88c1_del complete
Aug 14 18:39:13 user nova-compute[73078]: INFO nova.compute.manager [None req-918da274-ad2c-4e36-b314-77c56d541981 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 14 18:39:13 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-918da274-ad2c-4e36-b314-77c56d541981 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:39:13 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:39:13 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:39:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:13 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:39:14 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Took 0.56 seconds to deallocate network for instance.
Aug 14 18:39:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-918da274-ad2c-4e36-b314-77c56d541981 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:39:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-918da274-ad2c-4e36-b314-77c56d541981 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:39:14 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:39:14 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-918da274-ad2c-4e36-b314-77c56d541981 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:39:14 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-918da274-ad2c-4e36-b314-77c56d541981 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:39:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-918da274-ad2c-4e36-b314-77c56d541981 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.207s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:39:14 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-918da274-ad2c-4e36-b314-77c56d541981 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Deleted allocations for instance ebbaec07-9843-4cc0-bcb6-f993e62d88c1
Aug 14 18:39:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-918da274-ad2c-4e36-b314-77c56d541981 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "ebbaec07-9843-4cc0-bcb6-f993e62d88c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.825s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:39:14 user nova-compute[73078]: DEBUG nova.compute.manager [req-d6683d0c-db34-4bac-a438-8329747584c4 req-161f7f82-bcfd-4dc0-89d1-7ac22b69ba04 service nova] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Received event network-vif-plugged-f4b39d8b-c9a2-4747-88ba-834f2542b617 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:39:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d6683d0c-db34-4bac-a438-8329747584c4 req-161f7f82-bcfd-4dc0-89d1-7ac22b69ba04 service nova] Acquiring lock "ebbaec07-9843-4cc0-bcb6-f993e62d88c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:39:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d6683d0c-db34-4bac-a438-8329747584c4 req-161f7f82-bcfd-4dc0-89d1-7ac22b69ba04 service nova] Lock "ebbaec07-9843-4cc0-bcb6-f993e62d88c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:39:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d6683d0c-db34-4bac-a438-8329747584c4 req-161f7f82-bcfd-4dc0-89d1-7ac22b69ba04 service nova] Lock "ebbaec07-9843-4cc0-bcb6-f993e62d88c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:39:14 user nova-compute[73078]: DEBUG nova.compute.manager [req-d6683d0c-db34-4bac-a438-8329747584c4 req-161f7f82-bcfd-4dc0-89d1-7ac22b69ba04 service nova] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] No waiting events found dispatching network-vif-plugged-f4b39d8b-c9a2-4747-88ba-834f2542b617 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:39:14 user nova-compute[73078]: WARNING nova.compute.manager [req-d6683d0c-db34-4bac-a438-8329747584c4 req-161f7f82-bcfd-4dc0-89d1-7ac22b69ba04 service nova] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Received unexpected event network-vif-plugged-f4b39d8b-c9a2-4747-88ba-834f2542b617 for instance with vm_state deleted and task_state None.
Aug 14 18:39:14 user nova-compute[73078]: DEBUG nova.compute.manager [req-d6683d0c-db34-4bac-a438-8329747584c4 req-161f7f82-bcfd-4dc0-89d1-7ac22b69ba04 service nova] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Received event network-vif-deleted-f4b39d8b-c9a2-4747-88ba-834f2542b617 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:39:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:19 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:39:20 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692038345.2536402, 6777b9e0-9d18-4d13-951c-fafc510455f0 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:39:20 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] VM Stopped (Lifecycle Event)
Aug 14 18:39:20 user nova-compute[73078]: DEBUG nova.compute.manager [None req-d4448072-2bc2-4162-ae51-9d42ad87f4c5 None None] [instance: 6777b9e0-9d18-4d13-951c-fafc510455f0] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:39:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:39:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:28 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692038353.3525693, ebbaec07-9843-4cc0-bcb6-f993e62d88c1 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:39:28 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] VM Stopped (Lifecycle Event)
Aug 14 18:39:28 user nova-compute[73078]: DEBUG nova.compute.manager [None req-2ff3efb5-1bbf-4f66-aff0-778e39664022 None None] [instance: ebbaec07-9843-4cc0-bcb6-f993e62d88c1] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:39:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:29 user nova-compute[73078]: DEBUG nova.compute.manager [req-b0856c8f-7f68-46d2-80d7-343550aaa236 req-0c9c031b-1202-431e-8845-2a3aa73ed6a2 service nova] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Received event network-changed-b0f702c7-f5b1-4610-a26b-d82df3b12ed5 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:39:29 user nova-compute[73078]: DEBUG nova.compute.manager [req-b0856c8f-7f68-46d2-80d7-343550aaa236 req-0c9c031b-1202-431e-8845-2a3aa73ed6a2 service nova] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Refreshing instance network info cache due to event network-changed-b0f702c7-f5b1-4610-a26b-d82df3b12ed5. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:39:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b0856c8f-7f68-46d2-80d7-343550aaa236 req-0c9c031b-1202-431e-8845-2a3aa73ed6a2 service nova] Acquiring lock "refresh_cache-70bcb548-3cd4-4885-b0e0-b3cd3d14986e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:39:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b0856c8f-7f68-46d2-80d7-343550aaa236 req-0c9c031b-1202-431e-8845-2a3aa73ed6a2 service nova] Acquired lock "refresh_cache-70bcb548-3cd4-4885-b0e0-b3cd3d14986e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:39:29 user nova-compute[73078]: DEBUG nova.network.neutron [req-b0856c8f-7f68-46d2-80d7-343550aaa236 req-0c9c031b-1202-431e-8845-2a3aa73ed6a2 service nova] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Refreshing network info cache for port b0f702c7-f5b1-4610-a26b-d82df3b12ed5 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:39:30 user nova-compute[73078]: DEBUG nova.network.neutron [req-b0856c8f-7f68-46d2-80d7-343550aaa236 req-0c9c031b-1202-431e-8845-2a3aa73ed6a2 service nova] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Updated VIF entry in instance network info cache for port b0f702c7-f5b1-4610-a26b-d82df3b12ed5. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:39:30 user nova-compute[73078]: DEBUG nova.network.neutron [req-b0856c8f-7f68-46d2-80d7-343550aaa236 req-0c9c031b-1202-431e-8845-2a3aa73ed6a2 service nova] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Updating instance_info_cache with network_info: [{"id": "b0f702c7-f5b1-4610-a26b-d82df3b12ed5", "address": "fa:16:3e:35:1f:5e", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f702c7-f5", "ovs_interfaceid": "b0f702c7-f5b1-4610-a26b-d82df3b12ed5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:39:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b0856c8f-7f68-46d2-80d7-343550aaa236 req-0c9c031b-1202-431e-8845-2a3aa73ed6a2 service nova] Releasing lock "refresh_cache-70bcb548-3cd4-4885-b0e0-b3cd3d14986e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:39:30 user nova-compute[73078]: DEBUG nova.compute.manager [req-77870539-8f6e-4ac1-aa98-02c6bb125d9c req-10b61085-73d5-4345-88db-c56a33e2ec7b service nova] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Received event network-changed-b0f702c7-f5b1-4610-a26b-d82df3b12ed5 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:39:30 user nova-compute[73078]: DEBUG nova.compute.manager [req-77870539-8f6e-4ac1-aa98-02c6bb125d9c req-10b61085-73d5-4345-88db-c56a33e2ec7b service nova] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Refreshing instance network info cache due to event network-changed-b0f702c7-f5b1-4610-a26b-d82df3b12ed5. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:39:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-77870539-8f6e-4ac1-aa98-02c6bb125d9c req-10b61085-73d5-4345-88db-c56a33e2ec7b service nova] Acquiring lock "refresh_cache-70bcb548-3cd4-4885-b0e0-b3cd3d14986e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:39:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-77870539-8f6e-4ac1-aa98-02c6bb125d9c req-10b61085-73d5-4345-88db-c56a33e2ec7b service nova] Acquired lock "refresh_cache-70bcb548-3cd4-4885-b0e0-b3cd3d14986e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:39:30 user nova-compute[73078]: DEBUG nova.network.neutron [req-77870539-8f6e-4ac1-aa98-02c6bb125d9c req-10b61085-73d5-4345-88db-c56a33e2ec7b service nova] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Refreshing network info cache for port b0f702c7-f5b1-4610-a26b-d82df3b12ed5 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:39:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "70bcb548-3cd4-4885-b0e0-b3cd3d14986e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:39:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "70bcb548-3cd4-4885-b0e0-b3cd3d14986e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:39:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "70bcb548-3cd4-4885-b0e0-b3cd3d14986e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:39:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "70bcb548-3cd4-4885-b0e0-b3cd3d14986e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:39:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "70bcb548-3cd4-4885-b0e0-b3cd3d14986e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:39:30 user nova-compute[73078]: INFO nova.compute.manager [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Terminating instance
Aug 14 18:39:30 user nova-compute[73078]: DEBUG nova.compute.manager [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:39:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:30 user nova-compute[73078]: DEBUG nova.network.neutron [req-77870539-8f6e-4ac1-aa98-02c6bb125d9c req-10b61085-73d5-4345-88db-c56a33e2ec7b service nova] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Updated VIF entry in instance network info cache for port b0f702c7-f5b1-4610-a26b-d82df3b12ed5. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:39:30 user nova-compute[73078]: DEBUG nova.network.neutron [req-77870539-8f6e-4ac1-aa98-02c6bb125d9c req-10b61085-73d5-4345-88db-c56a33e2ec7b service nova] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Updating instance_info_cache with network_info: [{"id": "b0f702c7-f5b1-4610-a26b-d82df3b12ed5", "address": "fa:16:3e:35:1f:5e", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f702c7-f5", "ovs_interfaceid": "b0f702c7-f5b1-4610-a26b-d82df3b12ed5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:39:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-77870539-8f6e-4ac1-aa98-02c6bb125d9c req-10b61085-73d5-4345-88db-c56a33e2ec7b service nova] Releasing lock "refresh_cache-70bcb548-3cd4-4885-b0e0-b3cd3d14986e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:39:31 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Instance destroyed successfully.
Aug 14 18:39:31 user nova-compute[73078]: DEBUG nova.objects.instance [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lazy-loading 'resources' on Instance uuid 70bcb548-3cd4-4885-b0e0-b3cd3d14986e {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:37:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-423613483',display_name='tempest-TestVolumeBootPattern-server-423613483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-423613483',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU8q8wtxkW9pROl2j0NkoRwpKKcmziB/20QEkNRAKEXt/Sm0AgtPtqW4EQeZ9Nz+9SI3khJoGje9+NMiFY56dE76HSwv/RbWY1Ab2OSscMaXE4ftFHwz3mwUt13yK/iVg==',key_name='tempest-TestVolumeBootPattern-511986969',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:37:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7142101014c4defa7261a34fb9f28e4',ramdisk_id='',reservation_id='r-v58xtc0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1889877750',owner_user_name='tempest-TestVolumeBootPattern-1889877750-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:37:52Z,user_data=None,user_id='fe79455616584e0fb80e6007edf0b706',uuid=70bcb548-3cd4-4885-b0e0-b3cd3d14986e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0f702c7-f5b1-4610-a26b-d82df3b12ed5", "address": "fa:16:3e:35:1f:5e", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f702c7-f5", "ovs_interfaceid": "b0f702c7-f5b1-4610-a26b-d82df3b12ed5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Converting VIF {"id": "b0f702c7-f5b1-4610-a26b-d82df3b12ed5", "address": "fa:16:3e:35:1f:5e", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0f702c7-f5", "ovs_interfaceid": "b0f702c7-f5b1-4610-a26b-d82df3b12ed5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:1f:5e,bridge_name='br-int',has_traffic_filtering=True,id=b0f702c7-f5b1-4610-a26b-d82df3b12ed5,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0f702c7-f5') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG os_vif [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:1f:5e,bridge_name='br-int',has_traffic_filtering=True,id=b0f702c7-f5b1-4610-a26b-d82df3b12ed5,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0f702c7-f5') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0f702c7-f5, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:39:31 user nova-compute[73078]: INFO os_vif [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:1f:5e,bridge_name='br-int',has_traffic_filtering=True,id=b0f702c7-f5b1-4610-a26b-d82df3b12ed5,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0f702c7-f5')
Aug 14 18:39:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XBKtwDzb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:39:31 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:39:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[07244c9a-e133-4b07-91ec-9bf64cf54147]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c25ecb-8563-43ba-9037-1f21ca489436]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:39:31 user nova-compute[73078]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:39:31 user nova-compute[73078]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 (non-flash)
Aug 14 18:39:31 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:39:31 user nova-compute[73078]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:39:31 user nova-compute[73078]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 (non-flash)
Aug 14 18:39:31 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9546a0790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4'): ({'sdc'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Removing single pathed devices sdc {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[847091cd-c9bd-4325-9e6b-7a6f70f732df]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e030647-6bf3-490f-9356-812b093bbadf]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Flushing IO for device /dev/sdc {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc80f5f-cb16-4241-8a1a-d4bee2c7d49b]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG nova.compute.manager [req-0f83f0e8-cd0a-478e-8c0e-2df90e0f1318 req-cb16f551-0288-4bbf-9e3d-5af1d527653c service nova] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Received event network-vif-unplugged-b0f702c7-f5b1-4610-a26b-d82df3b12ed5 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0f83f0e8-cd0a-478e-8c0e-2df90e0f1318 req-cb16f551-0288-4bbf-9e3d-5af1d527653c service nova] Acquiring lock "70bcb548-3cd4-4885-b0e0-b3cd3d14986e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0f83f0e8-cd0a-478e-8c0e-2df90e0f1318 req-cb16f551-0288-4bbf-9e3d-5af1d527653c service nova] Lock "70bcb548-3cd4-4885-b0e0-b3cd3d14986e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0f83f0e8-cd0a-478e-8c0e-2df90e0f1318 req-cb16f551-0288-4bbf-9e3d-5af1d527653c service nova] Lock "70bcb548-3cd4-4885-b0e0-b3cd3d14986e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG nova.compute.manager [req-0f83f0e8-cd0a-478e-8c0e-2df90e0f1318 req-cb16f551-0288-4bbf-9e3d-5af1d527653c service nova] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] No waiting events found dispatching network-vif-unplugged-b0f702c7-f5b1-4610-a26b-d82df3b12ed5 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG nova.compute.manager [req-0f83f0e8-cd0a-478e-8c0e-2df90e0f1318 req-cb16f551-0288-4bbf-9e3d-5af1d527653c service nova] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Received event network-vif-unplugged-b0f702c7-f5b1-4610-a26b-d82df3b12ed5 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG nova.compute.manager [req-0f83f0e8-cd0a-478e-8c0e-2df90e0f1318 req-cb16f551-0288-4bbf-9e3d-5af1d527653c service nova] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Received event network-vif-plugged-b0f702c7-f5b1-4610-a26b-d82df3b12ed5 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0f83f0e8-cd0a-478e-8c0e-2df90e0f1318 req-cb16f551-0288-4bbf-9e3d-5af1d527653c service nova] Acquiring lock "70bcb548-3cd4-4885-b0e0-b3cd3d14986e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0f83f0e8-cd0a-478e-8c0e-2df90e0f1318 req-cb16f551-0288-4bbf-9e3d-5af1d527653c service nova] Lock "70bcb548-3cd4-4885-b0e0-b3cd3d14986e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0f83f0e8-cd0a-478e-8c0e-2df90e0f1318 req-cb16f551-0288-4bbf-9e3d-5af1d527653c service nova] Lock "70bcb548-3cd4-4885-b0e0-b3cd3d14986e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG nova.compute.manager [req-0f83f0e8-cd0a-478e-8c0e-2df90e0f1318 req-cb16f551-0288-4bbf-9e3d-5af1d527653c service nova] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] No waiting events found dispatching network-vif-plugged-b0f702c7-f5b1-4610-a26b-d82df3b12ed5 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:39:31 user nova-compute[73078]: WARNING nova.compute.manager [req-0f83f0e8-cd0a-478e-8c0e-2df90e0f1318 req-cb16f551-0288-4bbf-9e3d-5af1d527653c service nova] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Received unexpected event network-vif-plugged-b0f702c7-f5b1-4610-a26b-d82df3b12ed5 for instance with vm_state active and task_state deleting.
Aug 14 18:39:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b2fb47-970b-42d3-a85d-09001f9bcfae]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] SCSI volumes sdc have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[17668645-b408-4e9a-964b-6e161090d94d]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c2256f-46b1-4011-a1ce-8f7ae54e30a8]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4, portal: 172.16.0.220,3260]
Aug 14 18:39:31 user nova-compute[73078]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4, portal: 172.16.0.220,3260] successful.
Aug 14 18:39:31 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a281dbf-5eed-47fd-9da0-5e7a0dbacbe4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b840c5-2439-44b4-ac1e-deded19f49ec]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] <== disconnect_volume: return (303ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:39:31 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Deleting instance files /opt/stack/data/nova/instances/70bcb548-3cd4-4885-b0e0-b3cd3d14986e_del
Aug 14 18:39:31 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Deletion of /opt/stack/data/nova/instances/70bcb548-3cd4-4885-b0e0-b3cd3d14986e_del complete
Aug 14 18:39:31 user nova-compute[73078]: INFO nova.compute.manager [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 14 18:39:31 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:39:31 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:39:32 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:39:32 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Took 0.62 seconds to deallocate network for instance.
Aug 14 18:39:32 user nova-compute[73078]: DEBUG nova.compute.manager [req-8000146a-9bf7-4616-8cda-3387544c3089 req-6ea9b091-ec67-4f82-982f-ea5eb1d82341 service nova] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Received event network-vif-deleted-b0f702c7-f5b1-4610-a26b-d82df3b12ed5 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:39:33 user nova-compute[73078]: INFO nova.compute.manager [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Took 0.73 seconds to detach 1 volumes for instance.
Aug 14 18:39:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:39:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:39:33 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:39:33 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:39:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.183s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:39:33 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Deleted allocations for instance 70bcb548-3cd4-4885-b0e0-b3cd3d14986e
Aug 14 18:39:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-c638a2a1-13ff-43fe-b424-98da49870846 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "70bcb548-3cd4-4885-b0e0-b3cd3d14986e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.857s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:39:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:46 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692038371.3650105, 70bcb548-3cd4-4885-b0e0-b3cd3d14986e => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:39:46 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] VM Stopped (Lifecycle Event)
Aug 14 18:39:46 user nova-compute[73078]: DEBUG nova.compute.manager [None req-9b697b55-11da-41c9-bcf5-dcdd68a8f620 None None] [instance: 70bcb548-3cd4-4885-b0e0-b3cd3d14986e] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:39:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:39:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:39:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:39:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:39:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:39:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "3088da30-65b7-4801-b425-93df4fca6ad8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:40:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "3088da30-65b7-4801-b425-93df4fca6ad8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:40:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:40:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:40:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:40:03 user nova-compute[73078]: INFO nova.compute.manager [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Terminating instance
Aug 14 18:40:03 user nova-compute[73078]: DEBUG nova.compute.manager [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:40:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:03 user nova-compute[73078]: DEBUG nova.compute.manager [req-48b45e09-a174-4f0a-afef-c2ec5d0001b1 req-ba37e359-5b6a-4b5f-8d05-aed2c1cffbe9 service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Received event network-vif-unplugged-52e93284-9b32-4191-8f06-ab9c4497579c {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:40:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-48b45e09-a174-4f0a-afef-c2ec5d0001b1 req-ba37e359-5b6a-4b5f-8d05-aed2c1cffbe9 service nova] Acquiring lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:40:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-48b45e09-a174-4f0a-afef-c2ec5d0001b1 req-ba37e359-5b6a-4b5f-8d05-aed2c1cffbe9 service nova] Lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:40:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-48b45e09-a174-4f0a-afef-c2ec5d0001b1 req-ba37e359-5b6a-4b5f-8d05-aed2c1cffbe9 service nova] Lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:40:03 user nova-compute[73078]: DEBUG nova.compute.manager [req-48b45e09-a174-4f0a-afef-c2ec5d0001b1 req-ba37e359-5b6a-4b5f-8d05-aed2c1cffbe9 service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] No waiting events found dispatching network-vif-unplugged-52e93284-9b32-4191-8f06-ab9c4497579c {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:40:03 user nova-compute[73078]: DEBUG nova.compute.manager [req-48b45e09-a174-4f0a-afef-c2ec5d0001b1 req-ba37e359-5b6a-4b5f-8d05-aed2c1cffbe9 service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Received event network-vif-unplugged-52e93284-9b32-4191-8f06-ab9c4497579c for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:40:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:03 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Instance destroyed successfully.
Aug 14 18:40:03 user nova-compute[73078]: DEBUG nova.objects.instance [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lazy-loading 'resources' on Instance uuid 3088da30-65b7-4801-b425-93df4fca6ad8 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:40:03 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:24:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1775384835',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1775384835',id=31,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:26:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16e938ed650845d0a64b49273c9f6287',ramdisk_id='',reservation_id='r-ac9ip7h8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1267883434',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:28:04Z,user_data=None,user_id='0bff079d90d942bb8ab3ba53fb007125',uuid=3088da30-65b7-4801-b425-93df4fca6ad8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52e93284-9b32-4191-8f06-ab9c4497579c", "address": "fa:16:3e:ec:04:07", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e93284-9b", "ovs_interfaceid": "52e93284-9b32-4191-8f06-ab9c4497579c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:40:03 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Converting VIF {"id": "52e93284-9b32-4191-8f06-ab9c4497579c", "address": "fa:16:3e:ec:04:07", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e93284-9b", "ovs_interfaceid": "52e93284-9b32-4191-8f06-ab9c4497579c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:40:03 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:04:07,bridge_name='br-int',has_traffic_filtering=True,id=52e93284-9b32-4191-8f06-ab9c4497579c,network=Network(98a29135-c5de-46a6-a2bf-46c90b4e255b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e93284-9b') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:40:03 user nova-compute[73078]: DEBUG os_vif [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:04:07,bridge_name='br-int',has_traffic_filtering=True,id=52e93284-9b32-4191-8f06-ab9c4497579c,network=Network(98a29135-c5de-46a6-a2bf-46c90b4e255b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e93284-9b') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:40:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52e93284-9b, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:40:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:40:03 user nova-compute[73078]: INFO os_vif [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:04:07,bridge_name='br-int',has_traffic_filtering=True,id=52e93284-9b32-4191-8f06-ab9c4497579c,network=Network(98a29135-c5de-46a6-a2bf-46c90b4e255b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e93284-9b')
Aug 14 18:40:03 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:40:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rVZtSKwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:40:03 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:40:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:40:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:40:03 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:40:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:40:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:40:03 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6481d593-529e-4443-b1f4-2efe2471f1f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:40:03 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7dbe8f4-ae2c-4aef-8cb0-5230d4928e27]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:40:04 user nova-compute[73078]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:40:04 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb (non-flash)
Aug 14 18:40:04 user nova-compute[73078]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:40:04 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe99017e3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb'): ({'sdb'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Removing single pathed devices sdb {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc943b9-c552-4219-a77e-327c408946de]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e58e46c-1d2e-41cb-994a-4b56c2949b12]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Flushing IO for device /dev/sdb {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b406e8-4660-4dbd-8f27-edbf5085d9d0]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95419ec-92d6-4277-8787-6c2209922229]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] SCSI volumes sdb have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a86651-52fb-4b0c-833c-cb40f348278f]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb707517-0f5d-4299-b3b6-d4a7e2acef8d]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb, portal: 172.16.0.220,3260]
Aug 14 18:40:04 user nova-compute[73078]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb, portal: 172.16.0.220,3260] successful.
Aug 14 18:40:04 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c2186e7-99c9-4655-b4a6-ca20280ec7eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f18ded-ce5c-4273-8740-e0d84d1cbc98]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] <== disconnect_volume: return (279ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:40:04 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Deleting instance files /opt/stack/data/nova/instances/3088da30-65b7-4801-b425-93df4fca6ad8_del
Aug 14 18:40:04 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Deletion of /opt/stack/data/nova/instances/3088da30-65b7-4801-b425-93df4fca6ad8_del complete
Aug 14 18:40:04 user nova-compute[73078]: INFO nova.compute.manager [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 14 18:40:04 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:40:04 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:40:05 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:40:05 user nova-compute[73078]: DEBUG nova.compute.manager [req-b894c9e6-ead6-41a0-99d6-00540c010e23 req-a34dd30e-a30f-41a7-b60e-0ffd4903e8d2 service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Received event network-vif-deleted-52e93284-9b32-4191-8f06-ab9c4497579c {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:40:05 user nova-compute[73078]: INFO nova.compute.manager [req-b894c9e6-ead6-41a0-99d6-00540c010e23 req-a34dd30e-a30f-41a7-b60e-0ffd4903e8d2 service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Neutron deleted interface 52e93284-9b32-4191-8f06-ab9c4497579c; detaching it from the instance and deleting it from the info cache
Aug 14 18:40:05 user nova-compute[73078]: DEBUG nova.network.neutron [req-b894c9e6-ead6-41a0-99d6-00540c010e23 req-a34dd30e-a30f-41a7-b60e-0ffd4903e8d2 service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:40:05 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Took 0.74 seconds to deallocate network for instance.
Aug 14 18:40:05 user nova-compute[73078]: DEBUG nova.compute.manager [req-b894c9e6-ead6-41a0-99d6-00540c010e23 req-a34dd30e-a30f-41a7-b60e-0ffd4903e8d2 service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Detach interface failed, port_id=52e93284-9b32-4191-8f06-ab9c4497579c, reason: Instance 3088da30-65b7-4801-b425-93df4fca6ad8 could not be found. {{(pid=73078) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 18:40:05 user nova-compute[73078]: DEBUG nova.compute.manager [req-4c7a0c89-6c32-4cb0-bae2-3b1a3784131d req-83580ad8-7bd4-40c9-9a80-caa89191d61f service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Received event network-vif-plugged-52e93284-9b32-4191-8f06-ab9c4497579c {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:40:05 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4c7a0c89-6c32-4cb0-bae2-3b1a3784131d req-83580ad8-7bd4-40c9-9a80-caa89191d61f service nova] Acquiring lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:40:05 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4c7a0c89-6c32-4cb0-bae2-3b1a3784131d req-83580ad8-7bd4-40c9-9a80-caa89191d61f service nova] Lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:40:05 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4c7a0c89-6c32-4cb0-bae2-3b1a3784131d req-83580ad8-7bd4-40c9-9a80-caa89191d61f service nova] Lock "3088da30-65b7-4801-b425-93df4fca6ad8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:40:05 user nova-compute[73078]: DEBUG nova.compute.manager [req-4c7a0c89-6c32-4cb0-bae2-3b1a3784131d req-83580ad8-7bd4-40c9-9a80-caa89191d61f service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] No waiting events found dispatching network-vif-plugged-52e93284-9b32-4191-8f06-ab9c4497579c {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:40:05 user nova-compute[73078]: WARNING nova.compute.manager [req-4c7a0c89-6c32-4cb0-bae2-3b1a3784131d req-83580ad8-7bd4-40c9-9a80-caa89191d61f service nova] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Received unexpected event network-vif-plugged-52e93284-9b32-4191-8f06-ab9c4497579c for instance with vm_state active and task_state deleting.
Aug 14 18:40:05 user nova-compute[73078]: INFO nova.compute.manager [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Took 0.92 seconds to detach 1 volumes for instance.
Aug 14 18:40:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:40:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:40:06 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:40:06 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:40:06 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:40:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-16a18fae-165b-487b-bfd5-20097eac0a8e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:40:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-16a18fae-165b-487b-bfd5-20097eac0a8e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:40:06 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:40:06 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:40:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.188s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:40:06 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Deleted allocations for instance 3088da30-65b7-4801-b425-93df4fca6ad8
Aug 14 18:40:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-acedafe4-0e2a-49fd-9b0a-a56d60025bf1 tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "3088da30-65b7-4801-b425-93df4fca6ad8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.198s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:40:06 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Updating instance_info_cache with network_info: [{"id": "2dd60866-9ed8-4840-a797-893d81ab2b65", "address": "fa:16:3e:62:78:e2", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd60866-9e", "ovs_interfaceid": "2dd60866-9ed8-4840-a797-893d81ab2b65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:40:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-16a18fae-165b-487b-bfd5-20097eac0a8e" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:40:06 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:40:08 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:40:08 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:40:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:40:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:40:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:40:08 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:40:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:40:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:40:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:40:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:40:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:40:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:40:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:40:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:40:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:40:09 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:40:09 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:40:09 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=8403MB free_disk=24.987049102783203GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:40:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:40:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:40:09 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 61dfe42b-c943-4617-bf8e-745eaf1a1bb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:40:09 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 16a18fae-165b-487b-bfd5-20097eac0a8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:40:09 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance a4f1ae2d-5927-4931-bddf-5f503c4a94c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:40:09 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:40:09 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:40:09 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:40:09 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:40:09 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:40:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.237s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:40:10 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:40:10 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:40:10 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:40:12 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:40:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:40:14 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:40:14 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:40:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:16 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:40:18 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692038403.919827, 3088da30-65b7-4801-b425-93df4fca6ad8 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:40:18 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] VM Stopped (Lifecycle Event)
Aug 14 18:40:18 user nova-compute[73078]: DEBUG nova.compute.manager [None req-01b8e126-cd6f-4ddd-8e0e-3d13ca869c64 None None] [instance: 3088da30-65b7-4801-b425-93df4fca6ad8] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:40:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:40:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:40:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:40:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:40:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:40:32 user nova-compute[73078]: DEBUG nova.compute.manager [req-01e74d8a-a6dc-42d4-969d-b1575300dbc4 req-f0fecbf3-5808-4fa1-88cb-921516e421dc service nova] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Received event network-changed-a6d271b4-5e17-46ed-b704-9b7a84ab1c95 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:40:32 user nova-compute[73078]: DEBUG nova.compute.manager [req-01e74d8a-a6dc-42d4-969d-b1575300dbc4 req-f0fecbf3-5808-4fa1-88cb-921516e421dc service nova] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Refreshing instance network info cache due to event network-changed-a6d271b4-5e17-46ed-b704-9b7a84ab1c95. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:40:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-01e74d8a-a6dc-42d4-969d-b1575300dbc4 req-f0fecbf3-5808-4fa1-88cb-921516e421dc service nova] Acquiring lock "refresh_cache-a4f1ae2d-5927-4931-bddf-5f503c4a94c7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:40:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-01e74d8a-a6dc-42d4-969d-b1575300dbc4 req-f0fecbf3-5808-4fa1-88cb-921516e421dc service nova] Acquired lock "refresh_cache-a4f1ae2d-5927-4931-bddf-5f503c4a94c7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:40:32 user nova-compute[73078]: DEBUG nova.network.neutron [req-01e74d8a-a6dc-42d4-969d-b1575300dbc4 req-f0fecbf3-5808-4fa1-88cb-921516e421dc service nova] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Refreshing network info cache for port a6d271b4-5e17-46ed-b704-9b7a84ab1c95 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:40:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "a4f1ae2d-5927-4931-bddf-5f503c4a94c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:40:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "a4f1ae2d-5927-4931-bddf-5f503c4a94c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:40:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "a4f1ae2d-5927-4931-bddf-5f503c4a94c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:40:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "a4f1ae2d-5927-4931-bddf-5f503c4a94c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:40:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "a4f1ae2d-5927-4931-bddf-5f503c4a94c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:40:32 user nova-compute[73078]: INFO nova.compute.manager [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Terminating instance
Aug 14 18:40:32 user nova-compute[73078]: DEBUG nova.compute.manager [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:40:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:33 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Instance destroyed successfully.
Aug 14 18:40:33 user nova-compute[73078]: DEBUG nova.objects.instance [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lazy-loading 'resources' on Instance uuid a4f1ae2d-5927-4931-bddf-5f503c4a94c7 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:35:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1988570499',display_name='tempest-TestVolumeBootPattern-server-1988570499',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1988570499',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU8q8wtxkW9pROl2j0NkoRwpKKcmziB/20QEkNRAKEXt/Sm0AgtPtqW4EQeZ9Nz+9SI3khJoGje9+NMiFY56dE76HSwv/RbWY1Ab2OSscMaXE4ftFHwz3mwUt13yK/iVg==',key_name='tempest-TestVolumeBootPattern-511986969',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:35:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7142101014c4defa7261a34fb9f28e4',ramdisk_id='',reservation_id='r-enisliqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1889877750',owner_user_name='tempest-TestVolumeBootPattern-1889877750-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:35:48Z,user_data=None,user_id='fe79455616584e0fb80e6007edf0b706',uuid=a4f1ae2d-5927-4931-bddf-5f503c4a94c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6d271b4-5e17-46ed-b704-9b7a84ab1c95", "address": "fa:16:3e:28:7f:6d", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d271b4-5e", "ovs_interfaceid": "a6d271b4-5e17-46ed-b704-9b7a84ab1c95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Converting VIF {"id": "a6d271b4-5e17-46ed-b704-9b7a84ab1c95", "address": "fa:16:3e:28:7f:6d", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d271b4-5e", "ovs_interfaceid": "a6d271b4-5e17-46ed-b704-9b7a84ab1c95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:7f:6d,bridge_name='br-int',has_traffic_filtering=True,id=a6d271b4-5e17-46ed-b704-9b7a84ab1c95,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6d271b4-5e') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG os_vif [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:7f:6d,bridge_name='br-int',has_traffic_filtering=True,id=a6d271b4-5e17-46ed-b704-9b7a84ab1c95,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6d271b4-5e') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6d271b4-5e, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:40:33 user nova-compute[73078]: INFO os_vif [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:7f:6d,bridge_name='br-int',has_traffic_filtering=True,id=a6d271b4-5e17-46ed-b704-9b7a84ab1c95,network=Network(1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6d271b4-5e')
Aug 14 18:40:33 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lEybjUpx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:40:33 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:40:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec2d883-5201-49d2-93a1-93700c755d8e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[93416abc-7f16-4abf-81e1-f43e21359b2d]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:40:33 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 (non-flash)
Aug 14 18:40:33 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe97864bac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9'): ({'sde'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Removing single pathed devices sde {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17aa746-8a6e-4960-94da-7fc8e243adb1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e3cd08-b8c0-404f-8ff9-4d94df103ff6]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Flushing IO for device /dev/sde {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf4525d-65bd-45c8-847c-bd9e28b56808]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG nova.compute.manager [req-da3f79ce-c969-44b1-9461-cddcb28462f9 req-00985f49-dbd6-4475-aebd-20b88fab4708 service nova] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Received event network-vif-unplugged-a6d271b4-5e17-46ed-b704-9b7a84ab1c95 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-da3f79ce-c969-44b1-9461-cddcb28462f9 req-00985f49-dbd6-4475-aebd-20b88fab4708 service nova] Acquiring lock "a4f1ae2d-5927-4931-bddf-5f503c4a94c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-da3f79ce-c969-44b1-9461-cddcb28462f9 req-00985f49-dbd6-4475-aebd-20b88fab4708 service nova] Lock "a4f1ae2d-5927-4931-bddf-5f503c4a94c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-da3f79ce-c969-44b1-9461-cddcb28462f9 req-00985f49-dbd6-4475-aebd-20b88fab4708 service nova] Lock "a4f1ae2d-5927-4931-bddf-5f503c4a94c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG nova.compute.manager [req-da3f79ce-c969-44b1-9461-cddcb28462f9 req-00985f49-dbd6-4475-aebd-20b88fab4708 service nova] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] No waiting events found dispatching network-vif-unplugged-a6d271b4-5e17-46ed-b704-9b7a84ab1c95 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG nova.compute.manager [req-da3f79ce-c969-44b1-9461-cddcb28462f9 req-00985f49-dbd6-4475-aebd-20b88fab4708 service nova] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Received event network-vif-unplugged-a6d271b4-5e17-46ed-b704-9b7a84ab1c95 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5dbd21-5cd0-4216-a65d-6df740595840]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] SCSI volumes sde have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_5b8ce4c4', '/dev/disk/by-id/scsi-23231393536303265', '/dev/disk/by-id/scsi-1SCST_BIO5b8ce4c4-2195602e6324a7e9') {{(pid=84732) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5fb5ee-ce4e-48b2-b559-aa01b182f49d]: (4, None) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8155e0-b4d9-488a-8a61-6792cc611bb3]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3027b7-1952-43b3-a5d4-1b9ebcec2716]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9, portal: 172.16.0.220,3260]
Aug 14 18:40:33 user nova-compute[73078]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9, portal: 172.16.0.220,3260] successful.
Aug 14 18:40:33 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70705684-d58a-4b0f-82c9-6285bf674aa9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a756fc-447f-46d5-bfd9-a3797532e307]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] <== disconnect_volume: return (285ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:40:33 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Deleting instance files /opt/stack/data/nova/instances/a4f1ae2d-5927-4931-bddf-5f503c4a94c7_del
Aug 14 18:40:33 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Deletion of /opt/stack/data/nova/instances/a4f1ae2d-5927-4931-bddf-5f503c4a94c7_del complete
Aug 14 18:40:33 user nova-compute[73078]: DEBUG nova.network.neutron [req-01e74d8a-a6dc-42d4-969d-b1575300dbc4 req-f0fecbf3-5808-4fa1-88cb-921516e421dc service nova] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Updated VIF entry in instance network info cache for port a6d271b4-5e17-46ed-b704-9b7a84ab1c95. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG nova.network.neutron [req-01e74d8a-a6dc-42d4-969d-b1575300dbc4 req-f0fecbf3-5808-4fa1-88cb-921516e421dc service nova] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Updating instance_info_cache with network_info: [{"id": "a6d271b4-5e17-46ed-b704-9b7a84ab1c95", "address": "fa:16:3e:28:7f:6d", "network": {"id": "1c4c9a9c-79b9-4a3b-9ea2-47dcf85fd4a9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1932697480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7142101014c4defa7261a34fb9f28e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d271b4-5e", "ovs_interfaceid": "a6d271b4-5e17-46ed-b704-9b7a84ab1c95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:40:33 user nova-compute[73078]: INFO nova.compute.manager [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 14 18:40:33 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:40:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-01e74d8a-a6dc-42d4-969d-b1575300dbc4 req-f0fecbf3-5808-4fa1-88cb-921516e421dc service nova] Releasing lock "refresh_cache-a4f1ae2d-5927-4931-bddf-5f503c4a94c7" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:40:34 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:40:34 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Took 0.54 seconds to deallocate network for instance.
Aug 14 18:40:35 user nova-compute[73078]: INFO nova.compute.manager [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Took 0.74 seconds to detach 1 volumes for instance.
Aug 14 18:40:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:40:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:40:35 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:40:35 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:40:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.164s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:40:35 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Deleted allocations for instance a4f1ae2d-5927-4931-bddf-5f503c4a94c7
Aug 14 18:40:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-706adc2e-f04c-41fa-8b78-7dee0587a413 tempest-TestVolumeBootPattern-1889877750 tempest-TestVolumeBootPattern-1889877750-project-member] Lock "a4f1ae2d-5927-4931-bddf-5f503c4a94c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.770s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:40:35 user nova-compute[73078]: DEBUG nova.compute.manager [req-6929dd95-fa29-4a36-8bcc-2da1480f0995 req-cf59e14c-64d0-4eb7-98cf-1f90ab869738 service nova] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Received event network-vif-plugged-a6d271b4-5e17-46ed-b704-9b7a84ab1c95 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:40:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6929dd95-fa29-4a36-8bcc-2da1480f0995 req-cf59e14c-64d0-4eb7-98cf-1f90ab869738 service nova] Acquiring lock "a4f1ae2d-5927-4931-bddf-5f503c4a94c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:40:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6929dd95-fa29-4a36-8bcc-2da1480f0995 req-cf59e14c-64d0-4eb7-98cf-1f90ab869738 service nova] Lock "a4f1ae2d-5927-4931-bddf-5f503c4a94c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:40:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6929dd95-fa29-4a36-8bcc-2da1480f0995 req-cf59e14c-64d0-4eb7-98cf-1f90ab869738 service nova] Lock "a4f1ae2d-5927-4931-bddf-5f503c4a94c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:40:35 user nova-compute[73078]: DEBUG nova.compute.manager [req-6929dd95-fa29-4a36-8bcc-2da1480f0995 req-cf59e14c-64d0-4eb7-98cf-1f90ab869738 service nova] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] No waiting events found dispatching network-vif-plugged-a6d271b4-5e17-46ed-b704-9b7a84ab1c95 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:40:35 user nova-compute[73078]: WARNING nova.compute.manager [req-6929dd95-fa29-4a36-8bcc-2da1480f0995 req-cf59e14c-64d0-4eb7-98cf-1f90ab869738 service nova] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Received unexpected event network-vif-plugged-a6d271b4-5e17-46ed-b704-9b7a84ab1c95 for instance with vm_state deleted and task_state None.
Aug 14 18:40:35 user nova-compute[73078]: DEBUG nova.compute.manager [req-6929dd95-fa29-4a36-8bcc-2da1480f0995 req-cf59e14c-64d0-4eb7-98cf-1f90ab869738 service nova] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Received event network-vif-deleted-a6d271b4-5e17-46ed-b704-9b7a84ab1c95 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:40:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:40 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:43 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:48 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692038433.375838, a4f1ae2d-5927-4931-bddf-5f503c4a94c7 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:40:48 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] VM Stopped (Lifecycle Event)
Aug 14 18:40:48 user nova-compute[73078]: DEBUG nova.compute.manager [None req-3ad5e77c-473d-46e4-b7e3-7599638c30c1 None None] [instance: a4f1ae2d-5927-4931-bddf-5f503c4a94c7] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:40:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:40:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:40:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:40:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:40:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:40:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-80a4a195-39b1-4081-ac21-32bf41d5002a tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "61dfe42b-c943-4617-bf8e-745eaf1a1bb8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:40:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-80a4a195-39b1-4081-ac21-32bf41d5002a tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "61dfe42b-c943-4617-bf8e-745eaf1a1bb8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:40:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-80a4a195-39b1-4081-ac21-32bf41d5002a tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "61dfe42b-c943-4617-bf8e-745eaf1a1bb8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:40:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-80a4a195-39b1-4081-ac21-32bf41d5002a tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "61dfe42b-c943-4617-bf8e-745eaf1a1bb8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:40:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-80a4a195-39b1-4081-ac21-32bf41d5002a tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "61dfe42b-c943-4617-bf8e-745eaf1a1bb8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:40:53 user nova-compute[73078]: INFO nova.compute.manager [None req-80a4a195-39b1-4081-ac21-32bf41d5002a tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Terminating instance
Aug 14 18:40:53 user nova-compute[73078]: DEBUG nova.compute.manager [None req-80a4a195-39b1-4081-ac21-32bf41d5002a tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:40:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:54 user nova-compute[73078]: DEBUG nova.compute.manager [req-37c9811c-44cd-4571-9308-6d9e0dcc55ff req-a30d1cf6-1311-44ee-9e97-18a34c6d2afe service nova] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Received event network-vif-unplugged-d801cd85-be91-4f26-9750-c2ce847cb33c {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:40:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-37c9811c-44cd-4571-9308-6d9e0dcc55ff req-a30d1cf6-1311-44ee-9e97-18a34c6d2afe service nova] Acquiring lock "61dfe42b-c943-4617-bf8e-745eaf1a1bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:40:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-37c9811c-44cd-4571-9308-6d9e0dcc55ff req-a30d1cf6-1311-44ee-9e97-18a34c6d2afe service nova] Lock "61dfe42b-c943-4617-bf8e-745eaf1a1bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:40:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-37c9811c-44cd-4571-9308-6d9e0dcc55ff req-a30d1cf6-1311-44ee-9e97-18a34c6d2afe service nova] Lock "61dfe42b-c943-4617-bf8e-745eaf1a1bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:40:54 user nova-compute[73078]: DEBUG nova.compute.manager [req-37c9811c-44cd-4571-9308-6d9e0dcc55ff req-a30d1cf6-1311-44ee-9e97-18a34c6d2afe service nova] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] No waiting events found dispatching network-vif-unplugged-d801cd85-be91-4f26-9750-c2ce847cb33c {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:40:54 user nova-compute[73078]: DEBUG nova.compute.manager [req-37c9811c-44cd-4571-9308-6d9e0dcc55ff req-a30d1cf6-1311-44ee-9e97-18a34c6d2afe service nova] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Received event network-vif-unplugged-d801cd85-be91-4f26-9750-c2ce847cb33c for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:40:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f285e5e9-028b-4776-b30c-ab29d40c244e tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "16a18fae-165b-487b-bfd5-20097eac0a8e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:40:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f285e5e9-028b-4776-b30c-ab29d40c244e tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:40:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f285e5e9-028b-4776-b30c-ab29d40c244e tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:40:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f285e5e9-028b-4776-b30c-ab29d40c244e tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:40:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f285e5e9-028b-4776-b30c-ab29d40c244e tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:40:54 user nova-compute[73078]: INFO nova.compute.manager [None req-f285e5e9-028b-4776-b30c-ab29d40c244e tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Terminating instance
Aug 14 18:40:54 user nova-compute[73078]: DEBUG nova.compute.manager [None req-f285e5e9-028b-4776-b30c-ab29d40c244e tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:40:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:54 user nova-compute[73078]: DEBUG nova.compute.manager [req-bf686a5c-62d6-49e9-97c9-91bd3c0387ea req-8245606a-e002-44c7-bf9b-73b46d364a2f service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Received event network-vif-unplugged-2dd60866-9ed8-4840-a797-893d81ab2b65 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:40:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-bf686a5c-62d6-49e9-97c9-91bd3c0387ea req-8245606a-e002-44c7-bf9b-73b46d364a2f service nova] Acquiring lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:40:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-bf686a5c-62d6-49e9-97c9-91bd3c0387ea req-8245606a-e002-44c7-bf9b-73b46d364a2f service nova] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:40:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-bf686a5c-62d6-49e9-97c9-91bd3c0387ea req-8245606a-e002-44c7-bf9b-73b46d364a2f service nova] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:40:54 user nova-compute[73078]: DEBUG nova.compute.manager [req-bf686a5c-62d6-49e9-97c9-91bd3c0387ea req-8245606a-e002-44c7-bf9b-73b46d364a2f service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] No waiting events found dispatching network-vif-unplugged-2dd60866-9ed8-4840-a797-893d81ab2b65 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:40:54 user nova-compute[73078]: DEBUG nova.compute.manager [req-bf686a5c-62d6-49e9-97c9-91bd3c0387ea req-8245606a-e002-44c7-bf9b-73b46d364a2f service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Received event network-vif-unplugged-2dd60866-9ed8-4840-a797-893d81ab2b65 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:40:55 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Instance destroyed successfully.
Aug 14 18:40:55 user nova-compute[73078]: DEBUG nova.objects.instance [None req-80a4a195-39b1-4081-ac21-32bf41d5002a tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lazy-loading 'resources' on Instance uuid 61dfe42b-c943-4617-bf8e-745eaf1a1bb8 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:40:55 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Instance destroyed successfully.
Aug 14 18:40:55 user nova-compute[73078]: DEBUG nova.objects.instance [None req-f285e5e9-028b-4776-b30c-ab29d40c244e tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lazy-loading 'resources' on Instance uuid 16a18fae-165b-487b-bfd5-20097eac0a8e {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:40:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-80a4a195-39b1-4081-ac21-32bf41d5002a tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:21:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-801712425',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-801712425',id=26,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:21:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16e938ed650845d0a64b49273c9f6287',ramdisk_id='',reservation_id='r-jxwkk62y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1267883434',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:23:14Z,user_data=None,user_id='0bff079d90d942bb8ab3ba53fb007125',uuid=61dfe42b-c943-4617-bf8e-745eaf1a1bb8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d801cd85-be91-4f26-9750-c2ce847cb33c", "address": "fa:16:3e:87:55:89", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd801cd85-be", "ovs_interfaceid": "d801cd85-be91-4f26-9750-c2ce847cb33c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:40:55 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-80a4a195-39b1-4081-ac21-32bf41d5002a tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Converting VIF {"id": "d801cd85-be91-4f26-9750-c2ce847cb33c", "address": "fa:16:3e:87:55:89", "network": {"id": "98a29135-c5de-46a6-a2bf-46c90b4e255b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116695169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e938ed650845d0a64b49273c9f6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd801cd85-be", "ovs_interfaceid": "d801cd85-be91-4f26-9750-c2ce847cb33c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:40:55 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-80a4a195-39b1-4081-ac21-32bf41d5002a tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:55:89,bridge_name='br-int',has_traffic_filtering=True,id=d801cd85-be91-4f26-9750-c2ce847cb33c,network=Network(98a29135-c5de-46a6-a2bf-46c90b4e255b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd801cd85-be') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:40:55 user nova-compute[73078]: DEBUG os_vif [None req-80a4a195-39b1-4081-ac21-32bf41d5002a tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:55:89,bridge_name='br-int',has_traffic_filtering=True,id=d801cd85-be91-4f26-9750-c2ce847cb33c,network=Network(98a29135-c5de-46a6-a2bf-46c90b4e255b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd801cd85-be') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:40:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-f285e5e9-028b-4776-b30c-ab29d40c244e tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:31:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1523618791',display_name='tempest-AttachVolumeTestJSON-server-1523618791',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1523618791',id=41,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGt0IZUR45BoJPTktrLR+OSUIGX16DeSC3GRnxH2CMKh+NvhLefmy7aiMx94bvaYe2eBuYWP6rvvpzTkrEkuFVyTl4uoHzIOYqmCyqn8E4fpKgZ5Lep2EZjGHAoZGcIfQ==',key_name='tempest-keypair-1506094444',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:31:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c717b7be2814591a20db3c81bc5ba89',ramdisk_id='',reservation_id='r-j7btfmht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-120525527',owner_user_name='tempest-AttachVolumeTestJSON-120525527-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:39:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc0adf66a66f4f4fb698706b5d3294cd',uuid=16a18fae-165b-487b-bfd5-20097eac0a8e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2dd60866-9ed8-4840-a797-893d81ab2b65", "address": "fa:16:3e:62:78:e2", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd60866-9e", "ovs_interfaceid": "2dd60866-9ed8-4840-a797-893d81ab2b65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:40:55 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f285e5e9-028b-4776-b30c-ab29d40c244e tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Converting VIF {"id": "2dd60866-9ed8-4840-a797-893d81ab2b65", "address": "fa:16:3e:62:78:e2", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd60866-9e", "ovs_interfaceid": "2dd60866-9ed8-4840-a797-893d81ab2b65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:40:55 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f285e5e9-028b-4776-b30c-ab29d40c244e tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:78:e2,bridge_name='br-int',has_traffic_filtering=True,id=2dd60866-9ed8-4840-a797-893d81ab2b65,network=Network(0e58d249-c00c-45c4-bc46-9d975b128a0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd60866-9e') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:40:55 user nova-compute[73078]: DEBUG os_vif [None req-f285e5e9-028b-4776-b30c-ab29d40c244e tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:78:e2,bridge_name='br-int',has_traffic_filtering=True,id=2dd60866-9ed8-4840-a797-893d81ab2b65,network=Network(0e58d249-c00c-45c4-bc46-9d975b128a0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd60866-9e') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:40:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd801cd85-be, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:40:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:40:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2dd60866-9e, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:40:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:40:55 user nova-compute[73078]: INFO os_vif [None req-80a4a195-39b1-4081-ac21-32bf41d5002a tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:55:89,bridge_name='br-int',has_traffic_filtering=True,id=d801cd85-be91-4f26-9750-c2ce847cb33c,network=Network(98a29135-c5de-46a6-a2bf-46c90b4e255b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd801cd85-be')
Aug 14 18:40:55 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-80a4a195-39b1-4081-ac21-32bf41d5002a tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Deleting instance files /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8_del
Aug 14 18:40:55 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-80a4a195-39b1-4081-ac21-32bf41d5002a tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Deletion of /opt/stack/data/nova/instances/61dfe42b-c943-4617-bf8e-745eaf1a1bb8_del complete
Aug 14 18:40:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:40:55 user nova-compute[73078]: INFO os_vif [None req-f285e5e9-028b-4776-b30c-ab29d40c244e tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:78:e2,bridge_name='br-int',has_traffic_filtering=True,id=2dd60866-9ed8-4840-a797-893d81ab2b65,network=Network(0e58d249-c00c-45c4-bc46-9d975b128a0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd60866-9e')
Aug 14 18:40:55 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-f285e5e9-028b-4776-b30c-ab29d40c244e tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Deleting instance files /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e_del
Aug 14 18:40:55 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-f285e5e9-028b-4776-b30c-ab29d40c244e tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Deletion of /opt/stack/data/nova/instances/16a18fae-165b-487b-bfd5-20097eac0a8e_del complete
Aug 14 18:40:55 user nova-compute[73078]: INFO nova.compute.manager [None req-80a4a195-39b1-4081-ac21-32bf41d5002a tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 14 18:40:55 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-80a4a195-39b1-4081-ac21-32bf41d5002a tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:40:55 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:40:55 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:40:55 user nova-compute[73078]: INFO nova.compute.manager [None req-f285e5e9-028b-4776-b30c-ab29d40c244e tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 14 18:40:55 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-f285e5e9-028b-4776-b30c-ab29d40c244e tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:40:55 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:40:55 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:40:55 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:40:55 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Took 0.61 seconds to deallocate network for instance.
Aug 14 18:40:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-80a4a195-39b1-4081-ac21-32bf41d5002a tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:40:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-80a4a195-39b1-4081-ac21-32bf41d5002a tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:40:55 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-80a4a195-39b1-4081-ac21-32bf41d5002a tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:40:55 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-80a4a195-39b1-4081-ac21-32bf41d5002a tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:40:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-80a4a195-39b1-4081-ac21-32bf41d5002a tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.133s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:40:56 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:40:56 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-80a4a195-39b1-4081-ac21-32bf41d5002a tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Deleted allocations for instance 61dfe42b-c943-4617-bf8e-745eaf1a1bb8
Aug 14 18:40:56 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Took 0.84 seconds to deallocate network for instance.
Aug 14 18:40:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f285e5e9-028b-4776-b30c-ab29d40c244e tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:40:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f285e5e9-028b-4776-b30c-ab29d40c244e tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:40:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-80a4a195-39b1-4081-ac21-32bf41d5002a tempest-ServerBootFromVolumeStableRescueTest-1267883434 tempest-ServerBootFromVolumeStableRescueTest-1267883434-project-member] Lock "61dfe42b-c943-4617-bf8e-745eaf1a1bb8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.116s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:40:56 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-f285e5e9-028b-4776-b30c-ab29d40c244e tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:40:56 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-f285e5e9-028b-4776-b30c-ab29d40c244e tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:40:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f285e5e9-028b-4776-b30c-ab29d40c244e tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.103s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:40:56 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-f285e5e9-028b-4776-b30c-ab29d40c244e tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Deleted allocations for instance 16a18fae-165b-487b-bfd5-20097eac0a8e
Aug 14 18:40:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f285e5e9-028b-4776-b30c-ab29d40c244e tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.011s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:40:56 user nova-compute[73078]: DEBUG nova.compute.manager [req-6e409852-79d6-4ad2-b429-4249e616c71c req-c60e5db9-8ce8-45d2-87ca-cea649a34383 service nova] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Received event network-vif-plugged-d801cd85-be91-4f26-9750-c2ce847cb33c {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:40:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6e409852-79d6-4ad2-b429-4249e616c71c req-c60e5db9-8ce8-45d2-87ca-cea649a34383 service nova] Acquiring lock "61dfe42b-c943-4617-bf8e-745eaf1a1bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:40:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6e409852-79d6-4ad2-b429-4249e616c71c req-c60e5db9-8ce8-45d2-87ca-cea649a34383 service nova] Lock "61dfe42b-c943-4617-bf8e-745eaf1a1bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:40:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6e409852-79d6-4ad2-b429-4249e616c71c req-c60e5db9-8ce8-45d2-87ca-cea649a34383 service nova] Lock "61dfe42b-c943-4617-bf8e-745eaf1a1bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:40:56 user nova-compute[73078]: DEBUG nova.compute.manager [req-6e409852-79d6-4ad2-b429-4249e616c71c req-c60e5db9-8ce8-45d2-87ca-cea649a34383 service nova] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] No waiting events found dispatching network-vif-plugged-d801cd85-be91-4f26-9750-c2ce847cb33c {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:40:56 user nova-compute[73078]: WARNING nova.compute.manager [req-6e409852-79d6-4ad2-b429-4249e616c71c req-c60e5db9-8ce8-45d2-87ca-cea649a34383 service nova] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Received unexpected event network-vif-plugged-d801cd85-be91-4f26-9750-c2ce847cb33c for instance with vm_state deleted and task_state None.
Aug 14 18:40:56 user nova-compute[73078]: DEBUG nova.compute.manager [req-6e409852-79d6-4ad2-b429-4249e616c71c req-c60e5db9-8ce8-45d2-87ca-cea649a34383 service nova] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Received event network-vif-deleted-d801cd85-be91-4f26-9750-c2ce847cb33c {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:40:56 user nova-compute[73078]: DEBUG nova.compute.manager [req-10f3d99b-841b-409e-bc83-b0bae563b952 req-e6c499bd-9400-4258-93cf-ef14d8103837 service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Received event network-vif-plugged-2dd60866-9ed8-4840-a797-893d81ab2b65 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:40:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-10f3d99b-841b-409e-bc83-b0bae563b952 req-e6c499bd-9400-4258-93cf-ef14d8103837 service nova] Acquiring lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:40:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-10f3d99b-841b-409e-bc83-b0bae563b952 req-e6c499bd-9400-4258-93cf-ef14d8103837 service nova] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:40:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-10f3d99b-841b-409e-bc83-b0bae563b952 req-e6c499bd-9400-4258-93cf-ef14d8103837 service nova] Lock "16a18fae-165b-487b-bfd5-20097eac0a8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:40:56 user nova-compute[73078]: DEBUG nova.compute.manager [req-10f3d99b-841b-409e-bc83-b0bae563b952 req-e6c499bd-9400-4258-93cf-ef14d8103837 service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] No waiting events found dispatching network-vif-plugged-2dd60866-9ed8-4840-a797-893d81ab2b65 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:40:56 user nova-compute[73078]: WARNING nova.compute.manager [req-10f3d99b-841b-409e-bc83-b0bae563b952 req-e6c499bd-9400-4258-93cf-ef14d8103837 service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Received unexpected event network-vif-plugged-2dd60866-9ed8-4840-a797-893d81ab2b65 for instance with vm_state deleted and task_state None.
Aug 14 18:40:56 user nova-compute[73078]: DEBUG nova.compute.manager [req-10f3d99b-841b-409e-bc83-b0bae563b952 req-e6c499bd-9400-4258-93cf-ef14d8103837 service nova] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Received event network-vif-deleted-2dd60866-9ed8-4840-a797-893d81ab2b65 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:40:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:41:00 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:41:05 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:41:08 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:41:08 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:41:08 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Didn't find any instances for network info cache update. {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 18:41:09 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:41:10 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692038455.0510104, 61dfe42b-c943-4617-bf8e-745eaf1a1bb8 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:41:10 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] VM Stopped (Lifecycle Event)
Aug 14 18:41:10 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692038455.0599282, 16a18fae-165b-487b-bfd5-20097eac0a8e => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:41:10 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] VM Stopped (Lifecycle Event)
Aug 14 18:41:10 user nova-compute[73078]: DEBUG nova.compute.manager [None req-a6e947a5-f9e1-42f4-b93e-39ec4f6ba058 None None] [instance: 61dfe42b-c943-4617-bf8e-745eaf1a1bb8] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:41:10 user nova-compute[73078]: DEBUG nova.compute.manager [None req-65d9f233-eb35-4811-b1a8-b2bfb6411fbd None None] [instance: 16a18fae-165b-487b-bfd5-20097eac0a8e] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:41:10 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:41:10 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:41:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:41:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:41:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:41:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:41:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:41:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:41:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:41:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:41:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:41:10 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:41:10 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:41:10 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:41:10 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=8780MB free_disk=25.129764556884766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:41:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:41:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:41:10 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:41:10 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:41:10 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:41:10 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:41:10 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:41:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.135s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:41:12 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:41:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:41:14 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:41:15 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:41:15 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:41:16 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:41:17 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:41:20 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:41:20 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:41:25 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:41:30 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:41:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:41:35 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:41:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:41:40 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:41:45 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:41:45 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:41:45 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:41:45 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:41:45 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:41:45 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:41:45 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:41:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:41:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "8958e365-2ffd-45e1-a21b-231ee6dae350" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:41:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "8958e365-2ffd-45e1-a21b-231ee6dae350" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:41:49 user nova-compute[73078]: DEBUG nova.compute.manager [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:41:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:41:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:41:49 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:41:49 user nova-compute[73078]: INFO nova.compute.claims [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Claim successful on node user
Aug 14 18:41:49 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:41:49 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:41:49 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.211s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:41:49 user nova-compute[73078]: DEBUG nova.compute.manager [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:41:49 user nova-compute[73078]: DEBUG nova.compute.manager [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:41:49 user nova-compute[73078]: DEBUG nova.network.neutron [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:41:49 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:41:49 user nova-compute[73078]: DEBUG nova.compute.manager [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:41:50 user nova-compute[73078]: DEBUG nova.compute.manager [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:41:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:41:50 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Creating image(s)
Aug 14 18:41:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "/opt/stack/data/nova/instances/8958e365-2ffd-45e1-a21b-231ee6dae350/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:41:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "/opt/stack/data/nova/instances/8958e365-2ffd-45e1-a21b-231ee6dae350/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:41:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "/opt/stack/data/nova/instances/8958e365-2ffd-45e1-a21b-231ee6dae350/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:41:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:41:50 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:41:50 user nova-compute[73078]: DEBUG nova.policy [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cc0adf66a66f4f4fb698706b5d3294cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c717b7be2814591a20db3c81bc5ba89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:41:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.197s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:41:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:41:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:41:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:41:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.179s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:41:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/8958e365-2ffd-45e1-a21b-231ee6dae350/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:41:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/8958e365-2ffd-45e1-a21b-231ee6dae350/disk 1073741824" returned: 0 in 0.048s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:41:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:41:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:41:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.180s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:41:50 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8958e365-2ffd-45e1-a21b-231ee6dae350/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:41:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8958e365-2ffd-45e1-a21b-231ee6dae350/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:41:50 user nova-compute[73078]: DEBUG nova.network.neutron [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Successfully created port: 85d42c0a-782b-4542-8091-76f2cf960dc2 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:41:50 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8958e365-2ffd-45e1-a21b-231ee6dae350/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:41:50 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Cannot resize image /opt/stack/data/nova/instances/8958e365-2ffd-45e1-a21b-231ee6dae350/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:41:50 user nova-compute[73078]: DEBUG nova.objects.instance [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lazy-loading 'migration_context' on Instance uuid 8958e365-2ffd-45e1-a21b-231ee6dae350 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:41:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:41:50 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Ensure instance console log exists: /opt/stack/data/nova/instances/8958e365-2ffd-45e1-a21b-231ee6dae350/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:41:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:41:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:41:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:41:51 user nova-compute[73078]: DEBUG nova.network.neutron [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Successfully updated port: 85d42c0a-782b-4542-8091-76f2cf960dc2 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:41:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "refresh_cache-8958e365-2ffd-45e1-a21b-231ee6dae350" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:41:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquired lock "refresh_cache-8958e365-2ffd-45e1-a21b-231ee6dae350" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:41:51 user nova-compute[73078]: DEBUG nova.network.neutron [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:41:51 user nova-compute[73078]: DEBUG nova.network.neutron [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:41:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-86f36c3c-bda2-4014-8aa7-6e7d3c978a85 req-19e3b80a-f457-4129-92e3-087a1f527c45 service nova] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Received event network-changed-85d42c0a-782b-4542-8091-76f2cf960dc2 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:41:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-86f36c3c-bda2-4014-8aa7-6e7d3c978a85 req-19e3b80a-f457-4129-92e3-087a1f527c45 service nova] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Refreshing instance network info cache due to event network-changed-85d42c0a-782b-4542-8091-76f2cf960dc2. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:41:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-86f36c3c-bda2-4014-8aa7-6e7d3c978a85 req-19e3b80a-f457-4129-92e3-087a1f527c45 service nova] Acquiring lock "refresh_cache-8958e365-2ffd-45e1-a21b-231ee6dae350" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:41:51 user nova-compute[73078]: DEBUG nova.network.neutron [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Updating instance_info_cache with network_info: [{"id": "85d42c0a-782b-4542-8091-76f2cf960dc2", "address": "fa:16:3e:3a:3e:57", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d42c0a-78", "ovs_interfaceid": "85d42c0a-782b-4542-8091-76f2cf960dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:41:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Releasing lock "refresh_cache-8958e365-2ffd-45e1-a21b-231ee6dae350" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:41:51 user nova-compute[73078]: DEBUG nova.compute.manager [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Instance network_info: |[{"id": "85d42c0a-782b-4542-8091-76f2cf960dc2", "address": "fa:16:3e:3a:3e:57", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d42c0a-78", "ovs_interfaceid": "85d42c0a-782b-4542-8091-76f2cf960dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:41:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-86f36c3c-bda2-4014-8aa7-6e7d3c978a85 req-19e3b80a-f457-4129-92e3-087a1f527c45 service nova] Acquired lock "refresh_cache-8958e365-2ffd-45e1-a21b-231ee6dae350" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:41:51 user nova-compute[73078]: DEBUG nova.network.neutron [req-86f36c3c-bda2-4014-8aa7-6e7d3c978a85 req-19e3b80a-f457-4129-92e3-087a1f527c45 service nova] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Refreshing network info cache for port 85d42c0a-782b-4542-8091-76f2cf960dc2 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:41:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Start _get_guest_xml network_info=[{"id": "85d42c0a-782b-4542-8091-76f2cf960dc2", "address": "fa:16:3e:3a:3e:57", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d42c0a-78", "ovs_interfaceid": "85d42c0a-782b-4542-8091-76f2cf960dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:41:51 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:41:51 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:41:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:41:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:41:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:41:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:41:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:41:52 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:41:52 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:41:52 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:41:52 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:41:52 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:41:52 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:41:52 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:41:52 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:41:52 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:41:52 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:41:52 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:41:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1016340083',display_name='tempest-AttachVolumeTestJSON-server-1016340083',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1016340083',id=48,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLsFOpdpBbLx2Qsowu2Z/CFby/BDiBsWzGztLtMmert039uV6cAW0FjkgON6czmID8WachMTv5nTvE8rDTkJxQiT8eBvlyMaza9kHzfpoDgpSwf0ystcJZcDOhxLcq81Q==',key_name='tempest-keypair-484186757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c717b7be2814591a20db3c81bc5ba89',ramdisk_id='',reservation_id='r-zuuhzlyx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-120525527',owner_user_name='tempest-AttachVolumeTestJSON-120525527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:41:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc0adf66a66f4f4fb698706b5d3294cd',uuid=8958e365-2ffd-45e1-a21b-231ee6dae350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85d42c0a-782b-4542-8091-76f2cf960dc2", "address": "fa:16:3e:3a:3e:57", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d42c0a-78", "ovs_interfaceid": "85d42c0a-782b-4542-8091-76f2cf960dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:41:52 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Converting VIF {"id": "85d42c0a-782b-4542-8091-76f2cf960dc2", "address": "fa:16:3e:3a:3e:57", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d42c0a-78", "ovs_interfaceid": "85d42c0a-782b-4542-8091-76f2cf960dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:41:52 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:3e:57,bridge_name='br-int',has_traffic_filtering=True,id=85d42c0a-782b-4542-8091-76f2cf960dc2,network=Network(0e58d249-c00c-45c4-bc46-9d975b128a0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85d42c0a-78') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:41:52 user nova-compute[73078]: DEBUG nova.objects.instance [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lazy-loading 'pci_devices' on Instance uuid 8958e365-2ffd-45e1-a21b-231ee6dae350 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:41:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:41:52 user nova-compute[73078]:   <uuid>8958e365-2ffd-45e1-a21b-231ee6dae350</uuid>
Aug 14 18:41:52 user nova-compute[73078]:   <name>instance-00000030</name>
Aug 14 18:41:52 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:41:52 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:41:52 user nova-compute[73078]:   <metadata>
Aug 14 18:41:52 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:41:52 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:41:52 user nova-compute[73078]:       <nova:name>tempest-AttachVolumeTestJSON-server-1016340083</nova:name>
Aug 14 18:41:52 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:41:51</nova:creationTime>
Aug 14 18:41:52 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:41:52 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:41:52 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:41:52 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:41:52 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:41:52 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:41:52 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:41:52 user nova-compute[73078]:       <nova:owner>
Aug 14 18:41:52 user nova-compute[73078]:         <nova:user uuid="cc0adf66a66f4f4fb698706b5d3294cd">tempest-AttachVolumeTestJSON-120525527-project-member</nova:user>
Aug 14 18:41:52 user nova-compute[73078]:         <nova:project uuid="8c717b7be2814591a20db3c81bc5ba89">tempest-AttachVolumeTestJSON-120525527</nova:project>
Aug 14 18:41:52 user nova-compute[73078]:       </nova:owner>
Aug 14 18:41:52 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:41:52 user nova-compute[73078]:       <nova:ports>
Aug 14 18:41:52 user nova-compute[73078]:         <nova:port uuid="85d42c0a-782b-4542-8091-76f2cf960dc2">
Aug 14 18:41:52 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 18:41:52 user nova-compute[73078]:         </nova:port>
Aug 14 18:41:52 user nova-compute[73078]:       </nova:ports>
Aug 14 18:41:52 user nova-compute[73078]:     </nova:instance>
Aug 14 18:41:52 user nova-compute[73078]:   </metadata>
Aug 14 18:41:52 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:41:52 user nova-compute[73078]:     <system>
Aug 14 18:41:52 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:41:52 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:41:52 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:41:52 user nova-compute[73078]:       <entry name="serial">8958e365-2ffd-45e1-a21b-231ee6dae350</entry>
Aug 14 18:41:52 user nova-compute[73078]:       <entry name="uuid">8958e365-2ffd-45e1-a21b-231ee6dae350</entry>
Aug 14 18:41:52 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:41:52 user nova-compute[73078]:     </system>
Aug 14 18:41:52 user nova-compute[73078]:   </sysinfo>
Aug 14 18:41:52 user nova-compute[73078]:   <os>
Aug 14 18:41:52 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:41:52 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:41:52 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:41:52 user nova-compute[73078]:   </os>
Aug 14 18:41:52 user nova-compute[73078]:   <features>
Aug 14 18:41:52 user nova-compute[73078]:     <acpi/>
Aug 14 18:41:52 user nova-compute[73078]:     <apic/>
Aug 14 18:41:52 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:41:52 user nova-compute[73078]:   </features>
Aug 14 18:41:52 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:41:52 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:41:52 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:41:52 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:41:52 user nova-compute[73078]:   </clock>
Aug 14 18:41:52 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:41:52 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:41:52 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:41:52 user nova-compute[73078]:   </cpu>
Aug 14 18:41:52 user nova-compute[73078]:   <devices>
Aug 14 18:41:52 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:41:52 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:41:52 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/8958e365-2ffd-45e1-a21b-231ee6dae350/disk"/>
Aug 14 18:41:52 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:41:52 user nova-compute[73078]:     </disk>
Aug 14 18:41:52 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:41:52 user nova-compute[73078]:       <mac address="fa:16:3e:3a:3e:57"/>
Aug 14 18:41:52 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:41:52 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:41:52 user nova-compute[73078]:       <target dev="tap85d42c0a-78"/>
Aug 14 18:41:52 user nova-compute[73078]:     </interface>
Aug 14 18:41:52 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:41:52 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/8958e365-2ffd-45e1-a21b-231ee6dae350/console.log" append="off"/>
Aug 14 18:41:52 user nova-compute[73078]:     </serial>
Aug 14 18:41:52 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:41:52 user nova-compute[73078]:     <video>
Aug 14 18:41:52 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:41:52 user nova-compute[73078]:     </video>
Aug 14 18:41:52 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:41:52 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:41:52 user nova-compute[73078]:     </rng>
Aug 14 18:41:52 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:41:52 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:41:52 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:41:52 user nova-compute[73078]:     </memballoon>
Aug 14 18:41:52 user nova-compute[73078]:   </devices>
Aug 14 18:41:52 user nova-compute[73078]: </domain>
Aug 14 18:41:52 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:41:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1016340083',display_name='tempest-AttachVolumeTestJSON-server-1016340083',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1016340083',id=48,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLsFOpdpBbLx2Qsowu2Z/CFby/BDiBsWzGztLtMmert039uV6cAW0FjkgON6czmID8WachMTv5nTvE8rDTkJxQiT8eBvlyMaza9kHzfpoDgpSwf0ystcJZcDOhxLcq81Q==',key_name='tempest-keypair-484186757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c717b7be2814591a20db3c81bc5ba89',ramdisk_id='',reservation_id='r-zuuhzlyx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-120525527',owner_user_name='tempest-AttachVolumeTestJSON-120525527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:41:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc0adf66a66f4f4fb698706b5d3294cd',uuid=8958e365-2ffd-45e1-a21b-231ee6dae350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85d42c0a-782b-4542-8091-76f2cf960dc2", "address": "fa:16:3e:3a:3e:57", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d42c0a-78", "ovs_interfaceid": "85d42c0a-782b-4542-8091-76f2cf960dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:41:52 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Converting VIF {"id": "85d42c0a-782b-4542-8091-76f2cf960dc2", "address": "fa:16:3e:3a:3e:57", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d42c0a-78", "ovs_interfaceid": "85d42c0a-782b-4542-8091-76f2cf960dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:41:52 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:3e:57,bridge_name='br-int',has_traffic_filtering=True,id=85d42c0a-782b-4542-8091-76f2cf960dc2,network=Network(0e58d249-c00c-45c4-bc46-9d975b128a0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85d42c0a-78') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:41:52 user nova-compute[73078]: DEBUG os_vif [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:3e:57,bridge_name='br-int',has_traffic_filtering=True,id=85d42c0a-782b-4542-8091-76f2cf960dc2,network=Network(0e58d249-c00c-45c4-bc46-9d975b128a0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85d42c0a-78') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:41:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:41:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:41:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:41:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:41:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85d42c0a-78, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:41:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap85d42c0a-78, col_values=(('external_ids', {'iface-id': '85d42c0a-782b-4542-8091-76f2cf960dc2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:3e:57', 'vm-uuid': '8958e365-2ffd-45e1-a21b-231ee6dae350'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:41:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:41:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:41:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:41:52 user nova-compute[73078]: INFO os_vif [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:3e:57,bridge_name='br-int',has_traffic_filtering=True,id=85d42c0a-782b-4542-8091-76f2cf960dc2,network=Network(0e58d249-c00c-45c4-bc46-9d975b128a0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85d42c0a-78')
Aug 14 18:41:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:41:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] No VIF found with MAC fa:16:3e:3a:3e:57, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:41:52 user nova-compute[73078]: DEBUG nova.network.neutron [req-86f36c3c-bda2-4014-8aa7-6e7d3c978a85 req-19e3b80a-f457-4129-92e3-087a1f527c45 service nova] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Updated VIF entry in instance network info cache for port 85d42c0a-782b-4542-8091-76f2cf960dc2. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:41:52 user nova-compute[73078]: DEBUG nova.network.neutron [req-86f36c3c-bda2-4014-8aa7-6e7d3c978a85 req-19e3b80a-f457-4129-92e3-087a1f527c45 service nova] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Updating instance_info_cache with network_info: [{"id": "85d42c0a-782b-4542-8091-76f2cf960dc2", "address": "fa:16:3e:3a:3e:57", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d42c0a-78", "ovs_interfaceid": "85d42c0a-782b-4542-8091-76f2cf960dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:41:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-86f36c3c-bda2-4014-8aa7-6e7d3c978a85 req-19e3b80a-f457-4129-92e3-087a1f527c45 service nova] Releasing lock "refresh_cache-8958e365-2ffd-45e1-a21b-231ee6dae350" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:41:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:41:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:41:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:41:53 user nova-compute[73078]: DEBUG nova.compute.manager [req-880bf06b-d403-47e7-bb88-96b67c25644f req-d31396fb-7875-43b2-bed2-74d97bd5f368 service nova] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Received event network-vif-plugged-85d42c0a-782b-4542-8091-76f2cf960dc2 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:41:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-880bf06b-d403-47e7-bb88-96b67c25644f req-d31396fb-7875-43b2-bed2-74d97bd5f368 service nova] Acquiring lock "8958e365-2ffd-45e1-a21b-231ee6dae350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:41:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-880bf06b-d403-47e7-bb88-96b67c25644f req-d31396fb-7875-43b2-bed2-74d97bd5f368 service nova] Lock "8958e365-2ffd-45e1-a21b-231ee6dae350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:41:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-880bf06b-d403-47e7-bb88-96b67c25644f req-d31396fb-7875-43b2-bed2-74d97bd5f368 service nova] Lock "8958e365-2ffd-45e1-a21b-231ee6dae350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:41:53 user nova-compute[73078]: DEBUG nova.compute.manager [req-880bf06b-d403-47e7-bb88-96b67c25644f req-d31396fb-7875-43b2-bed2-74d97bd5f368 service nova] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] No waiting events found dispatching network-vif-plugged-85d42c0a-782b-4542-8091-76f2cf960dc2 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:41:53 user nova-compute[73078]: WARNING nova.compute.manager [req-880bf06b-d403-47e7-bb88-96b67c25644f req-d31396fb-7875-43b2-bed2-74d97bd5f368 service nova] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Received unexpected event network-vif-plugged-85d42c0a-782b-4542-8091-76f2cf960dc2 for instance with vm_state building and task_state spawning.
Aug 14 18:41:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:41:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:41:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:41:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:41:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:41:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:41:55 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692038515.5905414, 8958e365-2ffd-45e1-a21b-231ee6dae350 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:41:55 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] VM Resumed (Lifecycle Event)
Aug 14 18:41:55 user nova-compute[73078]: DEBUG nova.compute.manager [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:41:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:41:55 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Instance spawned successfully.
Aug 14 18:41:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:41:55 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:41:55 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:41:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:41:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:41:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:41:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:41:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:41:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:41:55 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:41:55 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692038515.59828, 8958e365-2ffd-45e1-a21b-231ee6dae350 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:41:55 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] VM Started (Lifecycle Event)
Aug 14 18:41:55 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:41:55 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:41:55 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:41:55 user nova-compute[73078]: INFO nova.compute.manager [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Took 5.65 seconds to spawn the instance on the hypervisor.
Aug 14 18:41:55 user nova-compute[73078]: DEBUG nova.compute.manager [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:41:55 user nova-compute[73078]: DEBUG nova.compute.manager [req-bc0e1966-5934-4bbd-9c6b-fbdee97830e2 req-d1336f32-e623-4325-9ccf-6a55c1424970 service nova] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Received event network-vif-plugged-85d42c0a-782b-4542-8091-76f2cf960dc2 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:41:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-bc0e1966-5934-4bbd-9c6b-fbdee97830e2 req-d1336f32-e623-4325-9ccf-6a55c1424970 service nova] Acquiring lock "8958e365-2ffd-45e1-a21b-231ee6dae350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:41:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-bc0e1966-5934-4bbd-9c6b-fbdee97830e2 req-d1336f32-e623-4325-9ccf-6a55c1424970 service nova] Lock "8958e365-2ffd-45e1-a21b-231ee6dae350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:41:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-bc0e1966-5934-4bbd-9c6b-fbdee97830e2 req-d1336f32-e623-4325-9ccf-6a55c1424970 service nova] Lock "8958e365-2ffd-45e1-a21b-231ee6dae350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:41:55 user nova-compute[73078]: DEBUG nova.compute.manager [req-bc0e1966-5934-4bbd-9c6b-fbdee97830e2 req-d1336f32-e623-4325-9ccf-6a55c1424970 service nova] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] No waiting events found dispatching network-vif-plugged-85d42c0a-782b-4542-8091-76f2cf960dc2 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:41:55 user nova-compute[73078]: WARNING nova.compute.manager [req-bc0e1966-5934-4bbd-9c6b-fbdee97830e2 req-d1336f32-e623-4325-9ccf-6a55c1424970 service nova] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Received unexpected event network-vif-plugged-85d42c0a-782b-4542-8091-76f2cf960dc2 for instance with vm_state building and task_state spawning.
Aug 14 18:41:55 user nova-compute[73078]: INFO nova.compute.manager [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Took 6.35 seconds to build instance.
Aug 14 18:41:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-5a1dd547-29bb-4813-ac5a-7fd07a6d22bf tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "8958e365-2ffd-45e1-a21b-231ee6dae350" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.461s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:41:57 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:41:57 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:41:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:41:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Acquiring lock "385ba618-9b83-495b-a4cc-0bf97a42a5bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:41:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lock "385ba618-9b83-495b-a4cc-0bf97a42a5bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:41:59 user nova-compute[73078]: DEBUG nova.compute.manager [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:41:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:41:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:41:59 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:41:59 user nova-compute[73078]: INFO nova.compute.claims [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Claim successful on node user
Aug 14 18:41:59 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:41:59 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:41:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.298s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:41:59 user nova-compute[73078]: DEBUG nova.compute.manager [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:41:59 user nova-compute[73078]: DEBUG nova.compute.manager [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:41:59 user nova-compute[73078]: DEBUG nova.network.neutron [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:41:59 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:41:59 user nova-compute[73078]: DEBUG nova.compute.manager [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:41:59 user nova-compute[73078]: DEBUG nova.policy [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1a94313076234222b07cbcb8ed97fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59c99ecbb5c4bfa8444a2fbe224f345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:41:59 user nova-compute[73078]: DEBUG nova.compute.manager [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:41:59 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:41:59 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Creating image(s)
Aug 14 18:41:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Acquiring lock "/opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:41:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lock "/opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:41:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lock "/opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:41:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:42:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.202s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:42:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:42:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:42:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:42:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.190s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:42:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:42:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk 1073741824" returned: 0 in 0.055s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:42:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:42:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:42:00 user nova-compute[73078]: DEBUG nova.network.neutron [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Successfully created port: ff742757-23c2-49c2-a57c-535307cbbb36 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:42:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.188s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:42:00 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Checking if we can resize image /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:42:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:42:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:42:00 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Cannot resize image /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:42:00 user nova-compute[73078]: DEBUG nova.objects.instance [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lazy-loading 'migration_context' on Instance uuid 385ba618-9b83-495b-a4cc-0bf97a42a5bd {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:42:00 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:42:00 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Ensure instance console log exists: /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:42:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:42:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:42:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG nova.network.neutron [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Successfully updated port: ff742757-23c2-49c2-a57c-535307cbbb36 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Acquiring lock "refresh_cache-385ba618-9b83-495b-a4cc-0bf97a42a5bd" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Acquired lock "refresh_cache-385ba618-9b83-495b-a4cc-0bf97a42a5bd" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG nova.network.neutron [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG nova.compute.manager [req-ab8b181b-076c-4da8-8714-47475e3065ac req-e02627cb-2bee-4513-8c97-77d09e4cb848 service nova] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Received event network-changed-ff742757-23c2-49c2-a57c-535307cbbb36 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG nova.compute.manager [req-ab8b181b-076c-4da8-8714-47475e3065ac req-e02627cb-2bee-4513-8c97-77d09e4cb848 service nova] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Refreshing instance network info cache due to event network-changed-ff742757-23c2-49c2-a57c-535307cbbb36. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ab8b181b-076c-4da8-8714-47475e3065ac req-e02627cb-2bee-4513-8c97-77d09e4cb848 service nova] Acquiring lock "refresh_cache-385ba618-9b83-495b-a4cc-0bf97a42a5bd" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG nova.network.neutron [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG nova.network.neutron [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Updating instance_info_cache with network_info: [{"id": "ff742757-23c2-49c2-a57c-535307cbbb36", "address": "fa:16:3e:1c:1a:4f", "network": {"id": "226b01bc-2d08-43f8-9ba8-2545b12952e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-821526969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f59c99ecbb5c4bfa8444a2fbe224f345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff742757-23", "ovs_interfaceid": "ff742757-23c2-49c2-a57c-535307cbbb36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Releasing lock "refresh_cache-385ba618-9b83-495b-a4cc-0bf97a42a5bd" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG nova.compute.manager [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Instance network_info: |[{"id": "ff742757-23c2-49c2-a57c-535307cbbb36", "address": "fa:16:3e:1c:1a:4f", "network": {"id": "226b01bc-2d08-43f8-9ba8-2545b12952e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-821526969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f59c99ecbb5c4bfa8444a2fbe224f345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff742757-23", "ovs_interfaceid": "ff742757-23c2-49c2-a57c-535307cbbb36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ab8b181b-076c-4da8-8714-47475e3065ac req-e02627cb-2bee-4513-8c97-77d09e4cb848 service nova] Acquired lock "refresh_cache-385ba618-9b83-495b-a4cc-0bf97a42a5bd" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG nova.network.neutron [req-ab8b181b-076c-4da8-8714-47475e3065ac req-e02627cb-2bee-4513-8c97-77d09e4cb848 service nova] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Refreshing network info cache for port ff742757-23c2-49c2-a57c-535307cbbb36 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Start _get_guest_xml network_info=[{"id": "ff742757-23c2-49c2-a57c-535307cbbb36", "address": "fa:16:3e:1c:1a:4f", "network": {"id": "226b01bc-2d08-43f8-9ba8-2545b12952e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-821526969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f59c99ecbb5c4bfa8444a2fbe224f345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff742757-23", "ovs_interfaceid": "ff742757-23c2-49c2-a57c-535307cbbb36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:42:01 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:42:01 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:42:01 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:41:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1955229464',display_name='tempest-ServersNegativeTestJSON-server-1955229464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1955229464',id=49,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f59c99ecbb5c4bfa8444a2fbe224f345',ramdisk_id='',reservation_id='r-n5e62qsn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1030825811',owner_user_name='tempest-ServersNegativeTestJSON-1030825811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:42:00Z,user_data=None,user_id='1a94313076234222b07cbcb8ed97fc30',uuid=385ba618-9b83-495b-a4cc-0bf97a42a5bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff742757-23c2-49c2-a57c-535307cbbb36", "address": "fa:16:3e:1c:1a:4f", "network": {"id": "226b01bc-2d08-43f8-9ba8-2545b12952e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-821526969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f59c99ecbb5c4bfa8444a2fbe224f345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff742757-23", "ovs_interfaceid": "ff742757-23c2-49c2-a57c-535307cbbb36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Converting VIF {"id": "ff742757-23c2-49c2-a57c-535307cbbb36", "address": "fa:16:3e:1c:1a:4f", "network": {"id": "226b01bc-2d08-43f8-9ba8-2545b12952e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-821526969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f59c99ecbb5c4bfa8444a2fbe224f345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff742757-23", "ovs_interfaceid": "ff742757-23c2-49c2-a57c-535307cbbb36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:1a:4f,bridge_name='br-int',has_traffic_filtering=True,id=ff742757-23c2-49c2-a57c-535307cbbb36,network=Network(226b01bc-2d08-43f8-9ba8-2545b12952e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff742757-23') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG nova.objects.instance [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lazy-loading 'pci_devices' on Instance uuid 385ba618-9b83-495b-a4cc-0bf97a42a5bd {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:42:01 user nova-compute[73078]:   <uuid>385ba618-9b83-495b-a4cc-0bf97a42a5bd</uuid>
Aug 14 18:42:01 user nova-compute[73078]:   <name>instance-00000031</name>
Aug 14 18:42:01 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:42:01 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:42:01 user nova-compute[73078]:   <metadata>
Aug 14 18:42:01 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:42:01 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:42:01 user nova-compute[73078]:       <nova:name>tempest-ServersNegativeTestJSON-server-1955229464</nova:name>
Aug 14 18:42:01 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:42:01</nova:creationTime>
Aug 14 18:42:01 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:42:01 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:42:01 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:42:01 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:42:01 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:42:01 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:42:01 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:42:01 user nova-compute[73078]:       <nova:owner>
Aug 14 18:42:01 user nova-compute[73078]:         <nova:user uuid="1a94313076234222b07cbcb8ed97fc30">tempest-ServersNegativeTestJSON-1030825811-project-member</nova:user>
Aug 14 18:42:01 user nova-compute[73078]:         <nova:project uuid="f59c99ecbb5c4bfa8444a2fbe224f345">tempest-ServersNegativeTestJSON-1030825811</nova:project>
Aug 14 18:42:01 user nova-compute[73078]:       </nova:owner>
Aug 14 18:42:01 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:42:01 user nova-compute[73078]:       <nova:ports>
Aug 14 18:42:01 user nova-compute[73078]:         <nova:port uuid="ff742757-23c2-49c2-a57c-535307cbbb36">
Aug 14 18:42:01 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 18:42:01 user nova-compute[73078]:         </nova:port>
Aug 14 18:42:01 user nova-compute[73078]:       </nova:ports>
Aug 14 18:42:01 user nova-compute[73078]:     </nova:instance>
Aug 14 18:42:01 user nova-compute[73078]:   </metadata>
Aug 14 18:42:01 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:42:01 user nova-compute[73078]:     <system>
Aug 14 18:42:01 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:42:01 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:42:01 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:42:01 user nova-compute[73078]:       <entry name="serial">385ba618-9b83-495b-a4cc-0bf97a42a5bd</entry>
Aug 14 18:42:01 user nova-compute[73078]:       <entry name="uuid">385ba618-9b83-495b-a4cc-0bf97a42a5bd</entry>
Aug 14 18:42:01 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:42:01 user nova-compute[73078]:     </system>
Aug 14 18:42:01 user nova-compute[73078]:   </sysinfo>
Aug 14 18:42:01 user nova-compute[73078]:   <os>
Aug 14 18:42:01 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:42:01 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:42:01 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:42:01 user nova-compute[73078]:   </os>
Aug 14 18:42:01 user nova-compute[73078]:   <features>
Aug 14 18:42:01 user nova-compute[73078]:     <acpi/>
Aug 14 18:42:01 user nova-compute[73078]:     <apic/>
Aug 14 18:42:01 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:42:01 user nova-compute[73078]:   </features>
Aug 14 18:42:01 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:42:01 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:42:01 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:42:01 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:42:01 user nova-compute[73078]:   </clock>
Aug 14 18:42:01 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:42:01 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:42:01 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:42:01 user nova-compute[73078]:   </cpu>
Aug 14 18:42:01 user nova-compute[73078]:   <devices>
Aug 14 18:42:01 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:42:01 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:42:01 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk"/>
Aug 14 18:42:01 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:42:01 user nova-compute[73078]:     </disk>
Aug 14 18:42:01 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:42:01 user nova-compute[73078]:       <mac address="fa:16:3e:1c:1a:4f"/>
Aug 14 18:42:01 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:42:01 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:42:01 user nova-compute[73078]:       <target dev="tapff742757-23"/>
Aug 14 18:42:01 user nova-compute[73078]:     </interface>
Aug 14 18:42:01 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:42:01 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/console.log" append="off"/>
Aug 14 18:42:01 user nova-compute[73078]:     </serial>
Aug 14 18:42:01 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:42:01 user nova-compute[73078]:     <video>
Aug 14 18:42:01 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:42:01 user nova-compute[73078]:     </video>
Aug 14 18:42:01 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:42:01 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:42:01 user nova-compute[73078]:     </rng>
Aug 14 18:42:01 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:42:01 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:42:01 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:42:01 user nova-compute[73078]:     </memballoon>
Aug 14 18:42:01 user nova-compute[73078]:   </devices>
Aug 14 18:42:01 user nova-compute[73078]: </domain>
Aug 14 18:42:01 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:41:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1955229464',display_name='tempest-ServersNegativeTestJSON-server-1955229464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1955229464',id=49,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f59c99ecbb5c4bfa8444a2fbe224f345',ramdisk_id='',reservation_id='r-n5e62qsn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1030825811',owner_user_name='tempest-ServersNegativeTestJSON-1030825811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:42:00Z,user_data=None,user_id='1a94313076234222b07cbcb8ed97fc30',uuid=385ba618-9b83-495b-a4cc-0bf97a42a5bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff742757-23c2-49c2-a57c-535307cbbb36", "address": "fa:16:3e:1c:1a:4f", "network": {"id": "226b01bc-2d08-43f8-9ba8-2545b12952e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-821526969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f59c99ecbb5c4bfa8444a2fbe224f345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff742757-23", "ovs_interfaceid": "ff742757-23c2-49c2-a57c-535307cbbb36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Converting VIF {"id": "ff742757-23c2-49c2-a57c-535307cbbb36", "address": "fa:16:3e:1c:1a:4f", "network": {"id": "226b01bc-2d08-43f8-9ba8-2545b12952e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-821526969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f59c99ecbb5c4bfa8444a2fbe224f345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff742757-23", "ovs_interfaceid": "ff742757-23c2-49c2-a57c-535307cbbb36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:1a:4f,bridge_name='br-int',has_traffic_filtering=True,id=ff742757-23c2-49c2-a57c-535307cbbb36,network=Network(226b01bc-2d08-43f8-9ba8-2545b12952e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff742757-23') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG os_vif [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:1a:4f,bridge_name='br-int',has_traffic_filtering=True,id=ff742757-23c2-49c2-a57c-535307cbbb36,network=Network(226b01bc-2d08-43f8-9ba8-2545b12952e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff742757-23') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff742757-23, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapff742757-23, col_values=(('external_ids', {'iface-id': 'ff742757-23c2-49c2-a57c-535307cbbb36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:1a:4f', 'vm-uuid': '385ba618-9b83-495b-a4cc-0bf97a42a5bd'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:42:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:42:01 user nova-compute[73078]: INFO os_vif [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:1a:4f,bridge_name='br-int',has_traffic_filtering=True,id=ff742757-23c2-49c2-a57c-535307cbbb36,network=Network(226b01bc-2d08-43f8-9ba8-2545b12952e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff742757-23')
Aug 14 18:42:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:42:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] No VIF found with MAC fa:16:3e:1c:1a:4f, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:42:02 user nova-compute[73078]: DEBUG nova.network.neutron [req-ab8b181b-076c-4da8-8714-47475e3065ac req-e02627cb-2bee-4513-8c97-77d09e4cb848 service nova] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Updated VIF entry in instance network info cache for port ff742757-23c2-49c2-a57c-535307cbbb36. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:42:02 user nova-compute[73078]: DEBUG nova.network.neutron [req-ab8b181b-076c-4da8-8714-47475e3065ac req-e02627cb-2bee-4513-8c97-77d09e4cb848 service nova] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Updating instance_info_cache with network_info: [{"id": "ff742757-23c2-49c2-a57c-535307cbbb36", "address": "fa:16:3e:1c:1a:4f", "network": {"id": "226b01bc-2d08-43f8-9ba8-2545b12952e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-821526969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f59c99ecbb5c4bfa8444a2fbe224f345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff742757-23", "ovs_interfaceid": "ff742757-23c2-49c2-a57c-535307cbbb36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:42:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-ab8b181b-076c-4da8-8714-47475e3065ac req-e02627cb-2bee-4513-8c97-77d09e4cb848 service nova] Releasing lock "refresh_cache-385ba618-9b83-495b-a4cc-0bf97a42a5bd" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:42:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:42:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:42:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:42:03 user nova-compute[73078]: DEBUG nova.compute.manager [req-b82fa7b8-5cea-49c1-b29b-87fcccd4c6b6 req-4836ed0c-e15c-4e77-9b67-4e945ffa61a0 service nova] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Received event network-vif-plugged-ff742757-23c2-49c2-a57c-535307cbbb36 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:42:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b82fa7b8-5cea-49c1-b29b-87fcccd4c6b6 req-4836ed0c-e15c-4e77-9b67-4e945ffa61a0 service nova] Acquiring lock "385ba618-9b83-495b-a4cc-0bf97a42a5bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:42:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b82fa7b8-5cea-49c1-b29b-87fcccd4c6b6 req-4836ed0c-e15c-4e77-9b67-4e945ffa61a0 service nova] Lock "385ba618-9b83-495b-a4cc-0bf97a42a5bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:42:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b82fa7b8-5cea-49c1-b29b-87fcccd4c6b6 req-4836ed0c-e15c-4e77-9b67-4e945ffa61a0 service nova] Lock "385ba618-9b83-495b-a4cc-0bf97a42a5bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:42:03 user nova-compute[73078]: DEBUG nova.compute.manager [req-b82fa7b8-5cea-49c1-b29b-87fcccd4c6b6 req-4836ed0c-e15c-4e77-9b67-4e945ffa61a0 service nova] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] No waiting events found dispatching network-vif-plugged-ff742757-23c2-49c2-a57c-535307cbbb36 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:42:03 user nova-compute[73078]: WARNING nova.compute.manager [req-b82fa7b8-5cea-49c1-b29b-87fcccd4c6b6 req-4836ed0c-e15c-4e77-9b67-4e945ffa61a0 service nova] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Received unexpected event network-vif-plugged-ff742757-23c2-49c2-a57c-535307cbbb36 for instance with vm_state building and task_state spawning.
Aug 14 18:42:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:42:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:42:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:42:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:42:05 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692038525.613284, 385ba618-9b83-495b-a4cc-0bf97a42a5bd => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:42:05 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] VM Resumed (Lifecycle Event)
Aug 14 18:42:05 user nova-compute[73078]: DEBUG nova.compute.manager [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:42:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:42:05 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Instance spawned successfully.
Aug 14 18:42:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:42:05 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:42:05 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:42:05 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:42:05 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692038525.6199362, 385ba618-9b83-495b-a4cc-0bf97a42a5bd => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:42:05 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] VM Started (Lifecycle Event)
Aug 14 18:42:05 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:42:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:42:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:42:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:42:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:42:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:42:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:42:05 user nova-compute[73078]: DEBUG nova.compute.manager [req-824a5c9e-a1aa-4ad7-9ffc-fe6debe897cd req-8bc1be32-c34c-4a17-a988-7b29427ef611 service nova] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Received event network-vif-plugged-ff742757-23c2-49c2-a57c-535307cbbb36 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:42:05 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-824a5c9e-a1aa-4ad7-9ffc-fe6debe897cd req-8bc1be32-c34c-4a17-a988-7b29427ef611 service nova] Acquiring lock "385ba618-9b83-495b-a4cc-0bf97a42a5bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:42:05 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-824a5c9e-a1aa-4ad7-9ffc-fe6debe897cd req-8bc1be32-c34c-4a17-a988-7b29427ef611 service nova] Lock "385ba618-9b83-495b-a4cc-0bf97a42a5bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:42:05 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-824a5c9e-a1aa-4ad7-9ffc-fe6debe897cd req-8bc1be32-c34c-4a17-a988-7b29427ef611 service nova] Lock "385ba618-9b83-495b-a4cc-0bf97a42a5bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:42:05 user nova-compute[73078]: DEBUG nova.compute.manager [req-824a5c9e-a1aa-4ad7-9ffc-fe6debe897cd req-8bc1be32-c34c-4a17-a988-7b29427ef611 service nova] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] No waiting events found dispatching network-vif-plugged-ff742757-23c2-49c2-a57c-535307cbbb36 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:42:05 user nova-compute[73078]: WARNING nova.compute.manager [req-824a5c9e-a1aa-4ad7-9ffc-fe6debe897cd req-8bc1be32-c34c-4a17-a988-7b29427ef611 service nova] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Received unexpected event network-vif-plugged-ff742757-23c2-49c2-a57c-535307cbbb36 for instance with vm_state building and task_state spawning.
Aug 14 18:42:05 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:42:05 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:42:05 user nova-compute[73078]: INFO nova.compute.manager [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Took 5.96 seconds to spawn the instance on the hypervisor.
Aug 14 18:42:05 user nova-compute[73078]: DEBUG nova.compute.manager [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:42:05 user nova-compute[73078]: INFO nova.compute.manager [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Took 6.62 seconds to build instance.
Aug 14 18:42:05 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-df611045-4d50-437f-9ba2-a47db1a2f041 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lock "385ba618-9b83-495b-a4cc-0bf97a42a5bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.719s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:42:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:42:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:42:09 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:42:09 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:42:09 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Rebuilding the list of instances to heal {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 18:42:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-8958e365-2ffd-45e1-a21b-231ee6dae350" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:42:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-8958e365-2ffd-45e1-a21b-231ee6dae350" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:42:09 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:42:09 user nova-compute[73078]: DEBUG nova.objects.instance [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lazy-loading 'info_cache' on Instance uuid 8958e365-2ffd-45e1-a21b-231ee6dae350 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:42:09 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Updating instance_info_cache with network_info: [{"id": "85d42c0a-782b-4542-8091-76f2cf960dc2", "address": "fa:16:3e:3a:3e:57", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d42c0a-78", "ovs_interfaceid": "85d42c0a-782b-4542-8091-76f2cf960dc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:42:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-8958e365-2ffd-45e1-a21b-231ee6dae350" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:42:09 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:42:09 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:42:10 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:42:11 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:42:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:42:12 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:42:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:42:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:42:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:42:12 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:42:12 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8958e365-2ffd-45e1-a21b-231ee6dae350/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:42:12 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8958e365-2ffd-45e1-a21b-231ee6dae350/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:42:12 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8958e365-2ffd-45e1-a21b-231ee6dae350/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:42:12 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8958e365-2ffd-45e1-a21b-231ee6dae350/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:42:12 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:42:12 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:42:12 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:42:12 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:42:13 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:42:13 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:42:13 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=8478MB free_disk=25.08987045288086GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:42:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:42:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:42:13 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 8958e365-2ffd-45e1-a21b-231ee6dae350 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:42:13 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 385ba618-9b83-495b-a4cc-0bf97a42a5bd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:42:13 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:42:13 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:42:13 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Refreshing inventories for resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 18:42:13 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Updating ProviderTree inventory for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 18:42:13 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Updating inventory in ProviderTree for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 18:42:13 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Refreshing aggregate associations for resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b, aggregates: None {{(pid=73078) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 18:42:13 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Refreshing trait associations for resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV {{(pid=73078) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 18:42:13 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:42:13 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:42:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:42:13 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:42:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.446s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:42:14 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:42:14 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:42:14 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:42:16 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:42:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:42:17 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:42:18 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:42:18 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Cleaning up deleted instances {{(pid=73078) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 18:42:18 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] There are 0 instances to clean {{(pid=73078) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 18:42:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:42:19 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:42:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:42:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:42:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:42:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:42:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:42:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:42:34 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:42:34 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73078) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 18:42:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:42:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:42:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:42:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:42:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:42:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:42:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:43:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:43:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:43:10 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:43:11 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:43:11 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:43:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-385ba618-9b83-495b-a4cc-0bf97a42a5bd" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:43:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-385ba618-9b83-495b-a4cc-0bf97a42a5bd" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:43:11 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:43:11 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Updating instance_info_cache with network_info: [{"id": "ff742757-23c2-49c2-a57c-535307cbbb36", "address": "fa:16:3e:1c:1a:4f", "network": {"id": "226b01bc-2d08-43f8-9ba8-2545b12952e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-821526969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f59c99ecbb5c4bfa8444a2fbe224f345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff742757-23", "ovs_interfaceid": "ff742757-23c2-49c2-a57c-535307cbbb36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:43:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-385ba618-9b83-495b-a4cc-0bf97a42a5bd" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:43:11 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:43:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:43:13 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:43:13 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:43:13 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:43:14 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:43:14 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:43:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:43:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:43:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:43:14 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:43:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8958e365-2ffd-45e1-a21b-231ee6dae350/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:43:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8958e365-2ffd-45e1-a21b-231ee6dae350/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:43:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8958e365-2ffd-45e1-a21b-231ee6dae350/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:43:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8958e365-2ffd-45e1-a21b-231ee6dae350/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:43:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:43:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:43:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:43:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:43:15 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:43:15 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:43:15 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=8640MB free_disk=25.0592041015625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:43:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:43:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:43:15 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 8958e365-2ffd-45e1-a21b-231ee6dae350 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:43:15 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 385ba618-9b83-495b-a4cc-0bf97a42a5bd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:43:15 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:43:15 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:43:15 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:43:15 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:43:15 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:43:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.206s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:43:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:43:17 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:43:18 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:43:19 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:43:21 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:43:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:43:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:43:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:43:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:43:40 user nova-compute[73078]: DEBUG nova.compute.manager [req-e35d2b21-c4fa-4edd-a1ba-07c82f7828c8 req-c774f947-fc5a-4346-a5d9-34ad276e8562 service nova] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Received event network-changed-85d42c0a-782b-4542-8091-76f2cf960dc2 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:43:40 user nova-compute[73078]: DEBUG nova.compute.manager [req-e35d2b21-c4fa-4edd-a1ba-07c82f7828c8 req-c774f947-fc5a-4346-a5d9-34ad276e8562 service nova] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Refreshing instance network info cache due to event network-changed-85d42c0a-782b-4542-8091-76f2cf960dc2. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:43:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e35d2b21-c4fa-4edd-a1ba-07c82f7828c8 req-c774f947-fc5a-4346-a5d9-34ad276e8562 service nova] Acquiring lock "refresh_cache-8958e365-2ffd-45e1-a21b-231ee6dae350" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:43:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e35d2b21-c4fa-4edd-a1ba-07c82f7828c8 req-c774f947-fc5a-4346-a5d9-34ad276e8562 service nova] Acquired lock "refresh_cache-8958e365-2ffd-45e1-a21b-231ee6dae350" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:43:40 user nova-compute[73078]: DEBUG nova.network.neutron [req-e35d2b21-c4fa-4edd-a1ba-07c82f7828c8 req-c774f947-fc5a-4346-a5d9-34ad276e8562 service nova] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Refreshing network info cache for port 85d42c0a-782b-4542-8091-76f2cf960dc2 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:43:41 user nova-compute[73078]: DEBUG nova.network.neutron [req-e35d2b21-c4fa-4edd-a1ba-07c82f7828c8 req-c774f947-fc5a-4346-a5d9-34ad276e8562 service nova] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Updated VIF entry in instance network info cache for port 85d42c0a-782b-4542-8091-76f2cf960dc2. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:43:41 user nova-compute[73078]: DEBUG nova.network.neutron [req-e35d2b21-c4fa-4edd-a1ba-07c82f7828c8 req-c774f947-fc5a-4346-a5d9-34ad276e8562 service nova] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Updating instance_info_cache with network_info: [{"id": "85d42c0a-782b-4542-8091-76f2cf960dc2", "address": "fa:16:3e:3a:3e:57", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d42c0a-78", "ovs_interfaceid": "85d42c0a-782b-4542-8091-76f2cf960dc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:43:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e35d2b21-c4fa-4edd-a1ba-07c82f7828c8 req-c774f947-fc5a-4346-a5d9-34ad276e8562 service nova] Releasing lock "refresh_cache-8958e365-2ffd-45e1-a21b-231ee6dae350" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:43:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:43:43 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:43:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "8958e365-2ffd-45e1-a21b-231ee6dae350" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:43:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "8958e365-2ffd-45e1-a21b-231ee6dae350" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:43:45 user nova-compute[73078]: DEBUG nova.objects.instance [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lazy-loading 'flavor' on Instance uuid 8958e365-2ffd-45e1-a21b-231ee6dae350 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:43:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "8958e365-2ffd-45e1-a21b-231ee6dae350" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:43:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "8958e365-2ffd-45e1-a21b-231ee6dae350" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:43:45 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "8958e365-2ffd-45e1-a21b-231ee6dae350" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:43:45 user nova-compute[73078]: INFO nova.compute.manager [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Attaching volume b8effc0c-412e-4021-92d9-5f4b5f2f4b88 to /dev/vdb
Aug 14 18:43:45 user nova-compute[73078]: DEBUG os_brick.utils [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:43:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:43:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:43:45 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffe5172-f541-49ad-95b8-ef82d822f1ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:43:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:43:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:43:45 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[82498716-16ed-4b43-86a2-1c38b95b2ddb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:43:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:43:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:43:45 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[89468c7e-74f7-47c7-a1b6-bbb45fe30073]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:43:45 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a60d8b-5979-4052-b4cf-ff1937c95737]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:43:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:43:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:43:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:43:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:43:45 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:43:45 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:43:45 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b164118-faab-4f25-85cf-b3fc198028f0]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:43:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:43:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:43:45 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:43:45 user nova-compute[73078]: DEBUG os_brick.utils [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:43:45 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Updating existing volume attachment record: afd07670-5225-4f8e-8468-745eb7683b0a {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:43:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:43:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:43:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Acquiring lock "d5f1f2eb-61af-4fe2-b805-b951e71d47bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:43:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lock "d5f1f2eb-61af-4fe2-b805-b951e71d47bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:43:50 user nova-compute[73078]: DEBUG nova.compute.manager [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:43:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:43:50 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:43:50 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:43:50 user nova-compute[73078]: INFO nova.compute.claims [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Claim successful on node user
Aug 14 18:43:51 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:43:51 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:43:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.241s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:43:51 user nova-compute[73078]: DEBUG nova.compute.manager [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:43:51 user nova-compute[73078]: DEBUG nova.compute.manager [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:43:51 user nova-compute[73078]: DEBUG nova.network.neutron [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:43:51 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:43:51 user nova-compute[73078]: DEBUG nova.compute.manager [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:43:51 user nova-compute[73078]: DEBUG nova.policy [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1a94313076234222b07cbcb8ed97fc30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f59c99ecbb5c4bfa8444a2fbe224f345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:43:51 user nova-compute[73078]: DEBUG nova.compute.manager [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:43:51 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:43:51 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Creating image(s)
Aug 14 18:43:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5f1f2eb-61af-4fe2-b805-b951e71d47bb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:43:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lock "/opt/stack/data/nova/instances/d5f1f2eb-61af-4fe2-b805-b951e71d47bb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:43:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lock "/opt/stack/data/nova/instances/d5f1f2eb-61af-4fe2-b805-b951e71d47bb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:43:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:43:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.179s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:43:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:43:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:43:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:43:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.177s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:43:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/d5f1f2eb-61af-4fe2-b805-b951e71d47bb/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:43:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/d5f1f2eb-61af-4fe2-b805-b951e71d47bb/disk 1073741824" returned: 0 in 0.051s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:43:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:43:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:43:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:43:51 user nova-compute[73078]: DEBUG nova.network.neutron [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Successfully created port: 8162f193-8c90-4b8b-8e9f-824dfdf70b10 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:43:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.189s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:43:51 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d5f1f2eb-61af-4fe2-b805-b951e71d47bb/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:43:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5f1f2eb-61af-4fe2-b805-b951e71d47bb/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:43:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:43:52 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5f1f2eb-61af-4fe2-b805-b951e71d47bb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:43:52 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Cannot resize image /opt/stack/data/nova/instances/d5f1f2eb-61af-4fe2-b805-b951e71d47bb/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:43:52 user nova-compute[73078]: DEBUG nova.objects.instance [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lazy-loading 'migration_context' on Instance uuid d5f1f2eb-61af-4fe2-b805-b951e71d47bb {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:43:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:43:52 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Ensure instance console log exists: /opt/stack/data/nova/instances/d5f1f2eb-61af-4fe2-b805-b951e71d47bb/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:43:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:43:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:43:52 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.network.neutron [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Successfully updated port: 8162f193-8c90-4b8b-8e9f-824dfdf70b10 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Acquiring lock "refresh_cache-d5f1f2eb-61af-4fe2-b805-b951e71d47bb" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Acquired lock "refresh_cache-d5f1f2eb-61af-4fe2-b805-b951e71d47bb" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.network.neutron [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.compute.manager [req-11bd9e33-6432-488e-9ab5-862a9b7f3be6 req-a7e9632f-6178-40af-a13e-3b994ea98958 service nova] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Received event network-changed-8162f193-8c90-4b8b-8e9f-824dfdf70b10 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.compute.manager [req-11bd9e33-6432-488e-9ab5-862a9b7f3be6 req-a7e9632f-6178-40af-a13e-3b994ea98958 service nova] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Refreshing instance network info cache due to event network-changed-8162f193-8c90-4b8b-8e9f-824dfdf70b10. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-11bd9e33-6432-488e-9ab5-862a9b7f3be6 req-a7e9632f-6178-40af-a13e-3b994ea98958 service nova] Acquiring lock "refresh_cache-d5f1f2eb-61af-4fe2-b805-b951e71d47bb" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.network.neutron [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.network.neutron [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Updating instance_info_cache with network_info: [{"id": "8162f193-8c90-4b8b-8e9f-824dfdf70b10", "address": "fa:16:3e:83:5a:fa", "network": {"id": "226b01bc-2d08-43f8-9ba8-2545b12952e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-821526969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f59c99ecbb5c4bfa8444a2fbe224f345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8162f193-8c", "ovs_interfaceid": "8162f193-8c90-4b8b-8e9f-824dfdf70b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Releasing lock "refresh_cache-d5f1f2eb-61af-4fe2-b805-b951e71d47bb" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.compute.manager [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Instance network_info: |[{"id": "8162f193-8c90-4b8b-8e9f-824dfdf70b10", "address": "fa:16:3e:83:5a:fa", "network": {"id": "226b01bc-2d08-43f8-9ba8-2545b12952e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-821526969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f59c99ecbb5c4bfa8444a2fbe224f345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8162f193-8c", "ovs_interfaceid": "8162f193-8c90-4b8b-8e9f-824dfdf70b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-11bd9e33-6432-488e-9ab5-862a9b7f3be6 req-a7e9632f-6178-40af-a13e-3b994ea98958 service nova] Acquired lock "refresh_cache-d5f1f2eb-61af-4fe2-b805-b951e71d47bb" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.network.neutron [req-11bd9e33-6432-488e-9ab5-862a9b7f3be6 req-a7e9632f-6178-40af-a13e-3b994ea98958 service nova] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Refreshing network info cache for port 8162f193-8c90-4b8b-8e9f-824dfdf70b10 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Start _get_guest_xml network_info=[{"id": "8162f193-8c90-4b8b-8e9f-824dfdf70b10", "address": "fa:16:3e:83:5a:fa", "network": {"id": "226b01bc-2d08-43f8-9ba8-2545b12952e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-821526969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f59c99ecbb5c4bfa8444a2fbe224f345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8162f193-8c", "ovs_interfaceid": "8162f193-8c90-4b8b-8e9f-824dfdf70b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:43:53 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:43:53 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:43:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1619377023',display_name='tempest-ServersNegativeTestJSON-server-1619377023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1619377023',id=50,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f59c99ecbb5c4bfa8444a2fbe224f345',ramdisk_id='',reservation_id='r-8vp5le5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1030825811',owner_user_name='tempest-ServersNegativeTestJSON-1030825811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:43:51Z,user_data=None,user_id='1a94313076234222b07cbcb8ed97fc30',uuid=d5f1f2eb-61af-4fe2-b805-b951e71d47bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8162f193-8c90-4b8b-8e9f-824dfdf70b10", "address": "fa:16:3e:83:5a:fa", "network": {"id": "226b01bc-2d08-43f8-9ba8-2545b12952e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-821526969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f59c99ecbb5c4bfa8444a2fbe224f345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8162f193-8c", "ovs_interfaceid": "8162f193-8c90-4b8b-8e9f-824dfdf70b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Converting VIF {"id": "8162f193-8c90-4b8b-8e9f-824dfdf70b10", "address": "fa:16:3e:83:5a:fa", "network": {"id": "226b01bc-2d08-43f8-9ba8-2545b12952e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-821526969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f59c99ecbb5c4bfa8444a2fbe224f345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8162f193-8c", "ovs_interfaceid": "8162f193-8c90-4b8b-8e9f-824dfdf70b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:5a:fa,bridge_name='br-int',has_traffic_filtering=True,id=8162f193-8c90-4b8b-8e9f-824dfdf70b10,network=Network(226b01bc-2d08-43f8-9ba8-2545b12952e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8162f193-8c') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.objects.instance [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lazy-loading 'pci_devices' on Instance uuid d5f1f2eb-61af-4fe2-b805-b951e71d47bb {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:43:53 user nova-compute[73078]:   <uuid>d5f1f2eb-61af-4fe2-b805-b951e71d47bb</uuid>
Aug 14 18:43:53 user nova-compute[73078]:   <name>instance-00000032</name>
Aug 14 18:43:53 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:43:53 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:43:53 user nova-compute[73078]:   <metadata>
Aug 14 18:43:53 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:43:53 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:43:53 user nova-compute[73078]:       <nova:name>tempest-ServersNegativeTestJSON-server-1619377023</nova:name>
Aug 14 18:43:53 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:43:53</nova:creationTime>
Aug 14 18:43:53 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:43:53 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:43:53 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:43:53 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:43:53 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:43:53 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:43:53 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:43:53 user nova-compute[73078]:       <nova:owner>
Aug 14 18:43:53 user nova-compute[73078]:         <nova:user uuid="1a94313076234222b07cbcb8ed97fc30">tempest-ServersNegativeTestJSON-1030825811-project-member</nova:user>
Aug 14 18:43:53 user nova-compute[73078]:         <nova:project uuid="f59c99ecbb5c4bfa8444a2fbe224f345">tempest-ServersNegativeTestJSON-1030825811</nova:project>
Aug 14 18:43:53 user nova-compute[73078]:       </nova:owner>
Aug 14 18:43:53 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:43:53 user nova-compute[73078]:       <nova:ports>
Aug 14 18:43:53 user nova-compute[73078]:         <nova:port uuid="8162f193-8c90-4b8b-8e9f-824dfdf70b10">
Aug 14 18:43:53 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 18:43:53 user nova-compute[73078]:         </nova:port>
Aug 14 18:43:53 user nova-compute[73078]:       </nova:ports>
Aug 14 18:43:53 user nova-compute[73078]:     </nova:instance>
Aug 14 18:43:53 user nova-compute[73078]:   </metadata>
Aug 14 18:43:53 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:43:53 user nova-compute[73078]:     <system>
Aug 14 18:43:53 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:43:53 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:43:53 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:43:53 user nova-compute[73078]:       <entry name="serial">d5f1f2eb-61af-4fe2-b805-b951e71d47bb</entry>
Aug 14 18:43:53 user nova-compute[73078]:       <entry name="uuid">d5f1f2eb-61af-4fe2-b805-b951e71d47bb</entry>
Aug 14 18:43:53 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:43:53 user nova-compute[73078]:     </system>
Aug 14 18:43:53 user nova-compute[73078]:   </sysinfo>
Aug 14 18:43:53 user nova-compute[73078]:   <os>
Aug 14 18:43:53 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:43:53 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:43:53 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:43:53 user nova-compute[73078]:   </os>
Aug 14 18:43:53 user nova-compute[73078]:   <features>
Aug 14 18:43:53 user nova-compute[73078]:     <acpi/>
Aug 14 18:43:53 user nova-compute[73078]:     <apic/>
Aug 14 18:43:53 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:43:53 user nova-compute[73078]:   </features>
Aug 14 18:43:53 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:43:53 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:43:53 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:43:53 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:43:53 user nova-compute[73078]:   </clock>
Aug 14 18:43:53 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:43:53 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:43:53 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:43:53 user nova-compute[73078]:   </cpu>
Aug 14 18:43:53 user nova-compute[73078]:   <devices>
Aug 14 18:43:53 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:43:53 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:43:53 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/d5f1f2eb-61af-4fe2-b805-b951e71d47bb/disk"/>
Aug 14 18:43:53 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:43:53 user nova-compute[73078]:     </disk>
Aug 14 18:43:53 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:43:53 user nova-compute[73078]:       <mac address="fa:16:3e:83:5a:fa"/>
Aug 14 18:43:53 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:43:53 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:43:53 user nova-compute[73078]:       <target dev="tap8162f193-8c"/>
Aug 14 18:43:53 user nova-compute[73078]:     </interface>
Aug 14 18:43:53 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:43:53 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/d5f1f2eb-61af-4fe2-b805-b951e71d47bb/console.log" append="off"/>
Aug 14 18:43:53 user nova-compute[73078]:     </serial>
Aug 14 18:43:53 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:43:53 user nova-compute[73078]:     <video>
Aug 14 18:43:53 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:43:53 user nova-compute[73078]:     </video>
Aug 14 18:43:53 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:43:53 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:43:53 user nova-compute[73078]:     </rng>
Aug 14 18:43:53 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:43:53 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:43:53 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:43:53 user nova-compute[73078]:     </memballoon>
Aug 14 18:43:53 user nova-compute[73078]:   </devices>
Aug 14 18:43:53 user nova-compute[73078]: </domain>
Aug 14 18:43:53 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:43:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1619377023',display_name='tempest-ServersNegativeTestJSON-server-1619377023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1619377023',id=50,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f59c99ecbb5c4bfa8444a2fbe224f345',ramdisk_id='',reservation_id='r-8vp5le5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1030825811',owner_user_name='tempest-ServersNegativeTestJSON-1030825811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:43:51Z,user_data=None,user_id='1a94313076234222b07cbcb8ed97fc30',uuid=d5f1f2eb-61af-4fe2-b805-b951e71d47bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8162f193-8c90-4b8b-8e9f-824dfdf70b10", "address": "fa:16:3e:83:5a:fa", "network": {"id": "226b01bc-2d08-43f8-9ba8-2545b12952e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-821526969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f59c99ecbb5c4bfa8444a2fbe224f345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8162f193-8c", "ovs_interfaceid": "8162f193-8c90-4b8b-8e9f-824dfdf70b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Converting VIF {"id": "8162f193-8c90-4b8b-8e9f-824dfdf70b10", "address": "fa:16:3e:83:5a:fa", "network": {"id": "226b01bc-2d08-43f8-9ba8-2545b12952e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-821526969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f59c99ecbb5c4bfa8444a2fbe224f345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8162f193-8c", "ovs_interfaceid": "8162f193-8c90-4b8b-8e9f-824dfdf70b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:5a:fa,bridge_name='br-int',has_traffic_filtering=True,id=8162f193-8c90-4b8b-8e9f-824dfdf70b10,network=Network(226b01bc-2d08-43f8-9ba8-2545b12952e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8162f193-8c') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG os_vif [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:5a:fa,bridge_name='br-int',has_traffic_filtering=True,id=8162f193-8c90-4b8b-8e9f-824dfdf70b10,network=Network(226b01bc-2d08-43f8-9ba8-2545b12952e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8162f193-8c') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8162f193-8c, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8162f193-8c, col_values=(('external_ids', {'iface-id': '8162f193-8c90-4b8b-8e9f-824dfdf70b10', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:5a:fa', 'vm-uuid': 'd5f1f2eb-61af-4fe2-b805-b951e71d47bb'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:43:53 user nova-compute[73078]: INFO os_vif [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:5a:fa,bridge_name='br-int',has_traffic_filtering=True,id=8162f193-8c90-4b8b-8e9f-824dfdf70b10,network=Network(226b01bc-2d08-43f8-9ba8-2545b12952e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8162f193-8c')
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] No VIF found with MAC fa:16:3e:83:5a:fa, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgLITOVJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:43:53 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:43:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:43:53 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:43:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:43:53 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:43:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0102d8-bf4b-47ea-b126-f299e98ce5d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:43:53 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cb4ac8-3e49-4023-b332-f3f6c59c15f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88] added
Aug 14 18:43:53 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5599b0ef-9553-4748-a551-69636dc2c078]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb7242a-2250-489b-a1f0-3bc13152c66d]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MgLITOVJ {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.network.neutron [req-11bd9e33-6432-488e-9ab5-862a9b7f3be6 req-a7e9632f-6178-40af-a13e-3b994ea98958 service nova] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Updated VIF entry in instance network info cache for port 8162f193-8c90-4b8b-8e9f-824dfdf70b10. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG nova.network.neutron [req-11bd9e33-6432-488e-9ab5-862a9b7f3be6 req-a7e9632f-6178-40af-a13e-3b994ea98958 service nova] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Updating instance_info_cache with network_info: [{"id": "8162f193-8c90-4b8b-8e9f-824dfdf70b10", "address": "fa:16:3e:83:5a:fa", "network": {"id": "226b01bc-2d08-43f8-9ba8-2545b12952e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-821526969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f59c99ecbb5c4bfa8444a2fbe224f345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8162f193-8c", "ovs_interfaceid": "8162f193-8c90-4b8b-8e9f-824dfdf70b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MgLITOVJ" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fc7f37-4569-4244-9472-6c1402a6889d]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MgLITOVJ'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-11bd9e33-6432-488e-9ab5-862a9b7f3be6 req-a7e9632f-6178-40af-a13e-3b994ea98958 service nova] Releasing lock "refresh_cache-d5f1f2eb-61af-4fe2-b805-b951e71d47bb" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb67ee92-b509-48dd-a518-310cb1580359]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a12e597-9492-4e90-9573-6a60a49fc80f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 18:43:53 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:43:53 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 18:43:53 user nova-compute[73078]:  {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:43:53 user nova-compute[73078]: WARNING os_brick.initiator.connectors.iscsi [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 18:43:53 user nova-compute[73078]: 
Aug 14 18:43:53 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:43:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:43:54 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5ce15a-8ab3-41d5-8bbf-f7149786919f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:43:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88, portal: 172.16.0.220,3260]
Aug 14 18:43:54 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88, portal: 172.16.0.220,3260] successful.
Aug 14 18:43:54 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:43:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:43:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:43:54 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cb01c7-af0f-43a9-858a-4c94d0f84381]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:43:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:43:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:43:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:43:54 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddc219b-e5e7-44d6-b4be-ff74273659b2]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:43:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88 (non-flash)
Aug 14 18:43:54 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:43:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88 (non-flash)
Aug 14 18:43:54 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:43:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:43:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:43:54 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:43:54 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:43:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:43:54 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:43:54 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c251633a-6a72-480b-87af-da2307cf7a59]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:43:54 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:43:54 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgLITOVJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:43:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:43:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:43:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:43:55 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:43:55 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '26332313539643534', 'path': '/dev/sdb'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:43:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332313539643534', 'path': '/dev/sdb'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:43:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:43:55 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:43:55 user nova-compute[73078]: DEBUG nova.objects.instance [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lazy-loading 'flavor' on Instance uuid 8958e365-2ffd-45e1-a21b-231ee6dae350 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:43:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 18:43:55 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:43:55 user nova-compute[73078]:   <source dev="/dev/sdb"/>
Aug 14 18:43:55 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:43:55 user nova-compute[73078]:   <serial>b8effc0c-412e-4021-92d9-5f4b5f2f4b88</serial>
Aug 14 18:43:55 user nova-compute[73078]: </disk>
Aug 14 18:43:55 user nova-compute[73078]:  {{(pid=73078) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 18:43:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:43:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:43:55 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] No VIF found with MAC fa:16:3e:3a:3e:57, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:43:55 user nova-compute[73078]: DEBUG nova.compute.manager [req-d013c99b-b575-43a2-ab73-e6ba58f92b4f req-f821a014-8349-445a-b2fe-1dbda0e7adff service nova] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Received event network-vif-plugged-8162f193-8c90-4b8b-8e9f-824dfdf70b10 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:43:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d013c99b-b575-43a2-ab73-e6ba58f92b4f req-f821a014-8349-445a-b2fe-1dbda0e7adff service nova] Acquiring lock "d5f1f2eb-61af-4fe2-b805-b951e71d47bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:43:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d013c99b-b575-43a2-ab73-e6ba58f92b4f req-f821a014-8349-445a-b2fe-1dbda0e7adff service nova] Lock "d5f1f2eb-61af-4fe2-b805-b951e71d47bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:43:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d013c99b-b575-43a2-ab73-e6ba58f92b4f req-f821a014-8349-445a-b2fe-1dbda0e7adff service nova] Lock "d5f1f2eb-61af-4fe2-b805-b951e71d47bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:43:55 user nova-compute[73078]: DEBUG nova.compute.manager [req-d013c99b-b575-43a2-ab73-e6ba58f92b4f req-f821a014-8349-445a-b2fe-1dbda0e7adff service nova] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] No waiting events found dispatching network-vif-plugged-8162f193-8c90-4b8b-8e9f-824dfdf70b10 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:43:55 user nova-compute[73078]: WARNING nova.compute.manager [req-d013c99b-b575-43a2-ab73-e6ba58f92b4f req-f821a014-8349-445a-b2fe-1dbda0e7adff service nova] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Received unexpected event network-vif-plugged-8162f193-8c90-4b8b-8e9f-824dfdf70b10 for instance with vm_state building and task_state spawning.
Aug 14 18:43:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-3412d34a-8b5a-4c5d-aa68-237812e13c34 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "8958e365-2ffd-45e1-a21b-231ee6dae350" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.134s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:43:57 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692038637.2588825, d5f1f2eb-61af-4fe2-b805-b951e71d47bb => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:43:57 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] VM Resumed (Lifecycle Event)
Aug 14 18:43:57 user nova-compute[73078]: DEBUG nova.compute.manager [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:43:57 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:43:57 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Instance spawned successfully.
Aug 14 18:43:57 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:43:57 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:43:57 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:43:57 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:43:57 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:43:57 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:43:57 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:43:57 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:43:57 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:43:57 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:43:57 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692038637.2633867, d5f1f2eb-61af-4fe2-b805-b951e71d47bb => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:43:57 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] VM Started (Lifecycle Event)
Aug 14 18:43:57 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:43:57 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:43:57 user nova-compute[73078]: INFO nova.compute.manager [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Took 6.08 seconds to spawn the instance on the hypervisor.
Aug 14 18:43:57 user nova-compute[73078]: DEBUG nova.compute.manager [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:43:57 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:43:57 user nova-compute[73078]: INFO nova.compute.manager [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Took 6.63 seconds to build instance.
Aug 14 18:43:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-226ceb86-3488-4444-97d6-0cef83120410 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lock "d5f1f2eb-61af-4fe2-b805-b951e71d47bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.744s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:43:57 user nova-compute[73078]: DEBUG nova.compute.manager [req-25c3c4d0-babd-458e-a5b1-acbf5a3fabd5 req-57cc0c1c-f4ee-46fc-8a11-3877bc025a4a service nova] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Received event network-vif-plugged-8162f193-8c90-4b8b-8e9f-824dfdf70b10 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:43:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-25c3c4d0-babd-458e-a5b1-acbf5a3fabd5 req-57cc0c1c-f4ee-46fc-8a11-3877bc025a4a service nova] Acquiring lock "d5f1f2eb-61af-4fe2-b805-b951e71d47bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:43:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-25c3c4d0-babd-458e-a5b1-acbf5a3fabd5 req-57cc0c1c-f4ee-46fc-8a11-3877bc025a4a service nova] Lock "d5f1f2eb-61af-4fe2-b805-b951e71d47bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:43:57 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-25c3c4d0-babd-458e-a5b1-acbf5a3fabd5 req-57cc0c1c-f4ee-46fc-8a11-3877bc025a4a service nova] Lock "d5f1f2eb-61af-4fe2-b805-b951e71d47bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:43:57 user nova-compute[73078]: DEBUG nova.compute.manager [req-25c3c4d0-babd-458e-a5b1-acbf5a3fabd5 req-57cc0c1c-f4ee-46fc-8a11-3877bc025a4a service nova] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] No waiting events found dispatching network-vif-plugged-8162f193-8c90-4b8b-8e9f-824dfdf70b10 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:43:57 user nova-compute[73078]: WARNING nova.compute.manager [req-25c3c4d0-babd-458e-a5b1-acbf5a3fabd5 req-57cc0c1c-f4ee-46fc-8a11-3877bc025a4a service nova] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Received unexpected event network-vif-plugged-8162f193-8c90-4b8b-8e9f-824dfdf70b10 for instance with vm_state active and task_state None.
Aug 14 18:43:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:43:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:43:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "8958e365-2ffd-45e1-a21b-231ee6dae350" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:43:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "8958e365-2ffd-45e1-a21b-231ee6dae350" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:43:59 user nova-compute[73078]: DEBUG nova.objects.instance [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lazy-loading 'flavor' on Instance uuid 8958e365-2ffd-45e1-a21b-231ee6dae350 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:44:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "8958e365-2ffd-45e1-a21b-231ee6dae350" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:44:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "8958e365-2ffd-45e1-a21b-231ee6dae350" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:44:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "8958e365-2ffd-45e1-a21b-231ee6dae350" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:44:00 user nova-compute[73078]: INFO nova.compute.manager [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Attaching volume c2b22c88-bc0f-46e2-b735-7a262ca4f52a to /dev/vdc
Aug 14 18:44:00 user nova-compute[73078]: DEBUG os_brick.utils [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:44:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:00 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9477aae-146e-4014-a5f2-233293c36395]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:44:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:00 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e3a3ce-ac74-4c73-ac42-3cc213a1386b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:44:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:00 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6a6433-6519-42ea-9e71-d84ed20b70d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:44:00 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a54285f-ecd6-4369-a6d1-f2cdf5391258]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:44:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:44:00 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:44:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:44:00 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:44:00 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[703cbf1d-7d7c-479c-ac60-474240d11620]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:44:00 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:44:00 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:44:00 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:44:00 user nova-compute[73078]: DEBUG os_brick.utils [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:44:00 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Updating existing volume attachment record: 93930571-47bd-4ed7-bdaf-b73a3e478740 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:44:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:44:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tLpdbkio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:44:09 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:44:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:44:09 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:44:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:44:09 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:44:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9a31aa-a7f0-440b-865c-509018817308]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:44:09 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c0aade-8078-4fee-9c5f-480287afda86]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a] added
Aug 14 18:44:09 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceacabea-63f8-4e92-8565-7816d8fd55cc]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e56bb0a-503c-4fa9-8bc8-a9d177a52438]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tLpdbkio {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tLpdbkio" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2aef75-a66d-4a57-8d3a-dba3ac7d064e]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tLpdbkio'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[40af39e1-ddef-4d1d-a611-ac2565b60374]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a86a19-e0a2-4a32-b476-51691f59e50c]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88 (non-flash)
Aug 14 18:44:09 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88 (non-flash)
Aug 14 18:44:09 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0c466d-e62f-46a0-aa2f-9a849b3522f5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a, portal: 172.16.0.220,3260]
Aug 14 18:44:09 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a, portal: 172.16.0.220,3260] successful.
Aug 14 18:44:09 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee1721d-7abe-4e55-8d1c-8decd4e18af6]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff38375c-b2b1-48fa-a577-043ffa161e81]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88 (non-flash)
Aug 14 18:44:09 user nova-compute[73078]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a (non-flash)
Aug 14 18:44:09 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88 (non-flash)
Aug 14 18:44:09 user nova-compute[73078]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a (non-flash)
Aug 14 18:44:09 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] HCTL ('34', '-', '-', 0) found on session 61 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb743d2-b4f9-4915-8735-2c873408b47e]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:44:09 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: None {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:44:10 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:44:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tLpdbkio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:44:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:44:10 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26139663737373366', 'path': '/dev/sdc'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:44:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139663737373366', 'path': '/dev/sdc'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:44:10 user nova-compute[73078]: DEBUG nova.objects.instance [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lazy-loading 'flavor' on Instance uuid 8958e365-2ffd-45e1-a21b-231ee6dae350 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:44:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 18:44:10 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:44:10 user nova-compute[73078]:   <source dev="/dev/sdc"/>
Aug 14 18:44:10 user nova-compute[73078]:   <target dev="vdc" bus="virtio"/>
Aug 14 18:44:10 user nova-compute[73078]:   <serial>c2b22c88-bc0f-46e2-b735-7a262ca4f52a</serial>
Aug 14 18:44:10 user nova-compute[73078]: </disk>
Aug 14 18:44:10 user nova-compute[73078]:  {{(pid=73078) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 18:44:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:44:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:44:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:44:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] No VIF found with MAC fa:16:3e:3a:3e:57, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:44:11 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:44:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-55e89bef-e87f-46b3-b99a-0cc6e63efbbb tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "8958e365-2ffd-45e1-a21b-231ee6dae350" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.975s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:44:12 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:44:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:44:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Rebuilding the list of instances to heal {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 18:44:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-8958e365-2ffd-45e1-a21b-231ee6dae350" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:44:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-8958e365-2ffd-45e1-a21b-231ee6dae350" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:44:12 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:44:12 user nova-compute[73078]: DEBUG nova.objects.instance [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lazy-loading 'info_cache' on Instance uuid 8958e365-2ffd-45e1-a21b-231ee6dae350 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:44:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-720fe7e7-104b-465a-a671-ea357e871cb7 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "8958e365-2ffd-45e1-a21b-231ee6dae350" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:44:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-720fe7e7-104b-465a-a671-ea357e871cb7 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "8958e365-2ffd-45e1-a21b-231ee6dae350" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:44:12 user nova-compute[73078]: INFO nova.compute.manager [None req-720fe7e7-104b-465a-a671-ea357e871cb7 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Detaching volume b8effc0c-412e-4021-92d9-5f4b5f2f4b88
Aug 14 18:44:12 user nova-compute[73078]: INFO nova.virt.block_device [None req-720fe7e7-104b-465a-a671-ea357e871cb7 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Attempting to driver detach volume b8effc0c-412e-4021-92d9-5f4b5f2f4b88 from mountpoint /dev/vdb
Aug 14 18:44:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-720fe7e7-104b-465a-a671-ea357e871cb7 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Attempting to detach device vdb from instance 8958e365-2ffd-45e1-a21b-231ee6dae350 from the persistent domain config. {{(pid=73078) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 18:44:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-720fe7e7-104b-465a-a671-ea357e871cb7 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:44:12 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:44:12 user nova-compute[73078]:   <source dev="/dev/sdb"/>
Aug 14 18:44:12 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:44:12 user nova-compute[73078]:   <serial>b8effc0c-412e-4021-92d9-5f4b5f2f4b88</serial>
Aug 14 18:44:12 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:44:12 user nova-compute[73078]: </disk>
Aug 14 18:44:12 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:44:12 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-720fe7e7-104b-465a-a671-ea357e871cb7 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Successfully detached device vdb from instance 8958e365-2ffd-45e1-a21b-231ee6dae350 from the persistent domain config.
Aug 14 18:44:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-720fe7e7-104b-465a-a671-ea357e871cb7 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8958e365-2ffd-45e1-a21b-231ee6dae350 from the live domain config. {{(pid=73078) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 18:44:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-720fe7e7-104b-465a-a671-ea357e871cb7 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:44:12 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:44:12 user nova-compute[73078]:   <source dev="/dev/sdb"/>
Aug 14 18:44:12 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:44:12 user nova-compute[73078]:   <serial>b8effc0c-412e-4021-92d9-5f4b5f2f4b88</serial>
Aug 14 18:44:12 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:44:12 user nova-compute[73078]: </disk>
Aug 14 18:44:12 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:44:12 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Updating instance_info_cache with network_info: [{"id": "85d42c0a-782b-4542-8091-76f2cf960dc2", "address": "fa:16:3e:3a:3e:57", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d42c0a-78", "ovs_interfaceid": "85d42c0a-782b-4542-8091-76f2cf960dc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:44:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-8958e365-2ffd-45e1-a21b-231ee6dae350" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:44:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Received event <DeviceRemovedEvent: 1692038653.0402932, 8958e365-2ffd-45e1-a21b-231ee6dae350 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73078) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-720fe7e7-104b-465a-a671-ea357e871cb7 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8958e365-2ffd-45e1-a21b-231ee6dae350 {{(pid=73078) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 18:44:13 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-720fe7e7-104b-465a-a671-ea357e871cb7 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Successfully detached device vdb from instance 8958e365-2ffd-45e1-a21b-231ee6dae350 from the live domain config.
Aug 14 18:44:13 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-720fe7e7-104b-465a-a671-ea357e871cb7 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-720fe7e7-104b-465a-a671-ea357e871cb7 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgLITOVJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:44:13 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-720fe7e7-104b-465a-a671-ea357e871cb7 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:44:13 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-720fe7e7-104b-465a-a671-ea357e871cb7 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-720fe7e7-104b-465a-a671-ea357e871cb7 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-720fe7e7-104b-465a-a671-ea357e871cb7 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc840451-447b-4a1e-8142-95d03297afff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ad93c0-0e3e-4f5e-9e55-4661b72a6066]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-720fe7e7-104b-465a-a671-ea357e871cb7 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88 (non-flash)
Aug 14 18:44:13 user nova-compute[73078]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a (non-flash)
Aug 14 18:44:13 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-720fe7e7-104b-465a-a671-ea357e871cb7 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88 (non-flash)
Aug 14 18:44:13 user nova-compute[73078]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a (non-flash)
Aug 14 18:44:13 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-720fe7e7-104b-465a-a671-ea357e871cb7 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9880f7250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88'): ({'sdb'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-720fe7e7-104b-465a-a671-ea357e871cb7 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Removing single pathed devices sdb {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2431d7-ed77-41c6-872b-fb302c6548a8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf04de3-bcaa-40c3-816a-d7cefa4ea5dd]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-720fe7e7-104b-465a-a671-ea357e871cb7 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Flushing IO for device /dev/sdb {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee9a17b-6537-44b5-b768-80c0fab3735c]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-720fe7e7-104b-465a-a671-ea357e871cb7 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b76642-e2b7-4ca3-9d5c-207088009afe]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-720fe7e7-104b-465a-a671-ea357e871cb7 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-720fe7e7-104b-465a-a671-ea357e871cb7 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] SCSI volumes sdb have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-720fe7e7-104b-465a-a671-ea357e871cb7 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[aedeece1-a6eb-42b8-990b-8439722c5e5c]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-720fe7e7-104b-465a-a671-ea357e871cb7 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1037358a-0ec6-469b-a2e5-bea94319a138]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-720fe7e7-104b-465a-a671-ea357e871cb7 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88, portal: 172.16.0.220,3260]
Aug 14 18:44:13 user nova-compute[73078]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88, portal: 172.16.0.220,3260] successful.
Aug 14 18:44:13 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8effc0c-412e-4021-92d9-5f4b5f2f4b88 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ef6dfa-dbec-45bc-9909-884a1159f368]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-720fe7e7-104b-465a-a671-ea357e871cb7 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-720fe7e7-104b-465a-a671-ea357e871cb7 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.251s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-720fe7e7-104b-465a-a671-ea357e871cb7 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] <== disconnect_volume: return (253ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-720fe7e7-104b-465a-a671-ea357e871cb7 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:44:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:44:14 user nova-compute[73078]: DEBUG nova.objects.instance [None req-720fe7e7-104b-465a-a671-ea357e871cb7 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lazy-loading 'flavor' on Instance uuid 8958e365-2ffd-45e1-a21b-231ee6dae350 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:44:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-720fe7e7-104b-465a-a671-ea357e871cb7 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "8958e365-2ffd-45e1-a21b-231ee6dae350" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.547s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:44:14 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:44:14 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:44:14 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:44:14 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:44:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-6996cdbb-a8c0-4e5c-b636-0cb7a7fdd169 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "8958e365-2ffd-45e1-a21b-231ee6dae350" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:44:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-6996cdbb-a8c0-4e5c-b636-0cb7a7fdd169 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "8958e365-2ffd-45e1-a21b-231ee6dae350" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:44:14 user nova-compute[73078]: INFO nova.compute.manager [None req-6996cdbb-a8c0-4e5c-b636-0cb7a7fdd169 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Detaching volume c2b22c88-bc0f-46e2-b735-7a262ca4f52a
Aug 14 18:44:14 user nova-compute[73078]: INFO nova.virt.block_device [None req-6996cdbb-a8c0-4e5c-b636-0cb7a7fdd169 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Attempting to driver detach volume c2b22c88-bc0f-46e2-b735-7a262ca4f52a from mountpoint /dev/vdc
Aug 14 18:44:14 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-6996cdbb-a8c0-4e5c-b636-0cb7a7fdd169 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Attempting to detach device vdc from instance 8958e365-2ffd-45e1-a21b-231ee6dae350 from the persistent domain config. {{(pid=73078) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 18:44:14 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-6996cdbb-a8c0-4e5c-b636-0cb7a7fdd169 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:44:14 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:44:14 user nova-compute[73078]:   <source dev="/dev/sdc"/>
Aug 14 18:44:14 user nova-compute[73078]:   <target dev="vdc" bus="virtio"/>
Aug 14 18:44:14 user nova-compute[73078]:   <serial>c2b22c88-bc0f-46e2-b735-7a262ca4f52a</serial>
Aug 14 18:44:14 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 18:44:14 user nova-compute[73078]: </disk>
Aug 14 18:44:14 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:44:14 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-6996cdbb-a8c0-4e5c-b636-0cb7a7fdd169 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Successfully detached device vdc from instance 8958e365-2ffd-45e1-a21b-231ee6dae350 from the persistent domain config.
Aug 14 18:44:14 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-6996cdbb-a8c0-4e5c-b636-0cb7a7fdd169 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 8958e365-2ffd-45e1-a21b-231ee6dae350 from the live domain config. {{(pid=73078) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 18:44:14 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-6996cdbb-a8c0-4e5c-b636-0cb7a7fdd169 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:44:14 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:44:14 user nova-compute[73078]:   <source dev="/dev/sdc"/>
Aug 14 18:44:14 user nova-compute[73078]:   <target dev="vdc" bus="virtio"/>
Aug 14 18:44:14 user nova-compute[73078]:   <serial>c2b22c88-bc0f-46e2-b735-7a262ca4f52a</serial>
Aug 14 18:44:14 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 18:44:14 user nova-compute[73078]: </disk>
Aug 14 18:44:14 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Received event <DeviceRemovedEvent: 1692038655.4119172, 8958e365-2ffd-45e1-a21b-231ee6dae350 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73078) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-6996cdbb-a8c0-4e5c-b636-0cb7a7fdd169 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 8958e365-2ffd-45e1-a21b-231ee6dae350 {{(pid=73078) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 18:44:15 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-6996cdbb-a8c0-4e5c-b636-0cb7a7fdd169 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Successfully detached device vdc from instance 8958e365-2ffd-45e1-a21b-231ee6dae350 from the live domain config.
Aug 14 18:44:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6996cdbb-a8c0-4e5c-b636-0cb7a7fdd169 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6996cdbb-a8c0-4e5c-b636-0cb7a7fdd169 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tLpdbkio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:44:15 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-6996cdbb-a8c0-4e5c-b636-0cb7a7fdd169 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:44:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-6996cdbb-a8c0-4e5c-b636-0cb7a7fdd169 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-6996cdbb-a8c0-4e5c-b636-0cb7a7fdd169 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6996cdbb-a8c0-4e5c-b636-0cb7a7fdd169 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ea3c2b-97f7-4063-a2e6-4d895a728833]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0838b843-8579-4b71-a425-7ceea2071183]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6996cdbb-a8c0-4e5c-b636-0cb7a7fdd169 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a (non-flash)
Aug 14 18:44:15 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6996cdbb-a8c0-4e5c-b636-0cb7a7fdd169 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a (non-flash)
Aug 14 18:44:15 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6996cdbb-a8c0-4e5c-b636-0cb7a7fdd169 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe995edc160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a'): ({'sdc'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-6996cdbb-a8c0-4e5c-b636-0cb7a7fdd169 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Removing single pathed devices sdc {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16833e6-add6-4752-a953-2a07a007578c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[606d5b66-eda6-49da-beb0-38e2c8eb9c96]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-6996cdbb-a8c0-4e5c-b636-0cb7a7fdd169 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Flushing IO for device /dev/sdc {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e6f05d-6f87-4e74-a5b2-ef95c8c5f613]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-6996cdbb-a8c0-4e5c-b636-0cb7a7fdd169 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63888a1-b985-47f4-8daf-f3a48313c684]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-6996cdbb-a8c0-4e5c-b636-0cb7a7fdd169 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-6996cdbb-a8c0-4e5c-b636-0cb7a7fdd169 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] SCSI volumes sdc have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6996cdbb-a8c0-4e5c-b636-0cb7a7fdd169 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf11d2fa-e4e8-4200-a911-863f3d676fe4]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6996cdbb-a8c0-4e5c-b636-0cb7a7fdd169 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68cff11-48a1-4a12-bb4b-4afa7c930e7d]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6996cdbb-a8c0-4e5c-b636-0cb7a7fdd169 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a, portal: 172.16.0.220,3260]
Aug 14 18:44:15 user nova-compute[73078]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a, portal: 172.16.0.220,3260] successful.
Aug 14 18:44:15 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b22c88-bc0f-46e2-b735-7a262ca4f52a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[16350b11-0115-412c-9e6e-4562af964787]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6996cdbb-a8c0-4e5c-b636-0cb7a7fdd169 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-6996cdbb-a8c0-4e5c-b636-0cb7a7fdd169 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6996cdbb-a8c0-4e5c-b636-0cb7a7fdd169 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] <== disconnect_volume: return (263ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:44:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6996cdbb-a8c0-4e5c-b636-0cb7a7fdd169 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:44:16 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:44:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:44:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:44:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:44:16 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:44:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5f1f2eb-61af-4fe2-b805-b951e71d47bb/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:16 user nova-compute[73078]: DEBUG nova.objects.instance [None req-6996cdbb-a8c0-4e5c-b636-0cb7a7fdd169 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lazy-loading 'flavor' on Instance uuid 8958e365-2ffd-45e1-a21b-231ee6dae350 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:44:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5f1f2eb-61af-4fe2-b805-b951e71d47bb/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5f1f2eb-61af-4fe2-b805-b951e71d47bb/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:16 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-6996cdbb-a8c0-4e5c-b636-0cb7a7fdd169 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "8958e365-2ffd-45e1-a21b-231ee6dae350" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.582s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:44:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5f1f2eb-61af-4fe2-b805-b951e71d47bb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8958e365-2ffd-45e1-a21b-231ee6dae350/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8958e365-2ffd-45e1-a21b-231ee6dae350/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8958e365-2ffd-45e1-a21b-231ee6dae350/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:16 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8958e365-2ffd-45e1-a21b-231ee6dae350/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:17 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:17 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:17 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:44:17 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:44:17 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:44:17 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:44:17 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=8486MB free_disk=25.030391693115234GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:44:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:44:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:44:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-477090d2-fe52-4ceb-8f2f-c45861bd8172 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "8958e365-2ffd-45e1-a21b-231ee6dae350" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:44:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-477090d2-fe52-4ceb-8f2f-c45861bd8172 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "8958e365-2ffd-45e1-a21b-231ee6dae350" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:44:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-477090d2-fe52-4ceb-8f2f-c45861bd8172 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "8958e365-2ffd-45e1-a21b-231ee6dae350-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:44:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-477090d2-fe52-4ceb-8f2f-c45861bd8172 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "8958e365-2ffd-45e1-a21b-231ee6dae350-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:44:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-477090d2-fe52-4ceb-8f2f-c45861bd8172 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "8958e365-2ffd-45e1-a21b-231ee6dae350-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:44:17 user nova-compute[73078]: INFO nova.compute.manager [None req-477090d2-fe52-4ceb-8f2f-c45861bd8172 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Terminating instance
Aug 14 18:44:17 user nova-compute[73078]: DEBUG nova.compute.manager [None req-477090d2-fe52-4ceb-8f2f-c45861bd8172 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:44:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:44:17 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 8958e365-2ffd-45e1-a21b-231ee6dae350 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:44:17 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 385ba618-9b83-495b-a4cc-0bf97a42a5bd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:44:17 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance d5f1f2eb-61af-4fe2-b805-b951e71d47bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:44:17 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:44:17 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:44:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:44:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:44:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:44:18 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:44:18 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:44:18 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:44:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.279s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:44:18 user nova-compute[73078]: DEBUG nova.compute.manager [req-e00fc02a-bccd-4c89-a11f-ad804c92cbe9 req-6fe9b4ec-1540-4ded-80d9-f11e390f06d1 service nova] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Received event network-vif-unplugged-85d42c0a-782b-4542-8091-76f2cf960dc2 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:44:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e00fc02a-bccd-4c89-a11f-ad804c92cbe9 req-6fe9b4ec-1540-4ded-80d9-f11e390f06d1 service nova] Acquiring lock "8958e365-2ffd-45e1-a21b-231ee6dae350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:44:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e00fc02a-bccd-4c89-a11f-ad804c92cbe9 req-6fe9b4ec-1540-4ded-80d9-f11e390f06d1 service nova] Lock "8958e365-2ffd-45e1-a21b-231ee6dae350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:44:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-e00fc02a-bccd-4c89-a11f-ad804c92cbe9 req-6fe9b4ec-1540-4ded-80d9-f11e390f06d1 service nova] Lock "8958e365-2ffd-45e1-a21b-231ee6dae350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:44:18 user nova-compute[73078]: DEBUG nova.compute.manager [req-e00fc02a-bccd-4c89-a11f-ad804c92cbe9 req-6fe9b4ec-1540-4ded-80d9-f11e390f06d1 service nova] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] No waiting events found dispatching network-vif-unplugged-85d42c0a-782b-4542-8091-76f2cf960dc2 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:44:18 user nova-compute[73078]: DEBUG nova.compute.manager [req-e00fc02a-bccd-4c89-a11f-ad804c92cbe9 req-6fe9b4ec-1540-4ded-80d9-f11e390f06d1 service nova] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Received event network-vif-unplugged-85d42c0a-782b-4542-8091-76f2cf960dc2 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:44:18 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Instance destroyed successfully.
Aug 14 18:44:18 user nova-compute[73078]: DEBUG nova.objects.instance [None req-477090d2-fe52-4ceb-8f2f-c45861bd8172 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lazy-loading 'resources' on Instance uuid 8958e365-2ffd-45e1-a21b-231ee6dae350 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:44:18 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-477090d2-fe52-4ceb-8f2f-c45861bd8172 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1016340083',display_name='tempest-AttachVolumeTestJSON-server-1016340083',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1016340083',id=48,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLsFOpdpBbLx2Qsowu2Z/CFby/BDiBsWzGztLtMmert039uV6cAW0FjkgON6czmID8WachMTv5nTvE8rDTkJxQiT8eBvlyMaza9kHzfpoDgpSwf0ystcJZcDOhxLcq81Q==',key_name='tempest-keypair-484186757',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:41:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c717b7be2814591a20db3c81bc5ba89',ramdisk_id='',reservation_id='r-zuuhzlyx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-120525527',owner_user_name='tempest-AttachVolumeTestJSON-120525527-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:41:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc0adf66a66f4f4fb698706b5d3294cd',uuid=8958e365-2ffd-45e1-a21b-231ee6dae350,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85d42c0a-782b-4542-8091-76f2cf960dc2", "address": "fa:16:3e:3a:3e:57", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d42c0a-78", "ovs_interfaceid": "85d42c0a-782b-4542-8091-76f2cf960dc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:44:18 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-477090d2-fe52-4ceb-8f2f-c45861bd8172 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Converting VIF {"id": "85d42c0a-782b-4542-8091-76f2cf960dc2", "address": "fa:16:3e:3a:3e:57", "network": {"id": "0e58d249-c00c-45c4-bc46-9d975b128a0e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1046382079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c717b7be2814591a20db3c81bc5ba89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85d42c0a-78", "ovs_interfaceid": "85d42c0a-782b-4542-8091-76f2cf960dc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:44:18 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-477090d2-fe52-4ceb-8f2f-c45861bd8172 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:3e:57,bridge_name='br-int',has_traffic_filtering=True,id=85d42c0a-782b-4542-8091-76f2cf960dc2,network=Network(0e58d249-c00c-45c4-bc46-9d975b128a0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85d42c0a-78') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:44:18 user nova-compute[73078]: DEBUG os_vif [None req-477090d2-fe52-4ceb-8f2f-c45861bd8172 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:3e:57,bridge_name='br-int',has_traffic_filtering=True,id=85d42c0a-782b-4542-8091-76f2cf960dc2,network=Network(0e58d249-c00c-45c4-bc46-9d975b128a0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85d42c0a-78') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:44:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:44:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85d42c0a-78, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:44:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:44:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:44:18 user nova-compute[73078]: INFO os_vif [None req-477090d2-fe52-4ceb-8f2f-c45861bd8172 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:3e:57,bridge_name='br-int',has_traffic_filtering=True,id=85d42c0a-782b-4542-8091-76f2cf960dc2,network=Network(0e58d249-c00c-45c4-bc46-9d975b128a0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85d42c0a-78')
Aug 14 18:44:18 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-477090d2-fe52-4ceb-8f2f-c45861bd8172 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Deleting instance files /opt/stack/data/nova/instances/8958e365-2ffd-45e1-a21b-231ee6dae350_del
Aug 14 18:44:18 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-477090d2-fe52-4ceb-8f2f-c45861bd8172 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Deletion of /opt/stack/data/nova/instances/8958e365-2ffd-45e1-a21b-231ee6dae350_del complete
Aug 14 18:44:18 user nova-compute[73078]: INFO nova.compute.manager [None req-477090d2-fe52-4ceb-8f2f-c45861bd8172 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Took 0.83 seconds to destroy the instance on the hypervisor.
Aug 14 18:44:18 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-477090d2-fe52-4ceb-8f2f-c45861bd8172 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:44:18 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:44:18 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:44:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:44:19 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:44:19 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:44:19 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:44:19 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Took 0.90 seconds to deallocate network for instance.
Aug 14 18:44:19 user nova-compute[73078]: DEBUG nova.compute.manager [req-b4d95c0d-e2e4-4279-90e2-cb70d42db825 req-fbb65420-59cb-4543-89b4-8913549dc956 service nova] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Received event network-vif-deleted-85d42c0a-782b-4542-8091-76f2cf960dc2 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:44:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-477090d2-fe52-4ceb-8f2f-c45861bd8172 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:44:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-477090d2-fe52-4ceb-8f2f-c45861bd8172 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:44:19 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-477090d2-fe52-4ceb-8f2f-c45861bd8172 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:44:19 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-477090d2-fe52-4ceb-8f2f-c45861bd8172 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:44:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-477090d2-fe52-4ceb-8f2f-c45861bd8172 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.142s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:44:19 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-477090d2-fe52-4ceb-8f2f-c45861bd8172 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Deleted allocations for instance 8958e365-2ffd-45e1-a21b-231ee6dae350
Aug 14 18:44:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-477090d2-fe52-4ceb-8f2f-c45861bd8172 tempest-AttachVolumeTestJSON-120525527 tempest-AttachVolumeTestJSON-120525527-project-member] Lock "8958e365-2ffd-45e1-a21b-231ee6dae350" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.075s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:44:20 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:44:20 user nova-compute[73078]: DEBUG nova.compute.manager [req-797c455b-1b13-4fcb-b169-2ef4e4834f94 req-fca909ce-10f2-42fb-b1f2-a5858a8b4e80 service nova] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Received event network-vif-plugged-85d42c0a-782b-4542-8091-76f2cf960dc2 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:44:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-797c455b-1b13-4fcb-b169-2ef4e4834f94 req-fca909ce-10f2-42fb-b1f2-a5858a8b4e80 service nova] Acquiring lock "8958e365-2ffd-45e1-a21b-231ee6dae350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:44:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-797c455b-1b13-4fcb-b169-2ef4e4834f94 req-fca909ce-10f2-42fb-b1f2-a5858a8b4e80 service nova] Lock "8958e365-2ffd-45e1-a21b-231ee6dae350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:44:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-797c455b-1b13-4fcb-b169-2ef4e4834f94 req-fca909ce-10f2-42fb-b1f2-a5858a8b4e80 service nova] Lock "8958e365-2ffd-45e1-a21b-231ee6dae350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:44:20 user nova-compute[73078]: DEBUG nova.compute.manager [req-797c455b-1b13-4fcb-b169-2ef4e4834f94 req-fca909ce-10f2-42fb-b1f2-a5858a8b4e80 service nova] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] No waiting events found dispatching network-vif-plugged-85d42c0a-782b-4542-8091-76f2cf960dc2 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:44:20 user nova-compute[73078]: WARNING nova.compute.manager [req-797c455b-1b13-4fcb-b169-2ef4e4834f94 req-fca909ce-10f2-42fb-b1f2-a5858a8b4e80 service nova] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Received unexpected event network-vif-plugged-85d42c0a-782b-4542-8091-76f2cf960dc2 for instance with vm_state deleted and task_state None.
Aug 14 18:44:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:44:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:44:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:44:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:44:33 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692038658.543982, 8958e365-2ffd-45e1-a21b-231ee6dae350 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:44:33 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] VM Stopped (Lifecycle Event)
Aug 14 18:44:33 user nova-compute[73078]: DEBUG nova.compute.manager [None req-cdb4b23f-99eb-4d25-add6-ee9ef3695813 None None] [instance: 8958e365-2ffd-45e1-a21b-231ee6dae350] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:44:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:44:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:44:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:44:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:44:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:44:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:44:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:44:43 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:44:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:44:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:44:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:44:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:44:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:44:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:44:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:44:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:45:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:45:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:45:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:45:13 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:45:13 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:45:14 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:45:14 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:45:14 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:45:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-385ba618-9b83-495b-a4cc-0bf97a42a5bd" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:45:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-385ba618-9b83-495b-a4cc-0bf97a42a5bd" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:45:14 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:45:14 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Updating instance_info_cache with network_info: [{"id": "ff742757-23c2-49c2-a57c-535307cbbb36", "address": "fa:16:3e:1c:1a:4f", "network": {"id": "226b01bc-2d08-43f8-9ba8-2545b12952e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-821526969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f59c99ecbb5c4bfa8444a2fbe224f345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff742757-23", "ovs_interfaceid": "ff742757-23c2-49c2-a57c-535307cbbb36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:45:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-385ba618-9b83-495b-a4cc-0bf97a42a5bd" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:45:14 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:45:14 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:45:15 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:45:15 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:45:17 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:45:18 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:45:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:45:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:45:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:45:18 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:45:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5f1f2eb-61af-4fe2-b805-b951e71d47bb/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:45:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5f1f2eb-61af-4fe2-b805-b951e71d47bb/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:45:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5f1f2eb-61af-4fe2-b805-b951e71d47bb/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:45:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:45:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5f1f2eb-61af-4fe2-b805-b951e71d47bb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:45:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:45:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:45:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:45:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:45:19 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:45:19 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:45:19 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=8678MB free_disk=25.055774688720703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:45:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:45:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:45:19 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 385ba618-9b83-495b-a4cc-0bf97a42a5bd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:45:19 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance d5f1f2eb-61af-4fe2-b805-b951e71d47bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:45:19 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:45:19 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:45:19 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:45:19 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:45:19 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:45:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:45:20 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:45:21 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:45:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:45:24 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:45:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:45:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:45:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:45:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:45:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:45:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:45:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:45:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:45:38 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:45:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-50ed9a4f-d8bc-4f1a-b233-f9ccfca9b272 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Acquiring lock "d5f1f2eb-61af-4fe2-b805-b951e71d47bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:45:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-50ed9a4f-d8bc-4f1a-b233-f9ccfca9b272 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lock "d5f1f2eb-61af-4fe2-b805-b951e71d47bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:45:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-50ed9a4f-d8bc-4f1a-b233-f9ccfca9b272 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Acquiring lock "d5f1f2eb-61af-4fe2-b805-b951e71d47bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:45:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-50ed9a4f-d8bc-4f1a-b233-f9ccfca9b272 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lock "d5f1f2eb-61af-4fe2-b805-b951e71d47bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:45:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-50ed9a4f-d8bc-4f1a-b233-f9ccfca9b272 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lock "d5f1f2eb-61af-4fe2-b805-b951e71d47bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:45:40 user nova-compute[73078]: INFO nova.compute.manager [None req-50ed9a4f-d8bc-4f1a-b233-f9ccfca9b272 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Terminating instance
Aug 14 18:45:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-50ed9a4f-d8bc-4f1a-b233-f9ccfca9b272 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:45:40 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:45:40 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:45:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:45:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:45:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:45:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:45:41 user nova-compute[73078]: DEBUG nova.compute.manager [req-5ab449cb-1d79-499d-be9e-1850c4cf38fa req-65259b80-f84e-4f06-8ea1-2c57e09ba3b7 service nova] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Received event network-vif-unplugged-8162f193-8c90-4b8b-8e9f-824dfdf70b10 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:45:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5ab449cb-1d79-499d-be9e-1850c4cf38fa req-65259b80-f84e-4f06-8ea1-2c57e09ba3b7 service nova] Acquiring lock "d5f1f2eb-61af-4fe2-b805-b951e71d47bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:45:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5ab449cb-1d79-499d-be9e-1850c4cf38fa req-65259b80-f84e-4f06-8ea1-2c57e09ba3b7 service nova] Lock "d5f1f2eb-61af-4fe2-b805-b951e71d47bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:45:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-5ab449cb-1d79-499d-be9e-1850c4cf38fa req-65259b80-f84e-4f06-8ea1-2c57e09ba3b7 service nova] Lock "d5f1f2eb-61af-4fe2-b805-b951e71d47bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:45:41 user nova-compute[73078]: DEBUG nova.compute.manager [req-5ab449cb-1d79-499d-be9e-1850c4cf38fa req-65259b80-f84e-4f06-8ea1-2c57e09ba3b7 service nova] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] No waiting events found dispatching network-vif-unplugged-8162f193-8c90-4b8b-8e9f-824dfdf70b10 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:45:41 user nova-compute[73078]: DEBUG nova.compute.manager [req-5ab449cb-1d79-499d-be9e-1850c4cf38fa req-65259b80-f84e-4f06-8ea1-2c57e09ba3b7 service nova] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Received event network-vif-unplugged-8162f193-8c90-4b8b-8e9f-824dfdf70b10 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:45:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:45:41 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Instance destroyed successfully.
Aug 14 18:45:41 user nova-compute[73078]: DEBUG nova.objects.instance [None req-50ed9a4f-d8bc-4f1a-b233-f9ccfca9b272 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lazy-loading 'resources' on Instance uuid d5f1f2eb-61af-4fe2-b805-b951e71d47bb {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:45:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-50ed9a4f-d8bc-4f1a-b233-f9ccfca9b272 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:43:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1619377023',display_name='tempest-ServersNegativeTestJSON-server-1619377023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1619377023',id=50,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:43:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f59c99ecbb5c4bfa8444a2fbe224f345',ramdisk_id='',reservation_id='r-8vp5le5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1030825811',owner_user_name='tempest-ServersNegativeTestJSON-1030825811-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:43:57Z,user_data=None,user_id='1a94313076234222b07cbcb8ed97fc30',uuid=d5f1f2eb-61af-4fe2-b805-b951e71d47bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8162f193-8c90-4b8b-8e9f-824dfdf70b10", "address": "fa:16:3e:83:5a:fa", "network": {"id": "226b01bc-2d08-43f8-9ba8-2545b12952e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-821526969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f59c99ecbb5c4bfa8444a2fbe224f345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8162f193-8c", "ovs_interfaceid": "8162f193-8c90-4b8b-8e9f-824dfdf70b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:45:41 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-50ed9a4f-d8bc-4f1a-b233-f9ccfca9b272 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Converting VIF {"id": "8162f193-8c90-4b8b-8e9f-824dfdf70b10", "address": "fa:16:3e:83:5a:fa", "network": {"id": "226b01bc-2d08-43f8-9ba8-2545b12952e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-821526969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f59c99ecbb5c4bfa8444a2fbe224f345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8162f193-8c", "ovs_interfaceid": "8162f193-8c90-4b8b-8e9f-824dfdf70b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:45:41 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-50ed9a4f-d8bc-4f1a-b233-f9ccfca9b272 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:5a:fa,bridge_name='br-int',has_traffic_filtering=True,id=8162f193-8c90-4b8b-8e9f-824dfdf70b10,network=Network(226b01bc-2d08-43f8-9ba8-2545b12952e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8162f193-8c') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:45:41 user nova-compute[73078]: DEBUG os_vif [None req-50ed9a4f-d8bc-4f1a-b233-f9ccfca9b272 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:5a:fa,bridge_name='br-int',has_traffic_filtering=True,id=8162f193-8c90-4b8b-8e9f-824dfdf70b10,network=Network(226b01bc-2d08-43f8-9ba8-2545b12952e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8162f193-8c') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:45:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:45:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8162f193-8c, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:45:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:45:41 user nova-compute[73078]: INFO os_vif [None req-50ed9a4f-d8bc-4f1a-b233-f9ccfca9b272 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:5a:fa,bridge_name='br-int',has_traffic_filtering=True,id=8162f193-8c90-4b8b-8e9f-824dfdf70b10,network=Network(226b01bc-2d08-43f8-9ba8-2545b12952e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8162f193-8c')
Aug 14 18:45:41 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-50ed9a4f-d8bc-4f1a-b233-f9ccfca9b272 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Deleting instance files /opt/stack/data/nova/instances/d5f1f2eb-61af-4fe2-b805-b951e71d47bb_del
Aug 14 18:45:41 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-50ed9a4f-d8bc-4f1a-b233-f9ccfca9b272 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Deletion of /opt/stack/data/nova/instances/d5f1f2eb-61af-4fe2-b805-b951e71d47bb_del complete
Aug 14 18:45:41 user nova-compute[73078]: INFO nova.compute.manager [None req-50ed9a4f-d8bc-4f1a-b233-f9ccfca9b272 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Took 0.73 seconds to destroy the instance on the hypervisor.
Aug 14 18:45:41 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-50ed9a4f-d8bc-4f1a-b233-f9ccfca9b272 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:45:41 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:45:41 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:45:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:45:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:45:42 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:45:42 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Took 0.53 seconds to deallocate network for instance.
Aug 14 18:45:42 user nova-compute[73078]: DEBUG nova.compute.manager [req-152c8c35-8b42-4291-8e7b-0aaf0b5782ac req-8e938640-8f29-4f1e-845a-5e9d975425d7 service nova] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Received event network-vif-deleted-8162f193-8c90-4b8b-8e9f-824dfdf70b10 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:45:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-50ed9a4f-d8bc-4f1a-b233-f9ccfca9b272 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:45:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-50ed9a4f-d8bc-4f1a-b233-f9ccfca9b272 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:45:42 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-50ed9a4f-d8bc-4f1a-b233-f9ccfca9b272 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:45:42 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-50ed9a4f-d8bc-4f1a-b233-f9ccfca9b272 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:45:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-50ed9a4f-d8bc-4f1a-b233-f9ccfca9b272 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.126s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:45:42 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-50ed9a4f-d8bc-4f1a-b233-f9ccfca9b272 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Deleted allocations for instance d5f1f2eb-61af-4fe2-b805-b951e71d47bb
Aug 14 18:45:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-50ed9a4f-d8bc-4f1a-b233-f9ccfca9b272 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lock "d5f1f2eb-61af-4fe2-b805-b951e71d47bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.579s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:45:43 user nova-compute[73078]: DEBUG nova.compute.manager [req-78e95ec9-b479-4abb-97c1-1be3c54b42f2 req-7d6ec40f-19af-47af-8c68-a1cbd4a4fd4d service nova] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Received event network-vif-plugged-8162f193-8c90-4b8b-8e9f-824dfdf70b10 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:45:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-78e95ec9-b479-4abb-97c1-1be3c54b42f2 req-7d6ec40f-19af-47af-8c68-a1cbd4a4fd4d service nova] Acquiring lock "d5f1f2eb-61af-4fe2-b805-b951e71d47bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:45:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-78e95ec9-b479-4abb-97c1-1be3c54b42f2 req-7d6ec40f-19af-47af-8c68-a1cbd4a4fd4d service nova] Lock "d5f1f2eb-61af-4fe2-b805-b951e71d47bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:45:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-78e95ec9-b479-4abb-97c1-1be3c54b42f2 req-7d6ec40f-19af-47af-8c68-a1cbd4a4fd4d service nova] Lock "d5f1f2eb-61af-4fe2-b805-b951e71d47bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:45:43 user nova-compute[73078]: DEBUG nova.compute.manager [req-78e95ec9-b479-4abb-97c1-1be3c54b42f2 req-7d6ec40f-19af-47af-8c68-a1cbd4a4fd4d service nova] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] No waiting events found dispatching network-vif-plugged-8162f193-8c90-4b8b-8e9f-824dfdf70b10 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:45:43 user nova-compute[73078]: WARNING nova.compute.manager [req-78e95ec9-b479-4abb-97c1-1be3c54b42f2 req-7d6ec40f-19af-47af-8c68-a1cbd4a4fd4d service nova] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Received unexpected event network-vif-plugged-8162f193-8c90-4b8b-8e9f-824dfdf70b10 for instance with vm_state deleted and task_state None.
Aug 14 18:45:43 user nova-compute[73078]: DEBUG nova.compute.manager [req-78e95ec9-b479-4abb-97c1-1be3c54b42f2 req-7d6ec40f-19af-47af-8c68-a1cbd4a4fd4d service nova] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Received event network-vif-plugged-8162f193-8c90-4b8b-8e9f-824dfdf70b10 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:45:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-78e95ec9-b479-4abb-97c1-1be3c54b42f2 req-7d6ec40f-19af-47af-8c68-a1cbd4a4fd4d service nova] Acquiring lock "d5f1f2eb-61af-4fe2-b805-b951e71d47bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:45:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-78e95ec9-b479-4abb-97c1-1be3c54b42f2 req-7d6ec40f-19af-47af-8c68-a1cbd4a4fd4d service nova] Lock "d5f1f2eb-61af-4fe2-b805-b951e71d47bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:45:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-78e95ec9-b479-4abb-97c1-1be3c54b42f2 req-7d6ec40f-19af-47af-8c68-a1cbd4a4fd4d service nova] Lock "d5f1f2eb-61af-4fe2-b805-b951e71d47bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:45:43 user nova-compute[73078]: DEBUG nova.compute.manager [req-78e95ec9-b479-4abb-97c1-1be3c54b42f2 req-7d6ec40f-19af-47af-8c68-a1cbd4a4fd4d service nova] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] No waiting events found dispatching network-vif-plugged-8162f193-8c90-4b8b-8e9f-824dfdf70b10 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:45:43 user nova-compute[73078]: WARNING nova.compute.manager [req-78e95ec9-b479-4abb-97c1-1be3c54b42f2 req-7d6ec40f-19af-47af-8c68-a1cbd4a4fd4d service nova] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Received unexpected event network-vif-plugged-8162f193-8c90-4b8b-8e9f-824dfdf70b10 for instance with vm_state deleted and task_state None.
Aug 14 18:45:43 user nova-compute[73078]: DEBUG nova.compute.manager [req-78e95ec9-b479-4abb-97c1-1be3c54b42f2 req-7d6ec40f-19af-47af-8c68-a1cbd4a4fd4d service nova] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Received event network-vif-plugged-8162f193-8c90-4b8b-8e9f-824dfdf70b10 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:45:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-78e95ec9-b479-4abb-97c1-1be3c54b42f2 req-7d6ec40f-19af-47af-8c68-a1cbd4a4fd4d service nova] Acquiring lock "d5f1f2eb-61af-4fe2-b805-b951e71d47bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:45:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-78e95ec9-b479-4abb-97c1-1be3c54b42f2 req-7d6ec40f-19af-47af-8c68-a1cbd4a4fd4d service nova] Lock "d5f1f2eb-61af-4fe2-b805-b951e71d47bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:45:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-78e95ec9-b479-4abb-97c1-1be3c54b42f2 req-7d6ec40f-19af-47af-8c68-a1cbd4a4fd4d service nova] Lock "d5f1f2eb-61af-4fe2-b805-b951e71d47bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:45:43 user nova-compute[73078]: DEBUG nova.compute.manager [req-78e95ec9-b479-4abb-97c1-1be3c54b42f2 req-7d6ec40f-19af-47af-8c68-a1cbd4a4fd4d service nova] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] No waiting events found dispatching network-vif-plugged-8162f193-8c90-4b8b-8e9f-824dfdf70b10 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:45:43 user nova-compute[73078]: WARNING nova.compute.manager [req-78e95ec9-b479-4abb-97c1-1be3c54b42f2 req-7d6ec40f-19af-47af-8c68-a1cbd4a4fd4d service nova] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Received unexpected event network-vif-plugged-8162f193-8c90-4b8b-8e9f-824dfdf70b10 for instance with vm_state deleted and task_state None.
Aug 14 18:45:43 user nova-compute[73078]: DEBUG nova.compute.manager [req-78e95ec9-b479-4abb-97c1-1be3c54b42f2 req-7d6ec40f-19af-47af-8c68-a1cbd4a4fd4d service nova] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Received event network-vif-plugged-8162f193-8c90-4b8b-8e9f-824dfdf70b10 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:45:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-78e95ec9-b479-4abb-97c1-1be3c54b42f2 req-7d6ec40f-19af-47af-8c68-a1cbd4a4fd4d service nova] Acquiring lock "d5f1f2eb-61af-4fe2-b805-b951e71d47bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:45:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-78e95ec9-b479-4abb-97c1-1be3c54b42f2 req-7d6ec40f-19af-47af-8c68-a1cbd4a4fd4d service nova] Lock "d5f1f2eb-61af-4fe2-b805-b951e71d47bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:45:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-78e95ec9-b479-4abb-97c1-1be3c54b42f2 req-7d6ec40f-19af-47af-8c68-a1cbd4a4fd4d service nova] Lock "d5f1f2eb-61af-4fe2-b805-b951e71d47bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:45:43 user nova-compute[73078]: DEBUG nova.compute.manager [req-78e95ec9-b479-4abb-97c1-1be3c54b42f2 req-7d6ec40f-19af-47af-8c68-a1cbd4a4fd4d service nova] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] No waiting events found dispatching network-vif-plugged-8162f193-8c90-4b8b-8e9f-824dfdf70b10 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:45:43 user nova-compute[73078]: WARNING nova.compute.manager [req-78e95ec9-b479-4abb-97c1-1be3c54b42f2 req-7d6ec40f-19af-47af-8c68-a1cbd4a4fd4d service nova] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Received unexpected event network-vif-plugged-8162f193-8c90-4b8b-8e9f-824dfdf70b10 for instance with vm_state deleted and task_state None.
Aug 14 18:45:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:45:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:45:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:45:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:45:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:45:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:45:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:45:56 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692038741.3605957, d5f1f2eb-61af-4fe2-b805-b951e71d47bb => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:45:56 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] VM Stopped (Lifecycle Event)
Aug 14 18:45:56 user nova-compute[73078]: DEBUG nova.compute.manager [None req-55ae4bc6-3c6a-44d4-a937-bfa4f4ae61ba None None] [instance: d5f1f2eb-61af-4fe2-b805-b951e71d47bb] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:45:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:45:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:45:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:45:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:45:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:45:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:46:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:46:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:46:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:46:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:46:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:46:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:46:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:46:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:46:13 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:46:14 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:46:14 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:46:14 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Didn't find any instances for network info cache update. {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 18:46:16 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:46:16 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:46:16 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:46:16 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:46:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:46:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:46:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:46:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:46:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:46:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:46:18 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:46:18 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:46:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:46:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:46:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:46:18 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:46:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:46:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:46:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:46:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:46:18 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:46:18 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:46:18 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=8754MB free_disk=25.07372283935547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:46:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:46:18 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:46:19 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 385ba618-9b83-495b-a4cc-0bf97a42a5bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:46:19 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:46:19 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:46:19 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:46:19 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:46:19 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:46:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:46:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:46:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:46:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:46:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:46:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:46:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:46:22 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:46:23 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:46:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:46:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:46:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:46:38 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:46:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:46:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:46:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:46:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:46:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:46:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:46:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.imagecache [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Verify base images {{(pid=73078) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 14 18:46:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.imagecache [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Image id 2cbd52c4-773f-4d5a-bbb1-b6f1221c7774 yields fingerprint 4bff63acd8bd6525c97e2d6e93ed608c71468fdd {{(pid=73078) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 14 18:46:38 user nova-compute[73078]: INFO nova.virt.libvirt.imagecache [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] image 2cbd52c4-773f-4d5a-bbb1-b6f1221c7774 at (/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd): checking
Aug 14 18:46:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.imagecache [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] image 2cbd52c4-773f-4d5a-bbb1-b6f1221c7774 at (/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd): image is in use {{(pid=73078) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 14 18:46:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.imagecache [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=73078) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 14 18:46:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.imagecache [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] 385ba618-9b83-495b-a4cc-0bf97a42a5bd is a valid instance name {{(pid=73078) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 14 18:46:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.imagecache [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] 385ba618-9b83-495b-a4cc-0bf97a42a5bd has a disk file {{(pid=73078) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 14 18:46:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:46:38 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:46:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.imagecache [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 385ba618-9b83-495b-a4cc-0bf97a42a5bd is backed by 4bff63acd8bd6525c97e2d6e93ed608c71468fdd {{(pid=73078) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 14 18:46:38 user nova-compute[73078]: WARNING nova.virt.libvirt.imagecache [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/16282be22f542c7126797c3e95ff4ffc4ca522b2
Aug 14 18:46:38 user nova-compute[73078]: WARNING nova.virt.libvirt.imagecache [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/dce954bcb987737be8c6c5fc1e5c1a74d5f40f18
Aug 14 18:46:38 user nova-compute[73078]: WARNING nova.virt.libvirt.imagecache [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/568fabfab401eb06d37ca3f3d52e2452384ffc5e
Aug 14 18:46:38 user nova-compute[73078]: WARNING nova.virt.libvirt.imagecache [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3892430236df3abc02187add29a19081a4fd6a74
Aug 14 18:46:38 user nova-compute[73078]: WARNING nova.virt.libvirt.imagecache [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/106c9f2ab5e54121307d9496129f8719d41141a2
Aug 14 18:46:38 user nova-compute[73078]: WARNING nova.virt.libvirt.imagecache [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ec7b1abca4d0e6ba0d98bb0e5a30edc2d662df94
Aug 14 18:46:38 user nova-compute[73078]: WARNING nova.virt.libvirt.imagecache [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/7525cdc2f4a31c89032b5077a27a0a9b409a3807
Aug 14 18:46:38 user nova-compute[73078]: WARNING nova.virt.libvirt.imagecache [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a25ee279ecedc5aaaa5279e162d8199454606a0e
Aug 14 18:46:38 user nova-compute[73078]: WARNING nova.virt.libvirt.imagecache [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3e47c6043e6ea1ea6e66cb3fba74c3aa1a55be25
Aug 14 18:46:38 user nova-compute[73078]: INFO nova.virt.libvirt.imagecache [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Active base files: /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd
Aug 14 18:46:38 user nova-compute[73078]: INFO nova.virt.libvirt.imagecache [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Removable base files: /opt/stack/data/nova/instances/_base/16282be22f542c7126797c3e95ff4ffc4ca522b2 /opt/stack/data/nova/instances/_base/dce954bcb987737be8c6c5fc1e5c1a74d5f40f18 /opt/stack/data/nova/instances/_base/568fabfab401eb06d37ca3f3d52e2452384ffc5e /opt/stack/data/nova/instances/_base/3892430236df3abc02187add29a19081a4fd6a74 /opt/stack/data/nova/instances/_base/106c9f2ab5e54121307d9496129f8719d41141a2 /opt/stack/data/nova/instances/_base/ec7b1abca4d0e6ba0d98bb0e5a30edc2d662df94 /opt/stack/data/nova/instances/_base/7525cdc2f4a31c89032b5077a27a0a9b409a3807 /opt/stack/data/nova/instances/_base/a25ee279ecedc5aaaa5279e162d8199454606a0e /opt/stack/data/nova/instances/_base/3e47c6043e6ea1ea6e66cb3fba74c3aa1a55be25
Aug 14 18:46:38 user nova-compute[73078]: INFO nova.virt.libvirt.imagecache [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/16282be22f542c7126797c3e95ff4ffc4ca522b2
Aug 14 18:46:38 user nova-compute[73078]: INFO nova.virt.libvirt.imagecache [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/dce954bcb987737be8c6c5fc1e5c1a74d5f40f18
Aug 14 18:46:38 user nova-compute[73078]: INFO nova.virt.libvirt.imagecache [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/568fabfab401eb06d37ca3f3d52e2452384ffc5e
Aug 14 18:46:38 user nova-compute[73078]: INFO nova.virt.libvirt.imagecache [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3892430236df3abc02187add29a19081a4fd6a74
Aug 14 18:46:38 user nova-compute[73078]: INFO nova.virt.libvirt.imagecache [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/106c9f2ab5e54121307d9496129f8719d41141a2
Aug 14 18:46:38 user nova-compute[73078]: INFO nova.virt.libvirt.imagecache [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ec7b1abca4d0e6ba0d98bb0e5a30edc2d662df94
Aug 14 18:46:38 user nova-compute[73078]: INFO nova.virt.libvirt.imagecache [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7525cdc2f4a31c89032b5077a27a0a9b409a3807
Aug 14 18:46:38 user nova-compute[73078]: INFO nova.virt.libvirt.imagecache [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a25ee279ecedc5aaaa5279e162d8199454606a0e
Aug 14 18:46:38 user nova-compute[73078]: INFO nova.virt.libvirt.imagecache [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3e47c6043e6ea1ea6e66cb3fba74c3aa1a55be25
Aug 14 18:46:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.imagecache [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Verification complete {{(pid=73078) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 14 18:46:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.imagecache [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Verify swap images {{(pid=73078) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 14 18:46:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.imagecache [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Verify ephemeral images {{(pid=73078) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 14 18:46:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:46:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:46:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:46:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:46:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:46:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:46:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:46:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:46:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:46:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:46:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:46:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:46:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:46:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:46:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:47:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:47:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:47:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:47:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:47:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:47:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:47:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:47:11 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:47:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:47:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:47:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:47:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:47:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:47:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:47:14 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:47:14 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:47:14 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Rebuilding the list of instances to heal {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 18:47:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-385ba618-9b83-495b-a4cc-0bf97a42a5bd" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:47:14 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-385ba618-9b83-495b-a4cc-0bf97a42a5bd" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:47:14 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:47:14 user nova-compute[73078]: DEBUG nova.objects.instance [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lazy-loading 'info_cache' on Instance uuid 385ba618-9b83-495b-a4cc-0bf97a42a5bd {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:47:15 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Updating instance_info_cache with network_info: [{"id": "ff742757-23c2-49c2-a57c-535307cbbb36", "address": "fa:16:3e:1c:1a:4f", "network": {"id": "226b01bc-2d08-43f8-9ba8-2545b12952e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-821526969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f59c99ecbb5c4bfa8444a2fbe224f345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff742757-23", "ovs_interfaceid": "ff742757-23c2-49c2-a57c-535307cbbb36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:47:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-385ba618-9b83-495b-a4cc-0bf97a42a5bd" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:47:15 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:47:15 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:47:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:47:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:47:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:47:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:47:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:47:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:47:17 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:47:17 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:47:18 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:47:18 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:47:19 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:47:19 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:47:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:47:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:47:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:47:19 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:47:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:47:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:47:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:47:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:47:19 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:47:19 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:47:19 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=8767MB free_disk=25.071945190429688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:47:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:47:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:47:20 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 385ba618-9b83-495b-a4cc-0bf97a42a5bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:47:20 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:47:20 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:47:20 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Refreshing inventories for resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 18:47:20 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Updating ProviderTree inventory for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 18:47:20 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Updating inventory in ProviderTree for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 18:47:20 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Refreshing aggregate associations for resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b, aggregates: None {{(pid=73078) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 18:47:20 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Refreshing trait associations for resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV {{(pid=73078) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 18:47:20 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:47:20 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:47:20 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:47:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.467s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:47:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:47:23 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:47:23 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:47:23 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Triggering sync for uuid 385ba618-9b83-495b-a4cc-0bf97a42a5bd {{(pid=73078) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 18:47:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "385ba618-9b83-495b-a4cc-0bf97a42a5bd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:47:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "385ba618-9b83-495b-a4cc-0bf97a42a5bd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:47:23 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:47:23 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Cleaning up deleted instances {{(pid=73078) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 18:47:23 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] There are 0 instances to clean {{(pid=73078) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 18:47:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "385ba618-9b83-495b-a4cc-0bf97a42a5bd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:47:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:47:25 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:47:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:47:28 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:47:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:47:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:47:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:47:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:47:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:47:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:47:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:47:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:47:46 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:47:46 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73078) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 18:47:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:47:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:47:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:47:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:47:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:47:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:47:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:47:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:47:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:47:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:47:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:47:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:47:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:47:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:48:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:48:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:48:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:48:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:48:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:48:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:48:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:48:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:48:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:48:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:48:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:48:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:48:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:48:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:48:15 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:48:15 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:48:15 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Rebuilding the list of instances to heal {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 18:48:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-385ba618-9b83-495b-a4cc-0bf97a42a5bd" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:48:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-385ba618-9b83-495b-a4cc-0bf97a42a5bd" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:48:15 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:48:15 user nova-compute[73078]: DEBUG nova.objects.instance [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lazy-loading 'info_cache' on Instance uuid 385ba618-9b83-495b-a4cc-0bf97a42a5bd {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:48:15 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Updating instance_info_cache with network_info: [{"id": "ff742757-23c2-49c2-a57c-535307cbbb36", "address": "fa:16:3e:1c:1a:4f", "network": {"id": "226b01bc-2d08-43f8-9ba8-2545b12952e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-821526969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f59c99ecbb5c4bfa8444a2fbe224f345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff742757-23", "ovs_interfaceid": "ff742757-23c2-49c2-a57c-535307cbbb36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:48:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-385ba618-9b83-495b-a4cc-0bf97a42a5bd" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:48:15 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:48:15 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:48:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:48:17 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:48:18 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:48:19 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:48:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:48:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:48:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:48:19 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:48:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:48:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:48:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:48:19 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:48:19 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:48:19 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:48:19 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=8819MB free_disk=25.070064544677734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:48:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:48:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:48:20 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 385ba618-9b83-495b-a4cc-0bf97a42a5bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:48:20 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:48:20 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:48:20 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:48:20 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:48:20 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:48:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:48:21 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:48:21 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:48:21 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:48:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:48:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:48:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:48:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:48:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:48:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:48:24 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:48:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:48:27 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:48:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:48:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:48:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:48:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:48:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:48:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:48:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:48:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:48:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:48:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:48:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:49:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:49:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:49:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:49:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:49:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:49:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:49:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:49:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:49:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:49:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:49:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:49:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:49:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:49:16 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:49:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:49:17 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:49:17 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:49:17 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:49:17 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Rebuilding the list of instances to heal {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 18:49:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-385ba618-9b83-495b-a4cc-0bf97a42a5bd" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:49:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-385ba618-9b83-495b-a4cc-0bf97a42a5bd" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:49:17 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:49:17 user nova-compute[73078]: DEBUG nova.objects.instance [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lazy-loading 'info_cache' on Instance uuid 385ba618-9b83-495b-a4cc-0bf97a42a5bd {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:49:17 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Updating instance_info_cache with network_info: [{"id": "ff742757-23c2-49c2-a57c-535307cbbb36", "address": "fa:16:3e:1c:1a:4f", "network": {"id": "226b01bc-2d08-43f8-9ba8-2545b12952e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-821526969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f59c99ecbb5c4bfa8444a2fbe224f345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff742757-23", "ovs_interfaceid": "ff742757-23c2-49c2-a57c-535307cbbb36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:49:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-385ba618-9b83-495b-a4cc-0bf97a42a5bd" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:49:17 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:49:20 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:49:20 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:49:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:49:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:49:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:49:20 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:49:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:49:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:49:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:49:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:49:20 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:49:20 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:49:20 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=8820MB free_disk=25.069477081298828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:49:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:49:20 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:49:21 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 385ba618-9b83-495b-a4cc-0bf97a42a5bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:49:21 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:49:21 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:49:21 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:49:21 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:49:21 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:49:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:49:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:49:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:49:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:49:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:49:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:49:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:49:22 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:49:22 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:49:22 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:49:25 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:49:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:49:27 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:49:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:49:32 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:49:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:49:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:49:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:49:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:49:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:50:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:50:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:50:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:50:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:50:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:50:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:50:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:50:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:50:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:50:17 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:50:17 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:50:19 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:50:19 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:50:19 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Rebuilding the list of instances to heal {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 18:50:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-385ba618-9b83-495b-a4cc-0bf97a42a5bd" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:50:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-385ba618-9b83-495b-a4cc-0bf97a42a5bd" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:50:19 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:50:19 user nova-compute[73078]: DEBUG nova.objects.instance [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lazy-loading 'info_cache' on Instance uuid 385ba618-9b83-495b-a4cc-0bf97a42a5bd {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:50:19 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Updating instance_info_cache with network_info: [{"id": "ff742757-23c2-49c2-a57c-535307cbbb36", "address": "fa:16:3e:1c:1a:4f", "network": {"id": "226b01bc-2d08-43f8-9ba8-2545b12952e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-821526969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f59c99ecbb5c4bfa8444a2fbe224f345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff742757-23", "ovs_interfaceid": "ff742757-23c2-49c2-a57c-535307cbbb36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:50:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-385ba618-9b83-495b-a4cc-0bf97a42a5bd" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:50:19 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:50:20 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:50:21 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:50:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:50:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:50:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:50:21 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:50:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:50:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:50:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:50:21 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:50:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:50:21 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:50:21 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:50:21 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=8825MB free_disk=25.068851470947266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:50:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:50:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:50:21 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 385ba618-9b83-495b-a4cc-0bf97a42a5bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:50:21 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:50:21 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:50:22 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:50:22 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:50:22 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:50:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:50:23 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:50:23 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:50:23 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:50:25 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:50:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:50:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:50:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:50:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:50:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:50:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:50:28 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:50:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:50:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:50:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:50:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:50:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:50:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:50:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:50:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:50:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:50:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:50:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:50:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:50:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:50:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:50:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:50:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-af294783-88c9-4f07-82b5-6ce4939ee174 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Acquiring lock "385ba618-9b83-495b-a4cc-0bf97a42a5bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:50:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-af294783-88c9-4f07-82b5-6ce4939ee174 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lock "385ba618-9b83-495b-a4cc-0bf97a42a5bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:50:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-af294783-88c9-4f07-82b5-6ce4939ee174 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Acquiring lock "385ba618-9b83-495b-a4cc-0bf97a42a5bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:50:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-af294783-88c9-4f07-82b5-6ce4939ee174 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lock "385ba618-9b83-495b-a4cc-0bf97a42a5bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:50:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-af294783-88c9-4f07-82b5-6ce4939ee174 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lock "385ba618-9b83-495b-a4cc-0bf97a42a5bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:50:53 user nova-compute[73078]: INFO nova.compute.manager [None req-af294783-88c9-4f07-82b5-6ce4939ee174 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Terminating instance
Aug 14 18:50:53 user nova-compute[73078]: DEBUG nova.compute.manager [None req-af294783-88c9-4f07-82b5-6ce4939ee174 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:50:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:50:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:50:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:50:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:50:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:50:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:50:54 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Instance destroyed successfully.
Aug 14 18:50:54 user nova-compute[73078]: DEBUG nova.objects.instance [None req-af294783-88c9-4f07-82b5-6ce4939ee174 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lazy-loading 'resources' on Instance uuid 385ba618-9b83-495b-a4cc-0bf97a42a5bd {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:50:54 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-af294783-88c9-4f07-82b5-6ce4939ee174 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:41:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1955229464',display_name='tempest-ServersNegativeTestJSON-server-1955229464',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1955229464',id=49,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:42:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f59c99ecbb5c4bfa8444a2fbe224f345',ramdisk_id='',reservation_id='r-n5e62qsn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1030825811',owner_user_name='tempest-ServersNegativeTestJSON-1030825811-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:42:06Z,user_data=None,user_id='1a94313076234222b07cbcb8ed97fc30',uuid=385ba618-9b83-495b-a4cc-0bf97a42a5bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff742757-23c2-49c2-a57c-535307cbbb36", "address": "fa:16:3e:1c:1a:4f", "network": {"id": "226b01bc-2d08-43f8-9ba8-2545b12952e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-821526969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f59c99ecbb5c4bfa8444a2fbe224f345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff742757-23", "ovs_interfaceid": "ff742757-23c2-49c2-a57c-535307cbbb36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:50:54 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-af294783-88c9-4f07-82b5-6ce4939ee174 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Converting VIF {"id": "ff742757-23c2-49c2-a57c-535307cbbb36", "address": "fa:16:3e:1c:1a:4f", "network": {"id": "226b01bc-2d08-43f8-9ba8-2545b12952e8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-821526969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f59c99ecbb5c4bfa8444a2fbe224f345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff742757-23", "ovs_interfaceid": "ff742757-23c2-49c2-a57c-535307cbbb36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:50:54 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-af294783-88c9-4f07-82b5-6ce4939ee174 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:1a:4f,bridge_name='br-int',has_traffic_filtering=True,id=ff742757-23c2-49c2-a57c-535307cbbb36,network=Network(226b01bc-2d08-43f8-9ba8-2545b12952e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff742757-23') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:50:54 user nova-compute[73078]: DEBUG os_vif [None req-af294783-88c9-4f07-82b5-6ce4939ee174 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:1a:4f,bridge_name='br-int',has_traffic_filtering=True,id=ff742757-23c2-49c2-a57c-535307cbbb36,network=Network(226b01bc-2d08-43f8-9ba8-2545b12952e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff742757-23') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:50:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:50:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff742757-23, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:50:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:50:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:50:54 user nova-compute[73078]: INFO os_vif [None req-af294783-88c9-4f07-82b5-6ce4939ee174 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:1a:4f,bridge_name='br-int',has_traffic_filtering=True,id=ff742757-23c2-49c2-a57c-535307cbbb36,network=Network(226b01bc-2d08-43f8-9ba8-2545b12952e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff742757-23')
Aug 14 18:50:54 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-af294783-88c9-4f07-82b5-6ce4939ee174 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Deleting instance files /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd_del
Aug 14 18:50:54 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-af294783-88c9-4f07-82b5-6ce4939ee174 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Deletion of /opt/stack/data/nova/instances/385ba618-9b83-495b-a4cc-0bf97a42a5bd_del complete
Aug 14 18:50:54 user nova-compute[73078]: DEBUG nova.compute.manager [req-18c29f79-2e25-49a2-acac-bf829f2a6a50 req-1771896d-8c81-4a90-bf0f-f88dc1442299 service nova] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Received event network-vif-unplugged-ff742757-23c2-49c2-a57c-535307cbbb36 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:50:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-18c29f79-2e25-49a2-acac-bf829f2a6a50 req-1771896d-8c81-4a90-bf0f-f88dc1442299 service nova] Acquiring lock "385ba618-9b83-495b-a4cc-0bf97a42a5bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:50:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-18c29f79-2e25-49a2-acac-bf829f2a6a50 req-1771896d-8c81-4a90-bf0f-f88dc1442299 service nova] Lock "385ba618-9b83-495b-a4cc-0bf97a42a5bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:50:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-18c29f79-2e25-49a2-acac-bf829f2a6a50 req-1771896d-8c81-4a90-bf0f-f88dc1442299 service nova] Lock "385ba618-9b83-495b-a4cc-0bf97a42a5bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:50:54 user nova-compute[73078]: DEBUG nova.compute.manager [req-18c29f79-2e25-49a2-acac-bf829f2a6a50 req-1771896d-8c81-4a90-bf0f-f88dc1442299 service nova] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] No waiting events found dispatching network-vif-unplugged-ff742757-23c2-49c2-a57c-535307cbbb36 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:50:54 user nova-compute[73078]: DEBUG nova.compute.manager [req-18c29f79-2e25-49a2-acac-bf829f2a6a50 req-1771896d-8c81-4a90-bf0f-f88dc1442299 service nova] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Received event network-vif-unplugged-ff742757-23c2-49c2-a57c-535307cbbb36 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:50:54 user nova-compute[73078]: INFO nova.compute.manager [None req-af294783-88c9-4f07-82b5-6ce4939ee174 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 14 18:50:54 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-af294783-88c9-4f07-82b5-6ce4939ee174 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:50:54 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:50:54 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:50:54 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:50:54 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Took 0.49 seconds to deallocate network for instance.
Aug 14 18:50:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-af294783-88c9-4f07-82b5-6ce4939ee174 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:50:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-af294783-88c9-4f07-82b5-6ce4939ee174 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:50:54 user nova-compute[73078]: DEBUG nova.compute.manager [req-e62abfe3-1f50-47d8-8547-17a1ca69fe80 req-fa753c13-0e3a-4f36-aada-11cb0ec7e1d2 service nova] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Received event network-vif-deleted-ff742757-23c2-49c2-a57c-535307cbbb36 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:50:54 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-af294783-88c9-4f07-82b5-6ce4939ee174 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:50:55 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-af294783-88c9-4f07-82b5-6ce4939ee174 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:50:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-af294783-88c9-4f07-82b5-6ce4939ee174 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.170s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:50:55 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-af294783-88c9-4f07-82b5-6ce4939ee174 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Deleted allocations for instance 385ba618-9b83-495b-a4cc-0bf97a42a5bd
Aug 14 18:50:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-af294783-88c9-4f07-82b5-6ce4939ee174 tempest-ServersNegativeTestJSON-1030825811 tempest-ServersNegativeTestJSON-1030825811-project-member] Lock "385ba618-9b83-495b-a4cc-0bf97a42a5bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.688s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:50:56 user nova-compute[73078]: DEBUG nova.compute.manager [req-c696d429-f339-4e6f-88a4-513ecbd413ab req-71997709-6a56-4b2f-a517-e0c172fd4741 service nova] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Received event network-vif-plugged-ff742757-23c2-49c2-a57c-535307cbbb36 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:50:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-c696d429-f339-4e6f-88a4-513ecbd413ab req-71997709-6a56-4b2f-a517-e0c172fd4741 service nova] Acquiring lock "385ba618-9b83-495b-a4cc-0bf97a42a5bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:50:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-c696d429-f339-4e6f-88a4-513ecbd413ab req-71997709-6a56-4b2f-a517-e0c172fd4741 service nova] Lock "385ba618-9b83-495b-a4cc-0bf97a42a5bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:50:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-c696d429-f339-4e6f-88a4-513ecbd413ab req-71997709-6a56-4b2f-a517-e0c172fd4741 service nova] Lock "385ba618-9b83-495b-a4cc-0bf97a42a5bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:50:56 user nova-compute[73078]: DEBUG nova.compute.manager [req-c696d429-f339-4e6f-88a4-513ecbd413ab req-71997709-6a56-4b2f-a517-e0c172fd4741 service nova] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] No waiting events found dispatching network-vif-plugged-ff742757-23c2-49c2-a57c-535307cbbb36 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:50:56 user nova-compute[73078]: WARNING nova.compute.manager [req-c696d429-f339-4e6f-88a4-513ecbd413ab req-71997709-6a56-4b2f-a517-e0c172fd4741 service nova] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Received unexpected event network-vif-plugged-ff742757-23c2-49c2-a57c-535307cbbb36 for instance with vm_state deleted and task_state None.
Aug 14 18:50:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:51:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:51:09 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692039054.2362497, 385ba618-9b83-495b-a4cc-0bf97a42a5bd => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:51:09 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] VM Stopped (Lifecycle Event)
Aug 14 18:51:09 user nova-compute[73078]: DEBUG nova.compute.manager [None req-713567f3-3c10-4e3a-b429-5622800dc1d9 None None] [instance: 385ba618-9b83-495b-a4cc-0bf97a42a5bd] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:51:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:51:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:51:17 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:51:19 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:51:19 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:51:19 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:51:19 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Rebuilding the list of instances to heal {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 18:51:19 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Didn't find any instances for network info cache update. {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 18:51:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:51:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:51:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:51:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:51:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:51:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:51:21 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:51:22 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:51:22 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:51:22 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:51:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:51:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:51:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:51:22 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:51:22 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:51:22 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:51:22 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=8958MB free_disk=25.09591293334961GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:51:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:51:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:51:22 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:51:22 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:51:22 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:51:22 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:51:22 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:51:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:51:23 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:51:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:51:27 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:51:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:51:30 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:51:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:51:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:51:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:51:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:51:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:51:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:51:36 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:51:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:51:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:51:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:51:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:51:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:51:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:51:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:52:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:52:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:52:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:52:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:52:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:52:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:52:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:52:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:52:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:52:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:52:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:52:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:52:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:52:15 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:52:18 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:52:19 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:52:19 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:52:19 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Rebuilding the list of instances to heal {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 18:52:19 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Didn't find any instances for network info cache update. {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 18:52:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:52:21 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:52:23 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:52:23 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:52:23 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:52:23 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:52:23 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:52:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:52:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:52:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:52:23 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:52:23 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:52:23 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:52:23 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=8956MB free_disk=25.093761444091797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:52:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:52:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:52:23 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:52:23 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:52:23 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Refreshing inventories for resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 18:52:23 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Updating ProviderTree inventory for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 18:52:23 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Updating inventory in ProviderTree for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 18:52:23 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Refreshing aggregate associations for resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b, aggregates: None {{(pid=73078) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 18:52:23 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Refreshing trait associations for resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV {{(pid=73078) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 18:52:23 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:52:23 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:52:23 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:52:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.333s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:52:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:52:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:52:29 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:52:32 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:52:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:52:37 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:52:37 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Cleaning up deleted instances {{(pid=73078) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 18:52:37 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] There are 0 instances to clean {{(pid=73078) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 18:52:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:52:43 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:52:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:52:45 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:52:46 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:52:46 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73078) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 18:52:48 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:52:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:52:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:52:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:52:58 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:52:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:52:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Acquiring lock "af7e44d8-9660-4ad2-ab8d-768ea0895138" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:52:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "af7e44d8-9660-4ad2-ab8d-768ea0895138" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:52:59 user nova-compute[73078]: DEBUG nova.compute.manager [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:52:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:52:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:52:59 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:52:59 user nova-compute[73078]: INFO nova.compute.claims [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Claim successful on node user
Aug 14 18:52:59 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:53:00 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:53:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.251s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:53:00 user nova-compute[73078]: DEBUG nova.compute.manager [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:53:00 user nova-compute[73078]: DEBUG nova.compute.manager [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:53:00 user nova-compute[73078]: DEBUG nova.network.neutron [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:53:00 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:53:00 user nova-compute[73078]: DEBUG nova.compute.manager [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:53:00 user nova-compute[73078]: DEBUG nova.compute.manager [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:53:00 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:53:00 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Creating image(s)
Aug 14 18:53:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Acquiring lock "/opt/stack/data/nova/instances/af7e44d8-9660-4ad2-ab8d-768ea0895138/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:53:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "/opt/stack/data/nova/instances/af7e44d8-9660-4ad2-ab8d-768ea0895138/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:53:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "/opt/stack/data/nova/instances/af7e44d8-9660-4ad2-ab8d-768ea0895138/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:53:00 user nova-compute[73078]: DEBUG nova.policy [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '15a80edd010b4455b0fc1c1b87793407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5be577c441b4dc0acb3b76cbb07f877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:53:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:53:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.178s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:53:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:53:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:53:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:53:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.174s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:53:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/af7e44d8-9660-4ad2-ab8d-768ea0895138/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:53:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/af7e44d8-9660-4ad2-ab8d-768ea0895138/disk 1073741824" returned: 0 in 0.047s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:53:00 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:53:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:53:00 user nova-compute[73078]: DEBUG nova.network.neutron [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Successfully created port: 294d49e3-5a68-404e-b1ba-96606361a364 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:53:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.193s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:53:00 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Checking if we can resize image /opt/stack/data/nova/instances/af7e44d8-9660-4ad2-ab8d-768ea0895138/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:53:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af7e44d8-9660-4ad2-ab8d-768ea0895138/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:53:01 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af7e44d8-9660-4ad2-ab8d-768ea0895138/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:53:01 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Cannot resize image /opt/stack/data/nova/instances/af7e44d8-9660-4ad2-ab8d-768ea0895138/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:53:01 user nova-compute[73078]: DEBUG nova.objects.instance [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lazy-loading 'migration_context' on Instance uuid af7e44d8-9660-4ad2-ab8d-768ea0895138 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:53:01 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:53:01 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Ensure instance console log exists: /opt/stack/data/nova/instances/af7e44d8-9660-4ad2-ab8d-768ea0895138/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:53:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:53:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:53:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:53:01 user nova-compute[73078]: DEBUG nova.network.neutron [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Successfully updated port: 294d49e3-5a68-404e-b1ba-96606361a364 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:53:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Acquiring lock "refresh_cache-af7e44d8-9660-4ad2-ab8d-768ea0895138" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:53:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Acquired lock "refresh_cache-af7e44d8-9660-4ad2-ab8d-768ea0895138" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:53:01 user nova-compute[73078]: DEBUG nova.network.neutron [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:53:01 user nova-compute[73078]: DEBUG nova.compute.manager [req-6fcc4500-3761-4816-b482-d945435bd9c3 req-9225cd28-2938-46e0-af5b-9d2754c55974 service nova] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Received event network-changed-294d49e3-5a68-404e-b1ba-96606361a364 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:53:01 user nova-compute[73078]: DEBUG nova.compute.manager [req-6fcc4500-3761-4816-b482-d945435bd9c3 req-9225cd28-2938-46e0-af5b-9d2754c55974 service nova] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Refreshing instance network info cache due to event network-changed-294d49e3-5a68-404e-b1ba-96606361a364. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:53:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6fcc4500-3761-4816-b482-d945435bd9c3 req-9225cd28-2938-46e0-af5b-9d2754c55974 service nova] Acquiring lock "refresh_cache-af7e44d8-9660-4ad2-ab8d-768ea0895138" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:53:01 user nova-compute[73078]: DEBUG nova.network.neutron [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG nova.network.neutron [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Updating instance_info_cache with network_info: [{"id": "294d49e3-5a68-404e-b1ba-96606361a364", "address": "fa:16:3e:15:95:6d", "network": {"id": "4cbde028-e86d-4799-b1f5-4e6e87a4867a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1815397632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5be577c441b4dc0acb3b76cbb07f877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294d49e3-5a", "ovs_interfaceid": "294d49e3-5a68-404e-b1ba-96606361a364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Releasing lock "refresh_cache-af7e44d8-9660-4ad2-ab8d-768ea0895138" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG nova.compute.manager [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Instance network_info: |[{"id": "294d49e3-5a68-404e-b1ba-96606361a364", "address": "fa:16:3e:15:95:6d", "network": {"id": "4cbde028-e86d-4799-b1f5-4e6e87a4867a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1815397632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5be577c441b4dc0acb3b76cbb07f877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294d49e3-5a", "ovs_interfaceid": "294d49e3-5a68-404e-b1ba-96606361a364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6fcc4500-3761-4816-b482-d945435bd9c3 req-9225cd28-2938-46e0-af5b-9d2754c55974 service nova] Acquired lock "refresh_cache-af7e44d8-9660-4ad2-ab8d-768ea0895138" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG nova.network.neutron [req-6fcc4500-3761-4816-b482-d945435bd9c3 req-9225cd28-2938-46e0-af5b-9d2754c55974 service nova] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Refreshing network info cache for port 294d49e3-5a68-404e-b1ba-96606361a364 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Start _get_guest_xml network_info=[{"id": "294d49e3-5a68-404e-b1ba-96606361a364", "address": "fa:16:3e:15:95:6d", "network": {"id": "4cbde028-e86d-4799-b1f5-4e6e87a4867a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1815397632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5be577c441b4dc0acb3b76cbb07f877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294d49e3-5a", "ovs_interfaceid": "294d49e3-5a68-404e-b1ba-96606361a364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:53:02 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:53:02 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:53:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-985202667',display_name='tempest-VolumesSnapshotTestJSON-instance-985202667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-985202667',id=51,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRH4tIs9tzBHTWrh1kLOyvGlI6G8+lWtfvLMIzToT9BbRjhB+DiUmoOusQjjfYltNl2Ih1Pugf/egsVQWVWukdUpcfzGM5Caxk5/amIzkeg3kiJT7EBRD8IEhpFZ5z8+g==',key_name='tempest-keypair-1698335954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5be577c441b4dc0acb3b76cbb07f877',ramdisk_id='',reservation_id='r-ra90migz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1944158015',owner_user_name='tempest-VolumesSnapshotTestJSON-1944158015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:53:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15a80edd010b4455b0fc1c1b87793407',uuid=af7e44d8-9660-4ad2-ab8d-768ea0895138,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "294d49e3-5a68-404e-b1ba-96606361a364", "address": "fa:16:3e:15:95:6d", "network": {"id": "4cbde028-e86d-4799-b1f5-4e6e87a4867a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1815397632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5be577c441b4dc0acb3b76cbb07f877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294d49e3-5a", "ovs_interfaceid": "294d49e3-5a68-404e-b1ba-96606361a364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Converting VIF {"id": "294d49e3-5a68-404e-b1ba-96606361a364", "address": "fa:16:3e:15:95:6d", "network": {"id": "4cbde028-e86d-4799-b1f5-4e6e87a4867a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1815397632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5be577c441b4dc0acb3b76cbb07f877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294d49e3-5a", "ovs_interfaceid": "294d49e3-5a68-404e-b1ba-96606361a364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:95:6d,bridge_name='br-int',has_traffic_filtering=True,id=294d49e3-5a68-404e-b1ba-96606361a364,network=Network(4cbde028-e86d-4799-b1f5-4e6e87a4867a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap294d49e3-5a') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG nova.objects.instance [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lazy-loading 'pci_devices' on Instance uuid af7e44d8-9660-4ad2-ab8d-768ea0895138 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:53:02 user nova-compute[73078]:   <uuid>af7e44d8-9660-4ad2-ab8d-768ea0895138</uuid>
Aug 14 18:53:02 user nova-compute[73078]:   <name>instance-00000033</name>
Aug 14 18:53:02 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:53:02 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:53:02 user nova-compute[73078]:   <metadata>
Aug 14 18:53:02 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:53:02 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:53:02 user nova-compute[73078]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-985202667</nova:name>
Aug 14 18:53:02 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:53:02</nova:creationTime>
Aug 14 18:53:02 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:53:02 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:53:02 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:53:02 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:53:02 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:53:02 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:53:02 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:53:02 user nova-compute[73078]:       <nova:owner>
Aug 14 18:53:02 user nova-compute[73078]:         <nova:user uuid="15a80edd010b4455b0fc1c1b87793407">tempest-VolumesSnapshotTestJSON-1944158015-project-member</nova:user>
Aug 14 18:53:02 user nova-compute[73078]:         <nova:project uuid="d5be577c441b4dc0acb3b76cbb07f877">tempest-VolumesSnapshotTestJSON-1944158015</nova:project>
Aug 14 18:53:02 user nova-compute[73078]:       </nova:owner>
Aug 14 18:53:02 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:53:02 user nova-compute[73078]:       <nova:ports>
Aug 14 18:53:02 user nova-compute[73078]:         <nova:port uuid="294d49e3-5a68-404e-b1ba-96606361a364">
Aug 14 18:53:02 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 18:53:02 user nova-compute[73078]:         </nova:port>
Aug 14 18:53:02 user nova-compute[73078]:       </nova:ports>
Aug 14 18:53:02 user nova-compute[73078]:     </nova:instance>
Aug 14 18:53:02 user nova-compute[73078]:   </metadata>
Aug 14 18:53:02 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:53:02 user nova-compute[73078]:     <system>
Aug 14 18:53:02 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:53:02 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:53:02 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:53:02 user nova-compute[73078]:       <entry name="serial">af7e44d8-9660-4ad2-ab8d-768ea0895138</entry>
Aug 14 18:53:02 user nova-compute[73078]:       <entry name="uuid">af7e44d8-9660-4ad2-ab8d-768ea0895138</entry>
Aug 14 18:53:02 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:53:02 user nova-compute[73078]:     </system>
Aug 14 18:53:02 user nova-compute[73078]:   </sysinfo>
Aug 14 18:53:02 user nova-compute[73078]:   <os>
Aug 14 18:53:02 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:53:02 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:53:02 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:53:02 user nova-compute[73078]:   </os>
Aug 14 18:53:02 user nova-compute[73078]:   <features>
Aug 14 18:53:02 user nova-compute[73078]:     <acpi/>
Aug 14 18:53:02 user nova-compute[73078]:     <apic/>
Aug 14 18:53:02 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:53:02 user nova-compute[73078]:   </features>
Aug 14 18:53:02 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:53:02 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:53:02 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:53:02 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:53:02 user nova-compute[73078]:   </clock>
Aug 14 18:53:02 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:53:02 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:53:02 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:53:02 user nova-compute[73078]:   </cpu>
Aug 14 18:53:02 user nova-compute[73078]:   <devices>
Aug 14 18:53:02 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:53:02 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:53:02 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/af7e44d8-9660-4ad2-ab8d-768ea0895138/disk"/>
Aug 14 18:53:02 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:53:02 user nova-compute[73078]:     </disk>
Aug 14 18:53:02 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:53:02 user nova-compute[73078]:       <mac address="fa:16:3e:15:95:6d"/>
Aug 14 18:53:02 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:53:02 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:53:02 user nova-compute[73078]:       <target dev="tap294d49e3-5a"/>
Aug 14 18:53:02 user nova-compute[73078]:     </interface>
Aug 14 18:53:02 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:53:02 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/af7e44d8-9660-4ad2-ab8d-768ea0895138/console.log" append="off"/>
Aug 14 18:53:02 user nova-compute[73078]:     </serial>
Aug 14 18:53:02 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:53:02 user nova-compute[73078]:     <video>
Aug 14 18:53:02 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:53:02 user nova-compute[73078]:     </video>
Aug 14 18:53:02 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:53:02 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:53:02 user nova-compute[73078]:     </rng>
Aug 14 18:53:02 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:53:02 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:53:02 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:53:02 user nova-compute[73078]:     </memballoon>
Aug 14 18:53:02 user nova-compute[73078]:   </devices>
Aug 14 18:53:02 user nova-compute[73078]: </domain>
Aug 14 18:53:02 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-985202667',display_name='tempest-VolumesSnapshotTestJSON-instance-985202667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-985202667',id=51,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRH4tIs9tzBHTWrh1kLOyvGlI6G8+lWtfvLMIzToT9BbRjhB+DiUmoOusQjjfYltNl2Ih1Pugf/egsVQWVWukdUpcfzGM5Caxk5/amIzkeg3kiJT7EBRD8IEhpFZ5z8+g==',key_name='tempest-keypair-1698335954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5be577c441b4dc0acb3b76cbb07f877',ramdisk_id='',reservation_id='r-ra90migz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1944158015',owner_user_name='tempest-VolumesSnapshotTestJSON-1944158015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:53:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15a80edd010b4455b0fc1c1b87793407',uuid=af7e44d8-9660-4ad2-ab8d-768ea0895138,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "294d49e3-5a68-404e-b1ba-96606361a364", "address": "fa:16:3e:15:95:6d", "network": {"id": "4cbde028-e86d-4799-b1f5-4e6e87a4867a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1815397632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5be577c441b4dc0acb3b76cbb07f877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294d49e3-5a", "ovs_interfaceid": "294d49e3-5a68-404e-b1ba-96606361a364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Converting VIF {"id": "294d49e3-5a68-404e-b1ba-96606361a364", "address": "fa:16:3e:15:95:6d", "network": {"id": "4cbde028-e86d-4799-b1f5-4e6e87a4867a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1815397632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5be577c441b4dc0acb3b76cbb07f877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294d49e3-5a", "ovs_interfaceid": "294d49e3-5a68-404e-b1ba-96606361a364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:95:6d,bridge_name='br-int',has_traffic_filtering=True,id=294d49e3-5a68-404e-b1ba-96606361a364,network=Network(4cbde028-e86d-4799-b1f5-4e6e87a4867a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap294d49e3-5a') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG os_vif [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:95:6d,bridge_name='br-int',has_traffic_filtering=True,id=294d49e3-5a68-404e-b1ba-96606361a364,network=Network(4cbde028-e86d-4799-b1f5-4e6e87a4867a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap294d49e3-5a') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap294d49e3-5a, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap294d49e3-5a, col_values=(('external_ids', {'iface-id': '294d49e3-5a68-404e-b1ba-96606361a364', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:95:6d', 'vm-uuid': 'af7e44d8-9660-4ad2-ab8d-768ea0895138'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:53:02 user nova-compute[73078]: INFO os_vif [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:95:6d,bridge_name='br-int',has_traffic_filtering=True,id=294d49e3-5a68-404e-b1ba-96606361a364,network=Network(4cbde028-e86d-4799-b1f5-4e6e87a4867a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap294d49e3-5a')
Aug 14 18:53:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] No VIF found with MAC fa:16:3e:15:95:6d, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG nova.network.neutron [req-6fcc4500-3761-4816-b482-d945435bd9c3 req-9225cd28-2938-46e0-af5b-9d2754c55974 service nova] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Updated VIF entry in instance network info cache for port 294d49e3-5a68-404e-b1ba-96606361a364. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG nova.network.neutron [req-6fcc4500-3761-4816-b482-d945435bd9c3 req-9225cd28-2938-46e0-af5b-9d2754c55974 service nova] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Updating instance_info_cache with network_info: [{"id": "294d49e3-5a68-404e-b1ba-96606361a364", "address": "fa:16:3e:15:95:6d", "network": {"id": "4cbde028-e86d-4799-b1f5-4e6e87a4867a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1815397632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5be577c441b4dc0acb3b76cbb07f877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294d49e3-5a", "ovs_interfaceid": "294d49e3-5a68-404e-b1ba-96606361a364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:53:02 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6fcc4500-3761-4816-b482-d945435bd9c3 req-9225cd28-2938-46e0-af5b-9d2754c55974 service nova] Releasing lock "refresh_cache-af7e44d8-9660-4ad2-ab8d-768ea0895138" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:53:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:53:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:53:03 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:53:03 user nova-compute[73078]: DEBUG nova.compute.manager [req-26c14460-35c6-4114-8ea2-3ba3a7fd331f req-d769da36-cae6-47ef-9a01-edef9c718ee3 service nova] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Received event network-vif-plugged-294d49e3-5a68-404e-b1ba-96606361a364 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:53:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-26c14460-35c6-4114-8ea2-3ba3a7fd331f req-d769da36-cae6-47ef-9a01-edef9c718ee3 service nova] Acquiring lock "af7e44d8-9660-4ad2-ab8d-768ea0895138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:53:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-26c14460-35c6-4114-8ea2-3ba3a7fd331f req-d769da36-cae6-47ef-9a01-edef9c718ee3 service nova] Lock "af7e44d8-9660-4ad2-ab8d-768ea0895138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:53:03 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-26c14460-35c6-4114-8ea2-3ba3a7fd331f req-d769da36-cae6-47ef-9a01-edef9c718ee3 service nova] Lock "af7e44d8-9660-4ad2-ab8d-768ea0895138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:53:03 user nova-compute[73078]: DEBUG nova.compute.manager [req-26c14460-35c6-4114-8ea2-3ba3a7fd331f req-d769da36-cae6-47ef-9a01-edef9c718ee3 service nova] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] No waiting events found dispatching network-vif-plugged-294d49e3-5a68-404e-b1ba-96606361a364 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:53:03 user nova-compute[73078]: WARNING nova.compute.manager [req-26c14460-35c6-4114-8ea2-3ba3a7fd331f req-d769da36-cae6-47ef-9a01-edef9c718ee3 service nova] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Received unexpected event network-vif-plugged-294d49e3-5a68-404e-b1ba-96606361a364 for instance with vm_state building and task_state spawning.
Aug 14 18:53:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:53:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:53:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:53:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:53:05 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692039185.9409673, af7e44d8-9660-4ad2-ab8d-768ea0895138 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:53:05 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] VM Resumed (Lifecycle Event)
Aug 14 18:53:05 user nova-compute[73078]: DEBUG nova.compute.manager [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:53:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:53:05 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Instance spawned successfully.
Aug 14 18:53:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:53:05 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:53:05 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:53:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:53:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:53:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:53:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:53:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:53:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:53:05 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:53:05 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692039185.9444838, af7e44d8-9660-4ad2-ab8d-768ea0895138 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:53:05 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] VM Started (Lifecycle Event)
Aug 14 18:53:06 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:53:06 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:53:06 user nova-compute[73078]: DEBUG nova.compute.manager [req-03d471d7-efb9-4fec-8a66-75def18d464f req-4b7cfc27-397d-4b00-a072-5f772d613144 service nova] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Received event network-vif-plugged-294d49e3-5a68-404e-b1ba-96606361a364 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:53:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-03d471d7-efb9-4fec-8a66-75def18d464f req-4b7cfc27-397d-4b00-a072-5f772d613144 service nova] Acquiring lock "af7e44d8-9660-4ad2-ab8d-768ea0895138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:53:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-03d471d7-efb9-4fec-8a66-75def18d464f req-4b7cfc27-397d-4b00-a072-5f772d613144 service nova] Lock "af7e44d8-9660-4ad2-ab8d-768ea0895138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:53:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-03d471d7-efb9-4fec-8a66-75def18d464f req-4b7cfc27-397d-4b00-a072-5f772d613144 service nova] Lock "af7e44d8-9660-4ad2-ab8d-768ea0895138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:53:06 user nova-compute[73078]: DEBUG nova.compute.manager [req-03d471d7-efb9-4fec-8a66-75def18d464f req-4b7cfc27-397d-4b00-a072-5f772d613144 service nova] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] No waiting events found dispatching network-vif-plugged-294d49e3-5a68-404e-b1ba-96606361a364 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:53:06 user nova-compute[73078]: WARNING nova.compute.manager [req-03d471d7-efb9-4fec-8a66-75def18d464f req-4b7cfc27-397d-4b00-a072-5f772d613144 service nova] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Received unexpected event network-vif-plugged-294d49e3-5a68-404e-b1ba-96606361a364 for instance with vm_state building and task_state spawning.
Aug 14 18:53:06 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:53:06 user nova-compute[73078]: INFO nova.compute.manager [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Took 5.78 seconds to spawn the instance on the hypervisor.
Aug 14 18:53:06 user nova-compute[73078]: DEBUG nova.compute.manager [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:53:06 user nova-compute[73078]: INFO nova.compute.manager [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Took 6.37 seconds to build instance.
Aug 14 18:53:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-8c3cdf87-aa8e-4443-8e65-fe6b796575d3 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "af7e44d8-9660-4ad2-ab8d-768ea0895138" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.460s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:53:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:53:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:53:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:53:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:53:18 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:53:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:53:19 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:53:19 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:53:19 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Rebuilding the list of instances to heal {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 18:53:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-af7e44d8-9660-4ad2-ab8d-768ea0895138" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:53:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-af7e44d8-9660-4ad2-ab8d-768ea0895138" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:53:19 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:53:19 user nova-compute[73078]: DEBUG nova.objects.instance [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lazy-loading 'info_cache' on Instance uuid af7e44d8-9660-4ad2-ab8d-768ea0895138 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:53:19 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Updating instance_info_cache with network_info: [{"id": "294d49e3-5a68-404e-b1ba-96606361a364", "address": "fa:16:3e:15:95:6d", "network": {"id": "4cbde028-e86d-4799-b1f5-4e6e87a4867a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1815397632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5be577c441b4dc0acb3b76cbb07f877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294d49e3-5a", "ovs_interfaceid": "294d49e3-5a68-404e-b1ba-96606361a364", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:53:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-af7e44d8-9660-4ad2-ab8d-768ea0895138" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:53:19 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:53:21 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:53:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:53:23 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:53:24 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:53:24 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:53:25 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:53:25 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:53:25 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:53:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:53:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:53:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:53:25 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:53:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af7e44d8-9660-4ad2-ab8d-768ea0895138/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:53:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af7e44d8-9660-4ad2-ab8d-768ea0895138/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:53:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af7e44d8-9660-4ad2-ab8d-768ea0895138/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:53:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af7e44d8-9660-4ad2-ab8d-768ea0895138/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:53:25 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:53:25 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:53:25 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=8736MB free_disk=25.056560516357422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:53:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:53:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:53:26 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance af7e44d8-9660-4ad2-ab8d-768ea0895138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:53:26 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:53:26 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:53:26 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:53:26 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:53:26 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:53:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.206s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:53:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:53:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:53:30 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:53:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:53:33 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:53:34 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:53:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:53:38 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:53:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:53:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:53:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:53:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:53:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:53:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:53:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:53:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:53:57 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:54:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:54:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:54:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:54:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:54:18 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:54:21 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:54:21 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:54:21 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Rebuilding the list of instances to heal {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 18:54:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-af7e44d8-9660-4ad2-ab8d-768ea0895138" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:54:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-af7e44d8-9660-4ad2-ab8d-768ea0895138" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:54:21 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:54:21 user nova-compute[73078]: DEBUG nova.objects.instance [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lazy-loading 'info_cache' on Instance uuid af7e44d8-9660-4ad2-ab8d-768ea0895138 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:54:21 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Updating instance_info_cache with network_info: [{"id": "294d49e3-5a68-404e-b1ba-96606361a364", "address": "fa:16:3e:15:95:6d", "network": {"id": "4cbde028-e86d-4799-b1f5-4e6e87a4867a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1815397632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5be577c441b4dc0acb3b76cbb07f877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294d49e3-5a", "ovs_interfaceid": "294d49e3-5a68-404e-b1ba-96606361a364", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:54:21 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-af7e44d8-9660-4ad2-ab8d-768ea0895138" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:54:21 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:54:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:54:22 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:54:24 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:54:24 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:54:26 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:54:26 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:54:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:54:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:54:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:54:26 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:54:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af7e44d8-9660-4ad2-ab8d-768ea0895138/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:54:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af7e44d8-9660-4ad2-ab8d-768ea0895138/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:54:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af7e44d8-9660-4ad2-ab8d-768ea0895138/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:54:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af7e44d8-9660-4ad2-ab8d-768ea0895138/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:54:26 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:54:26 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:54:26 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=8787MB free_disk=25.05455780029297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:54:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:54:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:54:27 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance af7e44d8-9660-4ad2-ab8d-768ea0895138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:54:27 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:54:27 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:54:27 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:54:27 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:54:27 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:54:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:54:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:54:28 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:54:31 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:54:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:54:35 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:54:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:54:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:54:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:54:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-16204bc1-bef9-4984-816d-93966ab05426 req-624c53e6-55b4-43c0-bea9-26df5ec41c66 service nova] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Received event network-changed-294d49e3-5a68-404e-b1ba-96606361a364 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:54:51 user nova-compute[73078]: DEBUG nova.compute.manager [req-16204bc1-bef9-4984-816d-93966ab05426 req-624c53e6-55b4-43c0-bea9-26df5ec41c66 service nova] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Refreshing instance network info cache due to event network-changed-294d49e3-5a68-404e-b1ba-96606361a364. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:54:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-16204bc1-bef9-4984-816d-93966ab05426 req-624c53e6-55b4-43c0-bea9-26df5ec41c66 service nova] Acquiring lock "refresh_cache-af7e44d8-9660-4ad2-ab8d-768ea0895138" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:54:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-16204bc1-bef9-4984-816d-93966ab05426 req-624c53e6-55b4-43c0-bea9-26df5ec41c66 service nova] Acquired lock "refresh_cache-af7e44d8-9660-4ad2-ab8d-768ea0895138" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:54:51 user nova-compute[73078]: DEBUG nova.network.neutron [req-16204bc1-bef9-4984-816d-93966ab05426 req-624c53e6-55b4-43c0-bea9-26df5ec41c66 service nova] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Refreshing network info cache for port 294d49e3-5a68-404e-b1ba-96606361a364 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:54:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Acquiring lock "af7e44d8-9660-4ad2-ab8d-768ea0895138" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:54:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "af7e44d8-9660-4ad2-ab8d-768ea0895138" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:54:51 user nova-compute[73078]: DEBUG nova.objects.instance [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lazy-loading 'flavor' on Instance uuid af7e44d8-9660-4ad2-ab8d-768ea0895138 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:54:51 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Ignoring supplied device name: /dev/vdb
Aug 14 18:54:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "af7e44d8-9660-4ad2-ab8d-768ea0895138" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:54:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Acquiring lock "af7e44d8-9660-4ad2-ab8d-768ea0895138" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:54:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "af7e44d8-9660-4ad2-ab8d-768ea0895138" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:54:51 user nova-compute[73078]: INFO nova.compute.manager [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Attaching volume 0fc09a14-9192-4b9a-8a25-5ddf84e09392 to /dev/vdb
Aug 14 18:54:51 user nova-compute[73078]: DEBUG os_brick.utils [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:54:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:54:51 user nova-compute[73078]: DEBUG nova.network.neutron [req-16204bc1-bef9-4984-816d-93966ab05426 req-624c53e6-55b4-43c0-bea9-26df5ec41c66 service nova] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Updated VIF entry in instance network info cache for port 294d49e3-5a68-404e-b1ba-96606361a364. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:54:51 user nova-compute[73078]: DEBUG nova.network.neutron [req-16204bc1-bef9-4984-816d-93966ab05426 req-624c53e6-55b4-43c0-bea9-26df5ec41c66 service nova] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Updating instance_info_cache with network_info: [{"id": "294d49e3-5a68-404e-b1ba-96606361a364", "address": "fa:16:3e:15:95:6d", "network": {"id": "4cbde028-e86d-4799-b1f5-4e6e87a4867a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1815397632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5be577c441b4dc0acb3b76cbb07f877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294d49e3-5a", "ovs_interfaceid": "294d49e3-5a68-404e-b1ba-96606361a364", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:54:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:54:51 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[85184291-1147-40e0-8482-84d4f0e302cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:54:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:54:51 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-16204bc1-bef9-4984-816d-93966ab05426 req-624c53e6-55b4-43c0-bea9-26df5ec41c66 service nova] Releasing lock "refresh_cache-af7e44d8-9660-4ad2-ab8d-768ea0895138" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:54:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:54:51 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[10175c51-4ae7-47c2-859d-472341747f64]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:54:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:54:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:54:51 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9a71bc-1efc-43ce-a252-b64c626903e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:54:51 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6addfc3e-2f8c-42cd-a2d5-1b8b7f396e07]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:54:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:54:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:54:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:54:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:54:51 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:54:51 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:54:51 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[977ab4cd-dc03-4753-80b1-da3515e26a4f]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:54:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:54:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:54:51 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:54:51 user nova-compute[73078]: DEBUG os_brick.utils [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:54:51 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Updating existing volume attachment record: e2052099-fc35-4118-bb99-fc0150f84524 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:54:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:54:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:54:57 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:54:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:54:59 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:54:59 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aKpHvSXc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:54:59 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:54:59 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:54:59 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:54:59 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:54:59 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:54:59 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:54:59 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:54:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:54:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:54:59 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57232ca-29c9-4d49-99a1-bfd53b621b7d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:54:59 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:54:59 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:54:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.045s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6b4389-4cae-4ffb-a56d-202ba36638c5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392] added
Aug 14 18:55:00 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f025a2-cb04-4518-856f-0b265a0c7956]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[219ae586-a8b1-404f-bd61-b166ba583572]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aKpHvSXc {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aKpHvSXc" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[94195507-815b-4879-9902-80931c7b5f50]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aKpHvSXc'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c4cdd0-3c7a-4aab-aa1f-54cad6507a72]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f43cc6-e328-4f7f-bcde-6f1ed77a6075]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 18:55:00 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 18:55:00 user nova-compute[73078]:  {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:55:00 user nova-compute[73078]: WARNING os_brick.initiator.connectors.iscsi [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 18:55:00 user nova-compute[73078]: 
Aug 14 18:55:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b08d185-4c5a-4596-9de1-a72e658acb95]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392, portal: 172.16.0.220,3260]
Aug 14 18:55:00 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392, portal: 172.16.0.220,3260] successful.
Aug 14 18:55:00 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[df815c7d-34f5-486c-8906-8f0576bda8a7]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a27421a-ccc2-4c8e-9631-a9dbdfecccb6]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392 (non-flash)
Aug 14 18:55:00 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392 (non-flash)
Aug 14 18:55:00 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[edae3e86-6e0a-4042-8312-316b6ee2825a]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:55:00 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aKpHvSXc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:55:01 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:55:01 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '26530333763396238', 'path': '/dev/sdb'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:55:01 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530333763396238', 'path': '/dev/sdb'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:55:01 user nova-compute[73078]: DEBUG nova.objects.instance [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lazy-loading 'flavor' on Instance uuid af7e44d8-9660-4ad2-ab8d-768ea0895138 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:55:01 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 18:55:01 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:55:01 user nova-compute[73078]:   <source dev="/dev/sdb"/>
Aug 14 18:55:01 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:55:01 user nova-compute[73078]:   <serial>0fc09a14-9192-4b9a-8a25-5ddf84e09392</serial>
Aug 14 18:55:01 user nova-compute[73078]: </disk>
Aug 14 18:55:01 user nova-compute[73078]:  {{(pid=73078) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 18:55:01 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:55:01 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:55:01 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] No VIF found with MAC fa:16:3e:15:95:6d, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:55:01 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-6f45c274-b03e-4f4e-a92b-feb48d67685c tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "af7e44d8-9660-4ad2-ab8d-768ea0895138" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.383s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:55:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:55:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:55:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:55:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:55:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:55:20 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:55:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:55:23 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:55:23 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:55:23 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Rebuilding the list of instances to heal {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 18:55:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-af7e44d8-9660-4ad2-ab8d-768ea0895138" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:55:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-af7e44d8-9660-4ad2-ab8d-768ea0895138" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:55:23 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:55:23 user nova-compute[73078]: DEBUG nova.objects.instance [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lazy-loading 'info_cache' on Instance uuid af7e44d8-9660-4ad2-ab8d-768ea0895138 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:55:23 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Updating instance_info_cache with network_info: [{"id": "294d49e3-5a68-404e-b1ba-96606361a364", "address": "fa:16:3e:15:95:6d", "network": {"id": "4cbde028-e86d-4799-b1f5-4e6e87a4867a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1815397632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5be577c441b4dc0acb3b76cbb07f877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294d49e3-5a", "ovs_interfaceid": "294d49e3-5a68-404e-b1ba-96606361a364", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:55:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-af7e44d8-9660-4ad2-ab8d-768ea0895138" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:55:23 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:55:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:55:24 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:55:26 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:55:26 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:55:26 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:55:26 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:55:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:55:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:55:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:55:26 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:55:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af7e44d8-9660-4ad2-ab8d-768ea0895138/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:55:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af7e44d8-9660-4ad2-ab8d-768ea0895138/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:55:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af7e44d8-9660-4ad2-ab8d-768ea0895138/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:55:26 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af7e44d8-9660-4ad2-ab8d-768ea0895138/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:55:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:55:26 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:55:26 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:55:26 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=8788MB free_disk=25.053424835205078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:55:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:55:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:55:27 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance af7e44d8-9660-4ad2-ab8d-768ea0895138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:55:27 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:55:27 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:55:27 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:55:27 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:55:27 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:55:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:55:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:55:28 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:55:31 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:55:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:55:35 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:55:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:55:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-00953cea-8240-4039-8c56-34dccd4535c6 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Acquiring lock "af7e44d8-9660-4ad2-ab8d-768ea0895138" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:55:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-00953cea-8240-4039-8c56-34dccd4535c6 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "af7e44d8-9660-4ad2-ab8d-768ea0895138" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:55:40 user nova-compute[73078]: INFO nova.compute.manager [None req-00953cea-8240-4039-8c56-34dccd4535c6 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Detaching volume 0fc09a14-9192-4b9a-8a25-5ddf84e09392
Aug 14 18:55:40 user nova-compute[73078]: INFO nova.virt.block_device [None req-00953cea-8240-4039-8c56-34dccd4535c6 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Attempting to driver detach volume 0fc09a14-9192-4b9a-8a25-5ddf84e09392 from mountpoint /dev/vdb
Aug 14 18:55:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-00953cea-8240-4039-8c56-34dccd4535c6 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Attempting to detach device vdb from instance af7e44d8-9660-4ad2-ab8d-768ea0895138 from the persistent domain config. {{(pid=73078) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 18:55:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-00953cea-8240-4039-8c56-34dccd4535c6 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:55:40 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:55:40 user nova-compute[73078]:   <source dev="/dev/sdb"/>
Aug 14 18:55:40 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:55:40 user nova-compute[73078]:   <serial>0fc09a14-9192-4b9a-8a25-5ddf84e09392</serial>
Aug 14 18:55:40 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:55:40 user nova-compute[73078]: </disk>
Aug 14 18:55:40 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:55:40 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-00953cea-8240-4039-8c56-34dccd4535c6 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Successfully detached device vdb from instance af7e44d8-9660-4ad2-ab8d-768ea0895138 from the persistent domain config.
Aug 14 18:55:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-00953cea-8240-4039-8c56-34dccd4535c6 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance af7e44d8-9660-4ad2-ab8d-768ea0895138 from the live domain config. {{(pid=73078) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 18:55:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-00953cea-8240-4039-8c56-34dccd4535c6 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:55:40 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:55:40 user nova-compute[73078]:   <source dev="/dev/sdb"/>
Aug 14 18:55:40 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:55:40 user nova-compute[73078]:   <serial>0fc09a14-9192-4b9a-8a25-5ddf84e09392</serial>
Aug 14 18:55:40 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:55:40 user nova-compute[73078]: </disk>
Aug 14 18:55:40 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:55:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Acquiring lock "af7e44d8-9660-4ad2-ab8d-768ea0895138" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:55:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Received event <DeviceRemovedEvent: 1692039340.998362, af7e44d8-9660-4ad2-ab8d-768ea0895138 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73078) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-00953cea-8240-4039-8c56-34dccd4535c6 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance af7e44d8-9660-4ad2-ab8d-768ea0895138 {{(pid=73078) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 18:55:41 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-00953cea-8240-4039-8c56-34dccd4535c6 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Successfully detached device vdb from instance af7e44d8-9660-4ad2-ab8d-768ea0895138 from the live domain config.
Aug 14 18:55:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00953cea-8240-4039-8c56-34dccd4535c6 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-00953cea-8240-4039-8c56-34dccd4535c6 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aKpHvSXc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:55:41 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-00953cea-8240-4039-8c56-34dccd4535c6 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:55:41 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-00953cea-8240-4039-8c56-34dccd4535c6 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-00953cea-8240-4039-8c56-34dccd4535c6 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-00953cea-8240-4039-8c56-34dccd4535c6 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce62dde3-f5e9-4c1e-85e9-d5d2e43298b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3007760-220d-45fc-b2b0-55010b4a618f]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-00953cea-8240-4039-8c56-34dccd4535c6 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392 (non-flash)
Aug 14 18:55:41 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-00953cea-8240-4039-8c56-34dccd4535c6 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392 (non-flash)
Aug 14 18:55:41 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-00953cea-8240-4039-8c56-34dccd4535c6 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9547d7eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392'): ({'sdb'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-00953cea-8240-4039-8c56-34dccd4535c6 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Removing single pathed devices sdb {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3860d63b-2265-4905-b662-d2e0163e7468]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1fb278-bdf2-4373-be12-5d84703c01d1]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-00953cea-8240-4039-8c56-34dccd4535c6 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Flushing IO for device /dev/sdb {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cb5b0a-defb-42ae-929a-c916712f2a64]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-00953cea-8240-4039-8c56-34dccd4535c6 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5390623b-c59d-4cb8-bbd7-c40022a77117]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-00953cea-8240-4039-8c56-34dccd4535c6 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-00953cea-8240-4039-8c56-34dccd4535c6 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] SCSI volumes sdb have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-00953cea-8240-4039-8c56-34dccd4535c6 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b809c92-4ade-4780-b57a-1a0b1b54301e]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-00953cea-8240-4039-8c56-34dccd4535c6 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f307ab0d-7c2b-4462-89f3-5ef70898c126]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-00953cea-8240-4039-8c56-34dccd4535c6 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392, portal: 172.16.0.220,3260]
Aug 14 18:55:41 user nova-compute[73078]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392, portal: 172.16.0.220,3260] successful.
Aug 14 18:55:41 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3cd518-52e9-438f-bd82-04416a063128]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-00953cea-8240-4039-8c56-34dccd4535c6 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-00953cea-8240-4039-8c56-34dccd4535c6 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-00953cea-8240-4039-8c56-34dccd4535c6 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] <== disconnect_volume: return (283ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:55:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00953cea-8240-4039-8c56-34dccd4535c6 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:55:42 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:55:42 user nova-compute[73078]: DEBUG nova.objects.instance [None req-00953cea-8240-4039-8c56-34dccd4535c6 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lazy-loading 'flavor' on Instance uuid af7e44d8-9660-4ad2-ab8d-768ea0895138 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:55:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-00953cea-8240-4039-8c56-34dccd4535c6 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "af7e44d8-9660-4ad2-ab8d-768ea0895138" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.702s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:55:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "af7e44d8-9660-4ad2-ab8d-768ea0895138" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.586s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:55:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Acquiring lock "af7e44d8-9660-4ad2-ab8d-768ea0895138-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:55:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "af7e44d8-9660-4ad2-ab8d-768ea0895138-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:55:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "af7e44d8-9660-4ad2-ab8d-768ea0895138-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:55:42 user nova-compute[73078]: INFO nova.compute.manager [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Terminating instance
Aug 14 18:55:42 user nova-compute[73078]: DEBUG nova.compute.manager [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:55:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:55:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:55:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:55:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:55:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:55:42 user nova-compute[73078]: DEBUG nova.compute.manager [req-b230ff32-d003-4e8a-8910-d66695055503 req-00b5daf3-ef15-4f05-a341-8a514014faba service nova] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Received event network-vif-unplugged-294d49e3-5a68-404e-b1ba-96606361a364 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:55:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b230ff32-d003-4e8a-8910-d66695055503 req-00b5daf3-ef15-4f05-a341-8a514014faba service nova] Acquiring lock "af7e44d8-9660-4ad2-ab8d-768ea0895138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:55:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b230ff32-d003-4e8a-8910-d66695055503 req-00b5daf3-ef15-4f05-a341-8a514014faba service nova] Lock "af7e44d8-9660-4ad2-ab8d-768ea0895138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:55:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-b230ff32-d003-4e8a-8910-d66695055503 req-00b5daf3-ef15-4f05-a341-8a514014faba service nova] Lock "af7e44d8-9660-4ad2-ab8d-768ea0895138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:55:42 user nova-compute[73078]: DEBUG nova.compute.manager [req-b230ff32-d003-4e8a-8910-d66695055503 req-00b5daf3-ef15-4f05-a341-8a514014faba service nova] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] No waiting events found dispatching network-vif-unplugged-294d49e3-5a68-404e-b1ba-96606361a364 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:55:42 user nova-compute[73078]: DEBUG nova.compute.manager [req-b230ff32-d003-4e8a-8910-d66695055503 req-00b5daf3-ef15-4f05-a341-8a514014faba service nova] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Received event network-vif-unplugged-294d49e3-5a68-404e-b1ba-96606361a364 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:55:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:55:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:55:42 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Instance destroyed successfully.
Aug 14 18:55:42 user nova-compute[73078]: DEBUG nova.objects.instance [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lazy-loading 'resources' on Instance uuid af7e44d8-9660-4ad2-ab8d-768ea0895138 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:55:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-985202667',display_name='tempest-VolumesSnapshotTestJSON-instance-985202667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-985202667',id=51,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRH4tIs9tzBHTWrh1kLOyvGlI6G8+lWtfvLMIzToT9BbRjhB+DiUmoOusQjjfYltNl2Ih1Pugf/egsVQWVWukdUpcfzGM5Caxk5/amIzkeg3kiJT7EBRD8IEhpFZ5z8+g==',key_name='tempest-keypair-1698335954',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:53:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5be577c441b4dc0acb3b76cbb07f877',ramdisk_id='',reservation_id='r-ra90migz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1944158015',owner_user_name='tempest-VolumesSnapshotTestJSON-1944158015-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:53:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15a80edd010b4455b0fc1c1b87793407',uuid=af7e44d8-9660-4ad2-ab8d-768ea0895138,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "294d49e3-5a68-404e-b1ba-96606361a364", "address": "fa:16:3e:15:95:6d", "network": {"id": "4cbde028-e86d-4799-b1f5-4e6e87a4867a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1815397632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5be577c441b4dc0acb3b76cbb07f877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294d49e3-5a", "ovs_interfaceid": "294d49e3-5a68-404e-b1ba-96606361a364", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:55:42 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Converting VIF {"id": "294d49e3-5a68-404e-b1ba-96606361a364", "address": "fa:16:3e:15:95:6d", "network": {"id": "4cbde028-e86d-4799-b1f5-4e6e87a4867a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1815397632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5be577c441b4dc0acb3b76cbb07f877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294d49e3-5a", "ovs_interfaceid": "294d49e3-5a68-404e-b1ba-96606361a364", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:55:42 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:95:6d,bridge_name='br-int',has_traffic_filtering=True,id=294d49e3-5a68-404e-b1ba-96606361a364,network=Network(4cbde028-e86d-4799-b1f5-4e6e87a4867a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap294d49e3-5a') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:55:42 user nova-compute[73078]: DEBUG os_vif [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:95:6d,bridge_name='br-int',has_traffic_filtering=True,id=294d49e3-5a68-404e-b1ba-96606361a364,network=Network(4cbde028-e86d-4799-b1f5-4e6e87a4867a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap294d49e3-5a') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:55:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:55:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap294d49e3-5a, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:55:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:55:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:55:42 user nova-compute[73078]: INFO os_vif [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:95:6d,bridge_name='br-int',has_traffic_filtering=True,id=294d49e3-5a68-404e-b1ba-96606361a364,network=Network(4cbde028-e86d-4799-b1f5-4e6e87a4867a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap294d49e3-5a')
Aug 14 18:55:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:55:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aKpHvSXc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:55:42 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:55:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:55:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:55:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fc09a14-9192-4b9a-8a25-5ddf84e09392', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:55:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:55:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:55:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f568c9b6-8a9c-4c02-8b98-6908c1ad0fb9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:55:42 user nova-compute[73078]: WARNING os_brick.initiator.connectors.iscsi [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Aug 14 18:55:42 user nova-compute[73078]: 
Aug 14 18:55:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:55:43 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:55:43 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f5166c-5ee6-4421-9fa1-8fd471e2a6ba]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:55:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 18:55:43 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:55:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 18:55:43 user nova-compute[73078]:  {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:55:43 user nova-compute[73078]: WARNING os_brick.initiator.connectors.iscsi [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 18:55:43 user nova-compute[73078]: 
Aug 14 18:55:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9546a3910>, {}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:55:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Disconnecting from: [] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:55:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.041s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:55:43 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] <== disconnect_volume: return (42ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:55:43 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:55:43 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Deleting instance files /opt/stack/data/nova/instances/af7e44d8-9660-4ad2-ab8d-768ea0895138_del
Aug 14 18:55:43 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Deletion of /opt/stack/data/nova/instances/af7e44d8-9660-4ad2-ab8d-768ea0895138_del complete
Aug 14 18:55:43 user nova-compute[73078]: INFO nova.compute.manager [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 14 18:55:43 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:55:43 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:55:43 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:55:43 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:55:43 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Took 0.73 seconds to deallocate network for instance.
Aug 14 18:55:43 user nova-compute[73078]: DEBUG nova.compute.manager [req-f5fefaca-8736-42d2-801f-bf5310fe083f req-bf453f84-442c-4cfb-ab78-60e36e6333f7 service nova] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Received event network-vif-deleted-294d49e3-5a68-404e-b1ba-96606361a364 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:55:43 user nova-compute[73078]: INFO nova.compute.manager [req-f5fefaca-8736-42d2-801f-bf5310fe083f req-bf453f84-442c-4cfb-ab78-60e36e6333f7 service nova] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Neutron deleted interface 294d49e3-5a68-404e-b1ba-96606361a364; detaching it from the instance and deleting it from the info cache
Aug 14 18:55:43 user nova-compute[73078]: DEBUG nova.network.neutron [req-f5fefaca-8736-42d2-801f-bf5310fe083f req-bf453f84-442c-4cfb-ab78-60e36e6333f7 service nova] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:55:43 user nova-compute[73078]: WARNING nova.volume.cinder [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Attachment e2052099-fc35-4118-bb99-fc0150f84524 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = e2052099-fc35-4118-bb99-fc0150f84524. (HTTP 404) (Request-ID: req-d7c22fb1-2349-4aee-8f40-49857a34c06b)
Aug 14 18:55:43 user nova-compute[73078]: INFO nova.compute.manager [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Took 0.03 seconds to detach 1 volumes for instance.
Aug 14 18:55:43 user nova-compute[73078]: DEBUG nova.compute.manager [req-f5fefaca-8736-42d2-801f-bf5310fe083f req-bf453f84-442c-4cfb-ab78-60e36e6333f7 service nova] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Detach interface failed, port_id=294d49e3-5a68-404e-b1ba-96606361a364, reason: Instance af7e44d8-9660-4ad2-ab8d-768ea0895138 could not be found. {{(pid=73078) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 18:55:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:55:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:55:43 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:55:43 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:55:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.126s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:55:44 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Deleted allocations for instance af7e44d8-9660-4ad2-ab8d-768ea0895138
Aug 14 18:55:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-fa6bab7d-60e4-4de2-bb56-0c4e796c2a65 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "af7e44d8-9660-4ad2-ab8d-768ea0895138" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.949s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:55:44 user nova-compute[73078]: DEBUG nova.compute.manager [req-99d8277a-fa30-4af8-9684-1f8b73981a1b req-346caa70-3d8c-459b-a109-b266a1753804 service nova] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Received event network-vif-plugged-294d49e3-5a68-404e-b1ba-96606361a364 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:55:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-99d8277a-fa30-4af8-9684-1f8b73981a1b req-346caa70-3d8c-459b-a109-b266a1753804 service nova] Acquiring lock "af7e44d8-9660-4ad2-ab8d-768ea0895138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:55:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-99d8277a-fa30-4af8-9684-1f8b73981a1b req-346caa70-3d8c-459b-a109-b266a1753804 service nova] Lock "af7e44d8-9660-4ad2-ab8d-768ea0895138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:55:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-99d8277a-fa30-4af8-9684-1f8b73981a1b req-346caa70-3d8c-459b-a109-b266a1753804 service nova] Lock "af7e44d8-9660-4ad2-ab8d-768ea0895138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:55:44 user nova-compute[73078]: DEBUG nova.compute.manager [req-99d8277a-fa30-4af8-9684-1f8b73981a1b req-346caa70-3d8c-459b-a109-b266a1753804 service nova] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] No waiting events found dispatching network-vif-plugged-294d49e3-5a68-404e-b1ba-96606361a364 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:55:44 user nova-compute[73078]: WARNING nova.compute.manager [req-99d8277a-fa30-4af8-9684-1f8b73981a1b req-346caa70-3d8c-459b-a109-b266a1753804 service nova] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Received unexpected event network-vif-plugged-294d49e3-5a68-404e-b1ba-96606361a364 for instance with vm_state deleted and task_state None.
Aug 14 18:55:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:55:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:55:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:55:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:55:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:55:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:55:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:55:57 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692039342.9255414, af7e44d8-9660-4ad2-ab8d-768ea0895138 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:55:57 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] VM Stopped (Lifecycle Event)
Aug 14 18:55:57 user nova-compute[73078]: DEBUG nova.compute.manager [None req-ae9ca94b-7129-446c-b82d-c7b988769eb4 None None] [instance: af7e44d8-9660-4ad2-ab8d-768ea0895138] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:55:57 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:55:57 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:55:57 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:55:57 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:55:57 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:55:57 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:56:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:56:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:56:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:56:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:56:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:56:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:56:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:56:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:56:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:56:21 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:56:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:56:23 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:56:23 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:56:23 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Rebuilding the list of instances to heal {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 18:56:23 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Didn't find any instances for network info cache update. {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 18:56:26 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:56:26 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:56:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:56:28 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:56:28 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:56:28 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:56:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:56:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:56:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:56:28 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:56:28 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:56:28 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:56:28 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=8934MB free_disk=25.08041763305664GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:56:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:56:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:56:28 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:56:28 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:56:28 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:56:28 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:56:28 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:56:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.131s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:56:29 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:56:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:56:32 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:56:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:56:36 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:56:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:56:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:56:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:56:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:56:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:56:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:56:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:56:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:56:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:56:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:56:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:56:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:56:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:56:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:56:57 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:57:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:57:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Acquiring lock "15ba3fbb-1b63-43d6-9e53-c65e0ca1853d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:57:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "15ba3fbb-1b63-43d6-9e53-c65e0ca1853d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:57:06 user nova-compute[73078]: DEBUG nova.compute.manager [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 18:57:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:57:06 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:57:06 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 18:57:06 user nova-compute[73078]: INFO nova.compute.claims [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Claim successful on node user
Aug 14 18:57:06 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:57:07 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:57:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.200s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:57:07 user nova-compute[73078]: DEBUG nova.compute.manager [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 18:57:07 user nova-compute[73078]: DEBUG nova.compute.manager [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 18:57:07 user nova-compute[73078]: DEBUG nova.network.neutron [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 18:57:07 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 18:57:07 user nova-compute[73078]: DEBUG nova.compute.manager [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 18:57:07 user nova-compute[73078]: DEBUG nova.policy [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '15a80edd010b4455b0fc1c1b87793407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5be577c441b4dc0acb3b76cbb07f877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 18:57:07 user nova-compute[73078]: DEBUG nova.compute.manager [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 18:57:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 18:57:07 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Creating image(s)
Aug 14 18:57:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Acquiring lock "/opt/stack/data/nova/instances/15ba3fbb-1b63-43d6-9e53-c65e0ca1853d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:57:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "/opt/stack/data/nova/instances/15ba3fbb-1b63-43d6-9e53-c65e0ca1853d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:57:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "/opt/stack/data/nova/instances/15ba3fbb-1b63-43d6-9e53-c65e0ca1853d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:57:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:57:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.180s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:57:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:57:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:57:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:57:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.169s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:57:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/15ba3fbb-1b63-43d6-9e53-c65e0ca1853d/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:57:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/15ba3fbb-1b63-43d6-9e53-c65e0ca1853d/disk 1073741824" returned: 0 in 0.049s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:57:07 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:57:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:57:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.180s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:57:07 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Checking if we can resize image /opt/stack/data/nova/instances/15ba3fbb-1b63-43d6-9e53-c65e0ca1853d/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 18:57:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ba3fbb-1b63-43d6-9e53-c65e0ca1853d/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:57:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:57:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ba3fbb-1b63-43d6-9e53-c65e0ca1853d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:57:08 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Cannot resize image /opt/stack/data/nova/instances/15ba3fbb-1b63-43d6-9e53-c65e0ca1853d/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 18:57:08 user nova-compute[73078]: DEBUG nova.objects.instance [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lazy-loading 'migration_context' on Instance uuid 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:57:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 18:57:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Ensure instance console log exists: /opt/stack/data/nova/instances/15ba3fbb-1b63-43d6-9e53-c65e0ca1853d/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 18:57:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:57:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:57:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:57:08 user nova-compute[73078]: DEBUG nova.network.neutron [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Successfully created port: de91d561-4b39-4336-92c3-54be53123358 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 18:57:08 user nova-compute[73078]: DEBUG nova.network.neutron [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Successfully updated port: de91d561-4b39-4336-92c3-54be53123358 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 18:57:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Acquiring lock "refresh_cache-15ba3fbb-1b63-43d6-9e53-c65e0ca1853d" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:57:08 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Acquired lock "refresh_cache-15ba3fbb-1b63-43d6-9e53-c65e0ca1853d" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:57:08 user nova-compute[73078]: DEBUG nova.network.neutron [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG nova.network.neutron [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG nova.compute.manager [req-89113c94-d8d9-4772-a572-68c70158774b req-9f9cef2d-ac54-4b29-b8e6-1f71385f252d service nova] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Received event network-changed-de91d561-4b39-4336-92c3-54be53123358 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG nova.compute.manager [req-89113c94-d8d9-4772-a572-68c70158774b req-9f9cef2d-ac54-4b29-b8e6-1f71385f252d service nova] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Refreshing instance network info cache due to event network-changed-de91d561-4b39-4336-92c3-54be53123358. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-89113c94-d8d9-4772-a572-68c70158774b req-9f9cef2d-ac54-4b29-b8e6-1f71385f252d service nova] Acquiring lock "refresh_cache-15ba3fbb-1b63-43d6-9e53-c65e0ca1853d" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG nova.network.neutron [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Updating instance_info_cache with network_info: [{"id": "de91d561-4b39-4336-92c3-54be53123358", "address": "fa:16:3e:c3:f2:1a", "network": {"id": "4cbde028-e86d-4799-b1f5-4e6e87a4867a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1815397632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5be577c441b4dc0acb3b76cbb07f877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde91d561-4b", "ovs_interfaceid": "de91d561-4b39-4336-92c3-54be53123358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Releasing lock "refresh_cache-15ba3fbb-1b63-43d6-9e53-c65e0ca1853d" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG nova.compute.manager [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Instance network_info: |[{"id": "de91d561-4b39-4336-92c3-54be53123358", "address": "fa:16:3e:c3:f2:1a", "network": {"id": "4cbde028-e86d-4799-b1f5-4e6e87a4867a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1815397632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5be577c441b4dc0acb3b76cbb07f877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde91d561-4b", "ovs_interfaceid": "de91d561-4b39-4336-92c3-54be53123358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-89113c94-d8d9-4772-a572-68c70158774b req-9f9cef2d-ac54-4b29-b8e6-1f71385f252d service nova] Acquired lock "refresh_cache-15ba3fbb-1b63-43d6-9e53-c65e0ca1853d" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG nova.network.neutron [req-89113c94-d8d9-4772-a572-68c70158774b req-9f9cef2d-ac54-4b29-b8e6-1f71385f252d service nova] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Refreshing network info cache for port de91d561-4b39-4336-92c3-54be53123358 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Start _get_guest_xml network_info=[{"id": "de91d561-4b39-4336-92c3-54be53123358", "address": "fa:16:3e:c3:f2:1a", "network": {"id": "4cbde028-e86d-4799-b1f5-4e6e87a4867a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1815397632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5be577c441b4dc0acb3b76cbb07f877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde91d561-4b", "ovs_interfaceid": "de91d561-4b39-4336-92c3-54be53123358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 18:57:09 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:57:09 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:57:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:57:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1903873587',display_name='tempest-VolumesSnapshotTestJSON-instance-1903873587',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1903873587',id=52,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMnnxntVvCOGah9MXknOj3/Vo6HnvsWo2ca5UJ/bmFTK+JvDxHMTDmwz2DMN/pHvW0cWuGAsOGoRCgd9v2jixtSz2O+nXD2h+L50qBAVJP+BYBcJKaaODGA2gAnNcGHug==',key_name='tempest-keypair-890796112',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5be577c441b4dc0acb3b76cbb07f877',ramdisk_id='',reservation_id='r-46xhbr51',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1944158015',owner_user_name='tempest-VolumesSnapshotTestJSON-1944158015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:57:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15a80edd010b4455b0fc1c1b87793407',uuid=15ba3fbb-1b63-43d6-9e53-c65e0ca1853d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de91d561-4b39-4336-92c3-54be53123358", "address": "fa:16:3e:c3:f2:1a", "network": {"id": "4cbde028-e86d-4799-b1f5-4e6e87a4867a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1815397632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5be577c441b4dc0acb3b76cbb07f877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde91d561-4b", "ovs_interfaceid": "de91d561-4b39-4336-92c3-54be53123358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Converting VIF {"id": "de91d561-4b39-4336-92c3-54be53123358", "address": "fa:16:3e:c3:f2:1a", "network": {"id": "4cbde028-e86d-4799-b1f5-4e6e87a4867a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1815397632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5be577c441b4dc0acb3b76cbb07f877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde91d561-4b", "ovs_interfaceid": "de91d561-4b39-4336-92c3-54be53123358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:f2:1a,bridge_name='br-int',has_traffic_filtering=True,id=de91d561-4b39-4336-92c3-54be53123358,network=Network(4cbde028-e86d-4799-b1f5-4e6e87a4867a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde91d561-4b') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG nova.objects.instance [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lazy-loading 'pci_devices' on Instance uuid 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] End _get_guest_xml xml=<domain type="kvm">
Aug 14 18:57:09 user nova-compute[73078]:   <uuid>15ba3fbb-1b63-43d6-9e53-c65e0ca1853d</uuid>
Aug 14 18:57:09 user nova-compute[73078]:   <name>instance-00000034</name>
Aug 14 18:57:09 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 18:57:09 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 18:57:09 user nova-compute[73078]:   <metadata>
Aug 14 18:57:09 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 18:57:09 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 18:57:09 user nova-compute[73078]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1903873587</nova:name>
Aug 14 18:57:09 user nova-compute[73078]:       <nova:creationTime>2023-08-14 18:57:09</nova:creationTime>
Aug 14 18:57:09 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 18:57:09 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 18:57:09 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 18:57:09 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 18:57:09 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 18:57:09 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 18:57:09 user nova-compute[73078]:       </nova:flavor>
Aug 14 18:57:09 user nova-compute[73078]:       <nova:owner>
Aug 14 18:57:09 user nova-compute[73078]:         <nova:user uuid="15a80edd010b4455b0fc1c1b87793407">tempest-VolumesSnapshotTestJSON-1944158015-project-member</nova:user>
Aug 14 18:57:09 user nova-compute[73078]:         <nova:project uuid="d5be577c441b4dc0acb3b76cbb07f877">tempest-VolumesSnapshotTestJSON-1944158015</nova:project>
Aug 14 18:57:09 user nova-compute[73078]:       </nova:owner>
Aug 14 18:57:09 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 18:57:09 user nova-compute[73078]:       <nova:ports>
Aug 14 18:57:09 user nova-compute[73078]:         <nova:port uuid="de91d561-4b39-4336-92c3-54be53123358">
Aug 14 18:57:09 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 14 18:57:09 user nova-compute[73078]:         </nova:port>
Aug 14 18:57:09 user nova-compute[73078]:       </nova:ports>
Aug 14 18:57:09 user nova-compute[73078]:     </nova:instance>
Aug 14 18:57:09 user nova-compute[73078]:   </metadata>
Aug 14 18:57:09 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 18:57:09 user nova-compute[73078]:     <system>
Aug 14 18:57:09 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 18:57:09 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 18:57:09 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 18:57:09 user nova-compute[73078]:       <entry name="serial">15ba3fbb-1b63-43d6-9e53-c65e0ca1853d</entry>
Aug 14 18:57:09 user nova-compute[73078]:       <entry name="uuid">15ba3fbb-1b63-43d6-9e53-c65e0ca1853d</entry>
Aug 14 18:57:09 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 18:57:09 user nova-compute[73078]:     </system>
Aug 14 18:57:09 user nova-compute[73078]:   </sysinfo>
Aug 14 18:57:09 user nova-compute[73078]:   <os>
Aug 14 18:57:09 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 18:57:09 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 18:57:09 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 18:57:09 user nova-compute[73078]:   </os>
Aug 14 18:57:09 user nova-compute[73078]:   <features>
Aug 14 18:57:09 user nova-compute[73078]:     <acpi/>
Aug 14 18:57:09 user nova-compute[73078]:     <apic/>
Aug 14 18:57:09 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 18:57:09 user nova-compute[73078]:   </features>
Aug 14 18:57:09 user nova-compute[73078]:   <clock offset="utc">
Aug 14 18:57:09 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 18:57:09 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 18:57:09 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 18:57:09 user nova-compute[73078]:   </clock>
Aug 14 18:57:09 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 18:57:09 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 18:57:09 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 18:57:09 user nova-compute[73078]:   </cpu>
Aug 14 18:57:09 user nova-compute[73078]:   <devices>
Aug 14 18:57:09 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 18:57:09 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 18:57:09 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/15ba3fbb-1b63-43d6-9e53-c65e0ca1853d/disk"/>
Aug 14 18:57:09 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 18:57:09 user nova-compute[73078]:     </disk>
Aug 14 18:57:09 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 18:57:09 user nova-compute[73078]:       <mac address="fa:16:3e:c3:f2:1a"/>
Aug 14 18:57:09 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:57:09 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 18:57:09 user nova-compute[73078]:       <target dev="tapde91d561-4b"/>
Aug 14 18:57:09 user nova-compute[73078]:     </interface>
Aug 14 18:57:09 user nova-compute[73078]:     <serial type="pty">
Aug 14 18:57:09 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/15ba3fbb-1b63-43d6-9e53-c65e0ca1853d/console.log" append="off"/>
Aug 14 18:57:09 user nova-compute[73078]:     </serial>
Aug 14 18:57:09 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 18:57:09 user nova-compute[73078]:     <video>
Aug 14 18:57:09 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 18:57:09 user nova-compute[73078]:     </video>
Aug 14 18:57:09 user nova-compute[73078]:     <rng model="virtio">
Aug 14 18:57:09 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 18:57:09 user nova-compute[73078]:     </rng>
Aug 14 18:57:09 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 18:57:09 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 18:57:09 user nova-compute[73078]:       <stats period="10"/>
Aug 14 18:57:09 user nova-compute[73078]:     </memballoon>
Aug 14 18:57:09 user nova-compute[73078]:   </devices>
Aug 14 18:57:09 user nova-compute[73078]: </domain>
Aug 14 18:57:09 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:57:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1903873587',display_name='tempest-VolumesSnapshotTestJSON-instance-1903873587',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1903873587',id=52,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMnnxntVvCOGah9MXknOj3/Vo6HnvsWo2ca5UJ/bmFTK+JvDxHMTDmwz2DMN/pHvW0cWuGAsOGoRCgd9v2jixtSz2O+nXD2h+L50qBAVJP+BYBcJKaaODGA2gAnNcGHug==',key_name='tempest-keypair-890796112',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5be577c441b4dc0acb3b76cbb07f877',ramdisk_id='',reservation_id='r-46xhbr51',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1944158015',owner_user_name='tempest-VolumesSnapshotTestJSON-1944158015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T18:57:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15a80edd010b4455b0fc1c1b87793407',uuid=15ba3fbb-1b63-43d6-9e53-c65e0ca1853d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de91d561-4b39-4336-92c3-54be53123358", "address": "fa:16:3e:c3:f2:1a", "network": {"id": "4cbde028-e86d-4799-b1f5-4e6e87a4867a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1815397632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5be577c441b4dc0acb3b76cbb07f877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde91d561-4b", "ovs_interfaceid": "de91d561-4b39-4336-92c3-54be53123358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Converting VIF {"id": "de91d561-4b39-4336-92c3-54be53123358", "address": "fa:16:3e:c3:f2:1a", "network": {"id": "4cbde028-e86d-4799-b1f5-4e6e87a4867a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1815397632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5be577c441b4dc0acb3b76cbb07f877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde91d561-4b", "ovs_interfaceid": "de91d561-4b39-4336-92c3-54be53123358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:f2:1a,bridge_name='br-int',has_traffic_filtering=True,id=de91d561-4b39-4336-92c3-54be53123358,network=Network(4cbde028-e86d-4799-b1f5-4e6e87a4867a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde91d561-4b') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG os_vif [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:f2:1a,bridge_name='br-int',has_traffic_filtering=True,id=de91d561-4b39-4336-92c3-54be53123358,network=Network(4cbde028-e86d-4799-b1f5-4e6e87a4867a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde91d561-4b') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde91d561-4b, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapde91d561-4b, col_values=(('external_ids', {'iface-id': 'de91d561-4b39-4336-92c3-54be53123358', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:f2:1a', 'vm-uuid': '15ba3fbb-1b63-43d6-9e53-c65e0ca1853d'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:57:09 user nova-compute[73078]: INFO os_vif [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:f2:1a,bridge_name='br-int',has_traffic_filtering=True,id=de91d561-4b39-4336-92c3-54be53123358,network=Network(4cbde028-e86d-4799-b1f5-4e6e87a4867a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde91d561-4b')
Aug 14 18:57:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] No VIF found with MAC fa:16:3e:c3:f2:1a, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG nova.network.neutron [req-89113c94-d8d9-4772-a572-68c70158774b req-9f9cef2d-ac54-4b29-b8e6-1f71385f252d service nova] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Updated VIF entry in instance network info cache for port de91d561-4b39-4336-92c3-54be53123358. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG nova.network.neutron [req-89113c94-d8d9-4772-a572-68c70158774b req-9f9cef2d-ac54-4b29-b8e6-1f71385f252d service nova] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Updating instance_info_cache with network_info: [{"id": "de91d561-4b39-4336-92c3-54be53123358", "address": "fa:16:3e:c3:f2:1a", "network": {"id": "4cbde028-e86d-4799-b1f5-4e6e87a4867a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1815397632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5be577c441b4dc0acb3b76cbb07f877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde91d561-4b", "ovs_interfaceid": "de91d561-4b39-4336-92c3-54be53123358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:57:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-89113c94-d8d9-4772-a572-68c70158774b req-9f9cef2d-ac54-4b29-b8e6-1f71385f252d service nova] Releasing lock "refresh_cache-15ba3fbb-1b63-43d6-9e53-c65e0ca1853d" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:57:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:57:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:57:10 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:57:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:57:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:57:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:57:11 user nova-compute[73078]: DEBUG nova.compute.manager [req-4451d4aa-11c4-44b3-819b-760f63c36e6a req-c89e0a76-eebb-4fe1-8481-93868d844fd3 service nova] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Received event network-vif-plugged-de91d561-4b39-4336-92c3-54be53123358 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:57:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4451d4aa-11c4-44b3-819b-760f63c36e6a req-c89e0a76-eebb-4fe1-8481-93868d844fd3 service nova] Acquiring lock "15ba3fbb-1b63-43d6-9e53-c65e0ca1853d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:57:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4451d4aa-11c4-44b3-819b-760f63c36e6a req-c89e0a76-eebb-4fe1-8481-93868d844fd3 service nova] Lock "15ba3fbb-1b63-43d6-9e53-c65e0ca1853d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:57:11 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-4451d4aa-11c4-44b3-819b-760f63c36e6a req-c89e0a76-eebb-4fe1-8481-93868d844fd3 service nova] Lock "15ba3fbb-1b63-43d6-9e53-c65e0ca1853d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:57:11 user nova-compute[73078]: DEBUG nova.compute.manager [req-4451d4aa-11c4-44b3-819b-760f63c36e6a req-c89e0a76-eebb-4fe1-8481-93868d844fd3 service nova] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] No waiting events found dispatching network-vif-plugged-de91d561-4b39-4336-92c3-54be53123358 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:57:11 user nova-compute[73078]: WARNING nova.compute.manager [req-4451d4aa-11c4-44b3-819b-760f63c36e6a req-c89e0a76-eebb-4fe1-8481-93868d844fd3 service nova] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Received unexpected event network-vif-plugged-de91d561-4b39-4336-92c3-54be53123358 for instance with vm_state building and task_state spawning.
Aug 14 18:57:12 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692039432.8692048, 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:57:12 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] VM Resumed (Lifecycle Event)
Aug 14 18:57:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 18:57:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 18:57:12 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Instance spawned successfully.
Aug 14 18:57:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 18:57:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:57:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:57:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:57:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:57:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:57:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:57:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:57:12 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 18:57:12 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:57:12 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692039432.8719287, 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:57:12 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] VM Started (Lifecycle Event)
Aug 14 18:57:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:57:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 18:57:12 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 18:57:12 user nova-compute[73078]: INFO nova.compute.manager [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Took 5.68 seconds to spawn the instance on the hypervisor.
Aug 14 18:57:12 user nova-compute[73078]: DEBUG nova.compute.manager [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:57:13 user nova-compute[73078]: INFO nova.compute.manager [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Took 6.25 seconds to build instance.
Aug 14 18:57:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-9b19eb9d-e868-4f64-a836-87a54f71c526 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "15ba3fbb-1b63-43d6-9e53-c65e0ca1853d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.345s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:57:13 user nova-compute[73078]: DEBUG nova.compute.manager [req-dd26f657-54de-4e9b-a20c-05baa6a999b2 req-7fb01317-e3d6-467f-a8d1-65255e9ee5ab service nova] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Received event network-vif-plugged-de91d561-4b39-4336-92c3-54be53123358 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:57:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-dd26f657-54de-4e9b-a20c-05baa6a999b2 req-7fb01317-e3d6-467f-a8d1-65255e9ee5ab service nova] Acquiring lock "15ba3fbb-1b63-43d6-9e53-c65e0ca1853d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:57:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-dd26f657-54de-4e9b-a20c-05baa6a999b2 req-7fb01317-e3d6-467f-a8d1-65255e9ee5ab service nova] Lock "15ba3fbb-1b63-43d6-9e53-c65e0ca1853d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:57:13 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-dd26f657-54de-4e9b-a20c-05baa6a999b2 req-7fb01317-e3d6-467f-a8d1-65255e9ee5ab service nova] Lock "15ba3fbb-1b63-43d6-9e53-c65e0ca1853d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:57:13 user nova-compute[73078]: DEBUG nova.compute.manager [req-dd26f657-54de-4e9b-a20c-05baa6a999b2 req-7fb01317-e3d6-467f-a8d1-65255e9ee5ab service nova] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] No waiting events found dispatching network-vif-plugged-de91d561-4b39-4336-92c3-54be53123358 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:57:13 user nova-compute[73078]: WARNING nova.compute.manager [req-dd26f657-54de-4e9b-a20c-05baa6a999b2 req-7fb01317-e3d6-467f-a8d1-65255e9ee5ab service nova] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Received unexpected event network-vif-plugged-de91d561-4b39-4336-92c3-54be53123358 for instance with vm_state active and task_state None.
Aug 14 18:57:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:57:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:57:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:57:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:57:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:57:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:57:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:57:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:57:20 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:57:23 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:57:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:57:25 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:57:25 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:57:25 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Rebuilding the list of instances to heal {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 18:57:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-15ba3fbb-1b63-43d6-9e53-c65e0ca1853d" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:57:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-15ba3fbb-1b63-43d6-9e53-c65e0ca1853d" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:57:25 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:57:25 user nova-compute[73078]: DEBUG nova.objects.instance [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lazy-loading 'info_cache' on Instance uuid 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:57:25 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Updating instance_info_cache with network_info: [{"id": "de91d561-4b39-4336-92c3-54be53123358", "address": "fa:16:3e:c3:f2:1a", "network": {"id": "4cbde028-e86d-4799-b1f5-4e6e87a4867a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1815397632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5be577c441b4dc0acb3b76cbb07f877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde91d561-4b", "ovs_interfaceid": "de91d561-4b39-4336-92c3-54be53123358", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:57:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-15ba3fbb-1b63-43d6-9e53-c65e0ca1853d" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:57:25 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:57:26 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:57:26 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Triggering sync for uuid 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d {{(pid=73078) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 18:57:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "15ba3fbb-1b63-43d6-9e53-c65e0ca1853d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:57:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "15ba3fbb-1b63-43d6-9e53-c65e0ca1853d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:57:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "15ba3fbb-1b63-43d6-9e53-c65e0ca1853d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:57:28 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:57:28 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:57:28 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:57:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:57:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:57:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:57:28 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:57:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ba3fbb-1b63-43d6-9e53-c65e0ca1853d/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:57:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ba3fbb-1b63-43d6-9e53-c65e0ca1853d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:57:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ba3fbb-1b63-43d6-9e53-c65e0ca1853d/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:57:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ba3fbb-1b63-43d6-9e53-c65e0ca1853d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:57:28 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:57:28 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:57:28 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=8736MB free_disk=25.051937103271484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:57:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:57:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:57:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:57:29 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:57:29 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:57:29 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:57:29 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Refreshing inventories for resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 18:57:29 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Updating ProviderTree inventory for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 18:57:29 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Updating inventory in ProviderTree for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 18:57:29 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Refreshing aggregate associations for resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b, aggregates: None {{(pid=73078) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 18:57:29 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Refreshing trait associations for resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV {{(pid=73078) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 18:57:29 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:57:29 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:57:29 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:57:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.398s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:57:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:57:30 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:57:30 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:57:31 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:57:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:57:34 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:57:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:57:38 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:57:38 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:57:38 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Cleaning up deleted instances {{(pid=73078) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 18:57:38 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] There are 0 instances to clean {{(pid=73078) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 18:57:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:57:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:57:42 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:57:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:57:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:57:46 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:57:46 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73078) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 18:57:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:57:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:57:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:57:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:57:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:57:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:57:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:57:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:58:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:58:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:58:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:58:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:58:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:58:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:58:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:58:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:58:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:58:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:58:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:58:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:58:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:58:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:58:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:58:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:58:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:58:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:58:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:58:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:58:25 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:58:27 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:58:27 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:58:27 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Rebuilding the list of instances to heal {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 18:58:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-15ba3fbb-1b63-43d6-9e53-c65e0ca1853d" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:58:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-15ba3fbb-1b63-43d6-9e53-c65e0ca1853d" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:58:27 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:58:27 user nova-compute[73078]: DEBUG nova.objects.instance [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lazy-loading 'info_cache' on Instance uuid 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:58:27 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Updating instance_info_cache with network_info: [{"id": "de91d561-4b39-4336-92c3-54be53123358", "address": "fa:16:3e:c3:f2:1a", "network": {"id": "4cbde028-e86d-4799-b1f5-4e6e87a4867a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1815397632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5be577c441b4dc0acb3b76cbb07f877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde91d561-4b", "ovs_interfaceid": "de91d561-4b39-4336-92c3-54be53123358", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:58:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-15ba3fbb-1b63-43d6-9e53-c65e0ca1853d" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:58:27 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:58:28 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:58:28 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:58:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:58:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:58:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:58:28 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:58:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ba3fbb-1b63-43d6-9e53-c65e0ca1853d/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:58:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ba3fbb-1b63-43d6-9e53-c65e0ca1853d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:58:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ba3fbb-1b63-43d6-9e53-c65e0ca1853d/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:58:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ba3fbb-1b63-43d6-9e53-c65e0ca1853d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:58:28 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:58:28 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:58:28 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=8808MB free_disk=25.04964828491211GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:58:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:58:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:58:29 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:58:29 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:58:29 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:58:29 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:58:29 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:58:29 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:58:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:58:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:58:31 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:58:31 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:58:31 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:58:32 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:58:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:58:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:58:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:58:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:58:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:58:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:58:36 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:58:38 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:58:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:58:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:58:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:58:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:58:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:58:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:58:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:58:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:58:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:58:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:58:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:58:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:58:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:58:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG nova.compute.manager [req-fbd1def5-78df-4968-a2c3-68961eb5c7c5 req-f1a728d6-c4a4-4ce6-a239-883beb6d7e6f service nova] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Received event network-changed-de91d561-4b39-4336-92c3-54be53123358 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG nova.compute.manager [req-fbd1def5-78df-4968-a2c3-68961eb5c7c5 req-f1a728d6-c4a4-4ce6-a239-883beb6d7e6f service nova] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Refreshing instance network info cache due to event network-changed-de91d561-4b39-4336-92c3-54be53123358. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-fbd1def5-78df-4968-a2c3-68961eb5c7c5 req-f1a728d6-c4a4-4ce6-a239-883beb6d7e6f service nova] Acquiring lock "refresh_cache-15ba3fbb-1b63-43d6-9e53-c65e0ca1853d" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-fbd1def5-78df-4968-a2c3-68961eb5c7c5 req-f1a728d6-c4a4-4ce6-a239-883beb6d7e6f service nova] Acquired lock "refresh_cache-15ba3fbb-1b63-43d6-9e53-c65e0ca1853d" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG nova.network.neutron [req-fbd1def5-78df-4968-a2c3-68961eb5c7c5 req-f1a728d6-c4a4-4ce6-a239-883beb6d7e6f service nova] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Refreshing network info cache for port de91d561-4b39-4336-92c3-54be53123358 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Acquiring lock "15ba3fbb-1b63-43d6-9e53-c65e0ca1853d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "15ba3fbb-1b63-43d6-9e53-c65e0ca1853d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG nova.objects.instance [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lazy-loading 'flavor' on Instance uuid 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:58:59 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Ignoring supplied device name: /dev/vdb
Aug 14 18:58:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "15ba3fbb-1b63-43d6-9e53-c65e0ca1853d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Acquiring lock "15ba3fbb-1b63-43d6-9e53-c65e0ca1853d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "15ba3fbb-1b63-43d6-9e53-c65e0ca1853d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:58:59 user nova-compute[73078]: INFO nova.compute.manager [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Attaching volume 710b0fde-039a-4eda-a62a-d499b411d2a1 to /dev/vdb
Aug 14 18:58:59 user nova-compute[73078]: DEBUG nova.network.neutron [req-fbd1def5-78df-4968-a2c3-68961eb5c7c5 req-f1a728d6-c4a4-4ce6-a239-883beb6d7e6f service nova] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Updated VIF entry in instance network info cache for port de91d561-4b39-4336-92c3-54be53123358. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG nova.network.neutron [req-fbd1def5-78df-4968-a2c3-68961eb5c7c5 req-f1a728d6-c4a4-4ce6-a239-883beb6d7e6f service nova] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Updating instance_info_cache with network_info: [{"id": "de91d561-4b39-4336-92c3-54be53123358", "address": "fa:16:3e:c3:f2:1a", "network": {"id": "4cbde028-e86d-4799-b1f5-4e6e87a4867a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1815397632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5be577c441b4dc0acb3b76cbb07f877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde91d561-4b", "ovs_interfaceid": "de91d561-4b39-4336-92c3-54be53123358", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG os_brick.utils [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcc8e59-d7be-47f3-b24e-b251ec0c9d19]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-fbd1def5-78df-4968-a2c3-68961eb5c7c5 req-f1a728d6-c4a4-4ce6-a239-883beb6d7e6f service nova] Releasing lock "refresh_cache-15ba3fbb-1b63-43d6-9e53-c65e0ca1853d" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5179f5-9925-455e-a07a-15c98068c74c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cba8cf-6f31-4c72-b710-13ddee5a844b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f226aafb-1ad8-47ce-917e-c0162ec5f1b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 18:58:59 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 18:58:59 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fda9df-7b9a-47e9-b1c2-f224adf24d18]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG os_brick.utils [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:58:59 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Updating existing volume attachment record: 20011958-19a5-4f4b-872a-5f3fd0faa17f {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 18:59:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:59:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XRnLVweK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:59:08 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:59:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:59:08 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:59:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:59:08 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 18:59:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c81fe9-9a2f-42fc-8e1e-48bf9144447b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 18:59:08 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9664ad35-3e9d-474f-a877-97069e9191b3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1] added
Aug 14 18:59:08 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5e6e74-db7f-4a92-96c5-19ea8b4b4354]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6090be-f212-478c-8570-479c62869ff1]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XRnLVweK {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XRnLVweK" returned: 0 in 0.024s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[09aa7249-79f0-4859-ba01-f6ee0dbd29de]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XRnLVweK'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b2984f-f0fe-49a0-bd6f-216d4ef612d7]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cee0e18-8873-47f4-b424-773fb9ed9939]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 18:59:08 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 18:59:08 user nova-compute[73078]:  {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:59:08 user nova-compute[73078]: WARNING os_brick.initiator.connectors.iscsi [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 18:59:08 user nova-compute[73078]: 
Aug 14 18:59:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[307cf3c4-a2c6-40a1-b2fd-37799985e250]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1, portal: 172.16.0.220,3260]
Aug 14 18:59:08 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1, portal: 172.16.0.220,3260] successful.
Aug 14 18:59:08 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9358109-77f3-4ac4-a846-21974ca1e333]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0204b402-7c6c-428c-b5f0-17c2d59a88eb]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1 (non-flash)
Aug 14 18:59:08 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1 (non-flash)
Aug 14 18:59:08 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe543ae5-372a-46b1-b2be-8570953f3ef2]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:59:08 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: None {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:59:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:59:09 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 18:59:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XRnLVweK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 18:59:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:59:09 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26364626264653632', 'path': '/dev/sdb'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:59:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364626264653632', 'path': '/dev/sdb'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 18:59:09 user nova-compute[73078]: DEBUG nova.objects.instance [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lazy-loading 'flavor' on Instance uuid 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:59:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:59:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 18:59:09 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:59:09 user nova-compute[73078]:   <source dev="/dev/sdb"/>
Aug 14 18:59:09 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:59:09 user nova-compute[73078]:   <serial>710b0fde-039a-4eda-a62a-d499b411d2a1</serial>
Aug 14 18:59:09 user nova-compute[73078]: </disk>
Aug 14 18:59:09 user nova-compute[73078]:  {{(pid=73078) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 18:59:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:59:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 18:59:10 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] No VIF found with MAC fa:16:3e:c3:f2:1a, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 18:59:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-27a03cd7-a340-4b0b-a41b-835288c8a91b tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "15ba3fbb-1b63-43d6-9e53-c65e0ca1853d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.487s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:59:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:59:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:59:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:59:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:59:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:59:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:59:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:59:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:59:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:59:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:59:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:59:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:59:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:59:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:59:27 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:59:27 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 18:59:27 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Rebuilding the list of instances to heal {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 18:59:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-15ba3fbb-1b63-43d6-9e53-c65e0ca1853d" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 18:59:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-15ba3fbb-1b63-43d6-9e53-c65e0ca1853d" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 18:59:27 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 18:59:27 user nova-compute[73078]: DEBUG nova.objects.instance [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lazy-loading 'info_cache' on Instance uuid 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:59:27 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Updating instance_info_cache with network_info: [{"id": "de91d561-4b39-4336-92c3-54be53123358", "address": "fa:16:3e:c3:f2:1a", "network": {"id": "4cbde028-e86d-4799-b1f5-4e6e87a4867a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1815397632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5be577c441b4dc0acb3b76cbb07f877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde91d561-4b", "ovs_interfaceid": "de91d561-4b39-4336-92c3-54be53123358", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:59:27 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-15ba3fbb-1b63-43d6-9e53-c65e0ca1853d" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 18:59:27 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 18:59:27 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:59:28 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:59:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:59:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:59:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:59:28 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 18:59:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ba3fbb-1b63-43d6-9e53-c65e0ca1853d/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:59:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ba3fbb-1b63-43d6-9e53-c65e0ca1853d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:59:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ba3fbb-1b63-43d6-9e53-c65e0ca1853d/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:59:28 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ba3fbb-1b63-43d6-9e53-c65e0ca1853d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:59:28 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73078) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 18:59:28 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:59:28 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 18:59:28 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=8788MB free_disk=25.048614501953125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 18:59:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:59:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:59:29 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 18:59:29 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 18:59:29 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 18:59:29 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:59:29 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:59:29 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 18:59:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:59:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:59:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:59:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:59:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:59:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:59:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:59:30 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:59:30 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:59:30 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:59:30 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 18:59:32 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:59:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:59:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:59:37 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:59:38 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:59:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:59:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:59:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 18:59:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:59:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 18:59:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:59:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d5a72c30-fa0e-4525-9bc4-007cf7908a51 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Acquiring lock "15ba3fbb-1b63-43d6-9e53-c65e0ca1853d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:59:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d5a72c30-fa0e-4525-9bc4-007cf7908a51 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "15ba3fbb-1b63-43d6-9e53-c65e0ca1853d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:59:40 user nova-compute[73078]: INFO nova.compute.manager [None req-d5a72c30-fa0e-4525-9bc4-007cf7908a51 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Detaching volume 710b0fde-039a-4eda-a62a-d499b411d2a1
Aug 14 18:59:40 user nova-compute[73078]: INFO nova.virt.block_device [None req-d5a72c30-fa0e-4525-9bc4-007cf7908a51 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Attempting to driver detach volume 710b0fde-039a-4eda-a62a-d499b411d2a1 from mountpoint /dev/vdb
Aug 14 18:59:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-d5a72c30-fa0e-4525-9bc4-007cf7908a51 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Attempting to detach device vdb from instance 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d from the persistent domain config. {{(pid=73078) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 18:59:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-d5a72c30-fa0e-4525-9bc4-007cf7908a51 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:59:40 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:59:40 user nova-compute[73078]:   <source dev="/dev/sdb"/>
Aug 14 18:59:40 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:59:40 user nova-compute[73078]:   <serial>710b0fde-039a-4eda-a62a-d499b411d2a1</serial>
Aug 14 18:59:40 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:59:40 user nova-compute[73078]: </disk>
Aug 14 18:59:40 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:59:40 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-d5a72c30-fa0e-4525-9bc4-007cf7908a51 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Successfully detached device vdb from instance 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d from the persistent domain config.
Aug 14 18:59:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-d5a72c30-fa0e-4525-9bc4-007cf7908a51 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d from the live domain config. {{(pid=73078) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 18:59:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-d5a72c30-fa0e-4525-9bc4-007cf7908a51 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 18:59:40 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 18:59:40 user nova-compute[73078]:   <source dev="/dev/sdb"/>
Aug 14 18:59:40 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 18:59:40 user nova-compute[73078]:   <serial>710b0fde-039a-4eda-a62a-d499b411d2a1</serial>
Aug 14 18:59:40 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 18:59:40 user nova-compute[73078]: </disk>
Aug 14 18:59:40 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 18:59:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Acquiring lock "15ba3fbb-1b63-43d6-9e53-c65e0ca1853d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:59:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Received event <DeviceRemovedEvent: 1692039580.8252883, 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73078) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 18:59:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-d5a72c30-fa0e-4525-9bc4-007cf7908a51 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d {{(pid=73078) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 18:59:40 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-d5a72c30-fa0e-4525-9bc4-007cf7908a51 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Successfully detached device vdb from instance 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d from the live domain config.
Aug 14 18:59:40 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5a72c30-fa0e-4525-9bc4-007cf7908a51 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:59:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a72c30-fa0e-4525-9bc4-007cf7908a51 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XRnLVweK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:59:40 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-d5a72c30-fa0e-4525-9bc4-007cf7908a51 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:59:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-d5a72c30-fa0e-4525-9bc4-007cf7908a51 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:59:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-d5a72c30-fa0e-4525-9bc4-007cf7908a51 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:59:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a72c30-fa0e-4525-9bc4-007cf7908a51 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:59:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:59:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:59:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3fe7f2-b97d-4e5c-a3fc-65581545c637]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:59:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:59:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:59:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e19e6d-26bd-43e4-908b-84c6211db6b8]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:59:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a72c30-fa0e-4525-9bc4-007cf7908a51 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1 (non-flash)
Aug 14 18:59:40 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:59:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a72c30-fa0e-4525-9bc4-007cf7908a51 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1 (non-flash)
Aug 14 18:59:40 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:59:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a72c30-fa0e-4525-9bc4-007cf7908a51 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe98820f9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1'): ({'sdb'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:59:40 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-d5a72c30-fa0e-4525-9bc4-007cf7908a51 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Removing single pathed devices sdb {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 18:59:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:59:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:59:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0570d99a-356f-4348-8dd3-97f925eb1ec1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:59:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:59:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:59:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff0b006-50cf-4fb2-bb70-213ba5a57ee9]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:59:40 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-d5a72c30-fa0e-4525-9bc4-007cf7908a51 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Flushing IO for device /dev/sdb {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 18:59:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:59:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:59:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[caedee83-90e6-43c3-a426-c87b3b463856]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:59:40 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-d5a72c30-fa0e-4525-9bc4-007cf7908a51 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 18:59:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:59:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:59:40 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65b85af-9db8-40d4-aaca-183ec951143f]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:59:40 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-d5a72c30-fa0e-4525-9bc4-007cf7908a51 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 18:59:40 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-d5a72c30-fa0e-4525-9bc4-007cf7908a51 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] SCSI volumes sdb have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 18:59:40 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a72c30-fa0e-4525-9bc4-007cf7908a51 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:59:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:59:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:59:41 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc3f979-a359-41b8-9e88-3ffefa766547]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:59:41 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a72c30-fa0e-4525-9bc4-007cf7908a51 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:59:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:59:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:59:41 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc23d8b-61fb-4568-b914-185e3c9d97af]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:59:41 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a72c30-fa0e-4525-9bc4-007cf7908a51 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1, portal: 172.16.0.220,3260]
Aug 14 18:59:41 user nova-compute[73078]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1, portal: 172.16.0.220,3260] successful.
Aug 14 18:59:41 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:59:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:59:41 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:59:41 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fa3547-5dc7-4f6b-a0fe-60a06babe4da]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:59:41 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a72c30-fa0e-4525-9bc4-007cf7908a51 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 18:59:41 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-d5a72c30-fa0e-4525-9bc4-007cf7908a51 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:59:41 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a72c30-fa0e-4525-9bc4-007cf7908a51 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] <== disconnect_volume: return (273ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:59:41 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5a72c30-fa0e-4525-9bc4-007cf7908a51 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:59:41 user nova-compute[73078]: DEBUG nova.objects.instance [None req-d5a72c30-fa0e-4525-9bc4-007cf7908a51 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lazy-loading 'flavor' on Instance uuid 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:59:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d5a72c30-fa0e-4525-9bc4-007cf7908a51 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "15ba3fbb-1b63-43d6-9e53-c65e0ca1853d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.602s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:59:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "15ba3fbb-1b63-43d6-9e53-c65e0ca1853d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.482s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:59:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Acquiring lock "15ba3fbb-1b63-43d6-9e53-c65e0ca1853d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:59:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "15ba3fbb-1b63-43d6-9e53-c65e0ca1853d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:59:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "15ba3fbb-1b63-43d6-9e53-c65e0ca1853d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:59:41 user nova-compute[73078]: INFO nova.compute.manager [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Terminating instance
Aug 14 18:59:41 user nova-compute[73078]: DEBUG nova.compute.manager [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 18:59:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:59:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:59:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:59:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:59:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:59:42 user nova-compute[73078]: DEBUG nova.compute.manager [req-3698c8bb-ccb7-4733-ba4a-9694460a88af req-088395c0-8f0b-49c0-bbee-1edf37f04d48 service nova] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Received event network-vif-unplugged-de91d561-4b39-4336-92c3-54be53123358 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:59:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3698c8bb-ccb7-4733-ba4a-9694460a88af req-088395c0-8f0b-49c0-bbee-1edf37f04d48 service nova] Acquiring lock "15ba3fbb-1b63-43d6-9e53-c65e0ca1853d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:59:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3698c8bb-ccb7-4733-ba4a-9694460a88af req-088395c0-8f0b-49c0-bbee-1edf37f04d48 service nova] Lock "15ba3fbb-1b63-43d6-9e53-c65e0ca1853d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:59:42 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-3698c8bb-ccb7-4733-ba4a-9694460a88af req-088395c0-8f0b-49c0-bbee-1edf37f04d48 service nova] Lock "15ba3fbb-1b63-43d6-9e53-c65e0ca1853d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:59:42 user nova-compute[73078]: DEBUG nova.compute.manager [req-3698c8bb-ccb7-4733-ba4a-9694460a88af req-088395c0-8f0b-49c0-bbee-1edf37f04d48 service nova] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] No waiting events found dispatching network-vif-unplugged-de91d561-4b39-4336-92c3-54be53123358 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:59:42 user nova-compute[73078]: DEBUG nova.compute.manager [req-3698c8bb-ccb7-4733-ba4a-9694460a88af req-088395c0-8f0b-49c0-bbee-1edf37f04d48 service nova] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Received event network-vif-unplugged-de91d561-4b39-4336-92c3-54be53123358 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 18:59:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:59:42 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Instance destroyed successfully.
Aug 14 18:59:42 user nova-compute[73078]: DEBUG nova.objects.instance [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lazy-loading 'resources' on Instance uuid 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 18:59:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T18:57:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1903873587',display_name='tempest-VolumesSnapshotTestJSON-instance-1903873587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1903873587',id=52,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMnnxntVvCOGah9MXknOj3/Vo6HnvsWo2ca5UJ/bmFTK+JvDxHMTDmwz2DMN/pHvW0cWuGAsOGoRCgd9v2jixtSz2O+nXD2h+L50qBAVJP+BYBcJKaaODGA2gAnNcGHug==',key_name='tempest-keypair-890796112',keypairs=<?>,launch_index=0,launched_at=2023-08-14T18:57:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5be577c441b4dc0acb3b76cbb07f877',ramdisk_id='',reservation_id='r-46xhbr51',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1944158015',owner_user_name='tempest-VolumesSnapshotTestJSON-1944158015-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T18:57:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15a80edd010b4455b0fc1c1b87793407',uuid=15ba3fbb-1b63-43d6-9e53-c65e0ca1853d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de91d561-4b39-4336-92c3-54be53123358", "address": "fa:16:3e:c3:f2:1a", "network": {"id": "4cbde028-e86d-4799-b1f5-4e6e87a4867a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1815397632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5be577c441b4dc0acb3b76cbb07f877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde91d561-4b", "ovs_interfaceid": "de91d561-4b39-4336-92c3-54be53123358", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 18:59:42 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Converting VIF {"id": "de91d561-4b39-4336-92c3-54be53123358", "address": "fa:16:3e:c3:f2:1a", "network": {"id": "4cbde028-e86d-4799-b1f5-4e6e87a4867a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1815397632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5be577c441b4dc0acb3b76cbb07f877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde91d561-4b", "ovs_interfaceid": "de91d561-4b39-4336-92c3-54be53123358", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 18:59:42 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:f2:1a,bridge_name='br-int',has_traffic_filtering=True,id=de91d561-4b39-4336-92c3-54be53123358,network=Network(4cbde028-e86d-4799-b1f5-4e6e87a4867a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde91d561-4b') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 18:59:42 user nova-compute[73078]: DEBUG os_vif [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:f2:1a,bridge_name='br-int',has_traffic_filtering=True,id=de91d561-4b39-4336-92c3-54be53123358,network=Network(4cbde028-e86d-4799-b1f5-4e6e87a4867a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde91d561-4b') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 18:59:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:59:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde91d561-4b, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 18:59:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:59:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 18:59:42 user nova-compute[73078]: INFO os_vif [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:f2:1a,bridge_name='br-int',has_traffic_filtering=True,id=de91d561-4b39-4336-92c3-54be53123358,network=Network(4cbde028-e86d-4799-b1f5-4e6e87a4867a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde91d561-4b')
Aug 14 18:59:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 18:59:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XRnLVweK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 18:59:42 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 18:59:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 18:59:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 18:59:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:710b0fde-039a-4eda-a62a-d499b411d2a1', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 18:59:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:59:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:59:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[80630c30-6663-4873-9d63-ae59683dd9c4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:59:42 user nova-compute[73078]: WARNING os_brick.initiator.connectors.iscsi [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Aug 14 18:59:42 user nova-compute[73078]: 
Aug 14 18:59:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 18:59:42 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 18:59:42 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[78548745-0198-4957-b2d6-a7a45202af55]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 18:59:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 18:59:42 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 18:59:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 18:59:42 user nova-compute[73078]:  {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 18:59:42 user nova-compute[73078]: WARNING os_brick.initiator.connectors.iscsi [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 18:59:42 user nova-compute[73078]: 
Aug 14 18:59:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe995db8b80>, {}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 18:59:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Disconnecting from: [] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 18:59:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.041s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 18:59:42 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] <== disconnect_volume: return (42ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 18:59:42 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 18:59:42 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Deleting instance files /opt/stack/data/nova/instances/15ba3fbb-1b63-43d6-9e53-c65e0ca1853d_del
Aug 14 18:59:42 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Deletion of /opt/stack/data/nova/instances/15ba3fbb-1b63-43d6-9e53-c65e0ca1853d_del complete
Aug 14 18:59:42 user nova-compute[73078]: INFO nova.compute.manager [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Took 1.03 seconds to destroy the instance on the hypervisor.
Aug 14 18:59:42 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 18:59:42 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 18:59:42 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 18:59:43 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 18:59:43 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Took 0.79 seconds to deallocate network for instance.
Aug 14 18:59:43 user nova-compute[73078]: WARNING nova.volume.cinder [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Attachment 20011958-19a5-4f4b-872a-5f3fd0faa17f does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 20011958-19a5-4f4b-872a-5f3fd0faa17f. (HTTP 404) (Request-ID: req-aee6fa56-8844-4e76-9207-7569970ef720)
Aug 14 18:59:43 user nova-compute[73078]: INFO nova.compute.manager [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Took 0.02 seconds to detach 1 volumes for instance.
Aug 14 18:59:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:59:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:59:43 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 18:59:43 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 18:59:43 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.105s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:59:43 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Deleted allocations for instance 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d
Aug 14 18:59:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-f83f4b2b-ede7-4ec2-b7f0-a812287803f0 tempest-VolumesSnapshotTestJSON-1944158015 tempest-VolumesSnapshotTestJSON-1944158015-project-member] Lock "15ba3fbb-1b63-43d6-9e53-c65e0ca1853d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.192s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:59:44 user nova-compute[73078]: DEBUG nova.compute.manager [req-d1f0bbef-5a16-4b4d-bcba-6d9fee5d76c5 req-11993cf6-640b-4d1f-8243-b2b604780e99 service nova] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Received event network-vif-plugged-de91d561-4b39-4336-92c3-54be53123358 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:59:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d1f0bbef-5a16-4b4d-bcba-6d9fee5d76c5 req-11993cf6-640b-4d1f-8243-b2b604780e99 service nova] Acquiring lock "15ba3fbb-1b63-43d6-9e53-c65e0ca1853d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 18:59:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d1f0bbef-5a16-4b4d-bcba-6d9fee5d76c5 req-11993cf6-640b-4d1f-8243-b2b604780e99 service nova] Lock "15ba3fbb-1b63-43d6-9e53-c65e0ca1853d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 18:59:44 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-d1f0bbef-5a16-4b4d-bcba-6d9fee5d76c5 req-11993cf6-640b-4d1f-8243-b2b604780e99 service nova] Lock "15ba3fbb-1b63-43d6-9e53-c65e0ca1853d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 18:59:44 user nova-compute[73078]: DEBUG nova.compute.manager [req-d1f0bbef-5a16-4b4d-bcba-6d9fee5d76c5 req-11993cf6-640b-4d1f-8243-b2b604780e99 service nova] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] No waiting events found dispatching network-vif-plugged-de91d561-4b39-4336-92c3-54be53123358 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 18:59:44 user nova-compute[73078]: WARNING nova.compute.manager [req-d1f0bbef-5a16-4b4d-bcba-6d9fee5d76c5 req-11993cf6-640b-4d1f-8243-b2b604780e99 service nova] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Received unexpected event network-vif-plugged-de91d561-4b39-4336-92c3-54be53123358 for instance with vm_state deleted and task_state None.
Aug 14 18:59:44 user nova-compute[73078]: DEBUG nova.compute.manager [req-d1f0bbef-5a16-4b4d-bcba-6d9fee5d76c5 req-11993cf6-640b-4d1f-8243-b2b604780e99 service nova] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Received event network-vif-deleted-de91d561-4b39-4336-92c3-54be53123358 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 18:59:47 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 18:59:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:59:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 18:59:57 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692039582.6691365, 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 18:59:57 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] VM Stopped (Lifecycle Event)
Aug 14 18:59:57 user nova-compute[73078]: DEBUG nova.compute.manager [None req-28022ea6-1f87-47e1-813b-3b627ace2c1b None None] [instance: 15ba3fbb-1b63-43d6-9e53-c65e0ca1853d] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 18:59:57 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:00:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:00:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:00:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:00:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:00:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:00:27 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:00:27 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 19:00:27 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Rebuilding the list of instances to heal {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 19:00:27 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Didn't find any instances for network info cache update. {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 19:00:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:00:28 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:00:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:00:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:00:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:00:28 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 19:00:28 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:00:28 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:00:28 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=8921MB free_disk=25.07569122314453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 19:00:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:00:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:00:28 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 19:00:28 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 19:00:28 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:00:28 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:00:28 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 19:00:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:00:29 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:00:29 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:00:30 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:00:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:00:31 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:00:31 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 19:00:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:00:33 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:00:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:00:39 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:00:40 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:00:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:00:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:00:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:00:57 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:01:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:01:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:01:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:01:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:01:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:01:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:01:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:01:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:01:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:01:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:01:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:01:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:01:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:01:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:01:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:01:27 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:01:27 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 19:01:27 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Rebuilding the list of instances to heal {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 19:01:27 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Didn't find any instances for network info cache update. {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 19:01:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:01:29 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:01:29 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:01:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:01:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:01:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:01:29 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 19:01:29 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:01:29 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:01:29 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=8938MB free_disk=25.066261291503906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 19:01:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:01:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:01:29 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 19:01:29 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 19:01:29 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:01:29 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:01:29 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 19:01:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.124s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:01:31 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:01:32 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:01:32 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:01:32 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 19:01:32 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:01:34 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:01:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:01:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:01:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:01:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:01:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:01:37 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:01:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:01:40 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:01:41 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:01:41 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:01:42 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:01:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:01:48 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:01:52 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:01:57 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:02:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:02:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:02:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:02:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:02:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:02:02 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:02:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:02:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:02:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:02:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:02:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:02:07 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:02:08 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:02:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:02:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:02:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:02:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:02:17 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:02:18 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:02:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:02:22 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:02:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Acquiring lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:02:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:02:23 user nova-compute[73078]: DEBUG nova.compute.manager [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Starting instance... {{(pid=73078) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 19:02:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:02:23 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:02:23 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73078) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 19:02:23 user nova-compute[73078]: INFO nova.compute.claims [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Claim successful on node user
Aug 14 19:02:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:02:24 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:02:24 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:02:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.340s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:02:24 user nova-compute[73078]: DEBUG nova.compute.manager [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Start building networks asynchronously for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 19:02:24 user nova-compute[73078]: DEBUG nova.compute.manager [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Allocating IP information in the background. {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 19:02:24 user nova-compute[73078]: DEBUG nova.network.neutron [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] allocate_for_instance() {{(pid=73078) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 19:02:24 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 19:02:24 user nova-compute[73078]: DEBUG nova.compute.manager [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Start building block device mappings for instance. {{(pid=73078) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 19:02:24 user nova-compute[73078]: DEBUG nova.policy [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd1378100bd4b4d7ebeb4ca2ef10339f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4fd49ab1f5444559f1da52c6249c12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73078) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 19:02:24 user nova-compute[73078]: DEBUG nova.compute.manager [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Start spawning the instance on the hypervisor. {{(pid=73078) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 19:02:24 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Creating instance directory {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 19:02:24 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Creating image(s)
Aug 14 19:02:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Acquiring lock "/opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:02:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "/opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:02:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "/opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:02:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:02:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.215s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:02:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Acquiring lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:02:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:02:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:02:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.187s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:02:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk 1073741824 {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:02:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd,backing_fmt=raw /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk 1073741824" returned: 0 in 0.051s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:02:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "4bff63acd8bd6525c97e2d6e93ed608c71468fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:02:24 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:02:25 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:02:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4bff63acd8bd6525c97e2d6e93ed608c71468fdd --force-share --output=json" returned: 0 in 0.208s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:02:25 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk. size=1073741824 {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 19:02:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:02:25 user nova-compute[73078]: DEBUG nova.network.neutron [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Successfully created port: fbc9cc5e-b965-459c-b461-dba3ec52a876 {{(pid=73078) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 19:02:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:02:25 user nova-compute[73078]: DEBUG nova.virt.disk.api [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Cannot resize image /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk to a smaller size. {{(pid=73078) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 19:02:25 user nova-compute[73078]: DEBUG nova.objects.instance [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lazy-loading 'migration_context' on Instance uuid bd8358d9-7e5c-42fb-97bc-928a7e02d146 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:02:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Created local disks {{(pid=73078) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 19:02:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Ensure instance console log exists: /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/console.log {{(pid=73078) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 19:02:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:02:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:02:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:02:25 user nova-compute[73078]: DEBUG nova.network.neutron [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Successfully updated port: fbc9cc5e-b965-459c-b461-dba3ec52a876 {{(pid=73078) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 19:02:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Acquiring lock "refresh_cache-bd8358d9-7e5c-42fb-97bc-928a7e02d146" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:02:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Acquired lock "refresh_cache-bd8358d9-7e5c-42fb-97bc-928a7e02d146" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:02:25 user nova-compute[73078]: DEBUG nova.network.neutron [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Building network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG nova.network.neutron [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Instance cache missing network info. {{(pid=73078) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG nova.compute.manager [req-1b8dfd61-c921-43d3-be0a-d0f76673b5bd req-895b41d6-9192-47ec-928e-7dff40f61b89 service nova] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Received event network-changed-fbc9cc5e-b965-459c-b461-dba3ec52a876 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG nova.compute.manager [req-1b8dfd61-c921-43d3-be0a-d0f76673b5bd req-895b41d6-9192-47ec-928e-7dff40f61b89 service nova] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Refreshing instance network info cache due to event network-changed-fbc9cc5e-b965-459c-b461-dba3ec52a876. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1b8dfd61-c921-43d3-be0a-d0f76673b5bd req-895b41d6-9192-47ec-928e-7dff40f61b89 service nova] Acquiring lock "refresh_cache-bd8358d9-7e5c-42fb-97bc-928a7e02d146" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG nova.network.neutron [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Updating instance_info_cache with network_info: [{"id": "fbc9cc5e-b965-459c-b461-dba3ec52a876", "address": "fa:16:3e:b0:49:bf", "network": {"id": "9e2aecd4-1e26-40ca-bc82-d84e3437e58a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-657604143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fd49ab1f5444559f1da52c6249c12e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbc9cc5e-b9", "ovs_interfaceid": "fbc9cc5e-b965-459c-b461-dba3ec52a876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Releasing lock "refresh_cache-bd8358d9-7e5c-42fb-97bc-928a7e02d146" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG nova.compute.manager [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Instance network_info: |[{"id": "fbc9cc5e-b965-459c-b461-dba3ec52a876", "address": "fa:16:3e:b0:49:bf", "network": {"id": "9e2aecd4-1e26-40ca-bc82-d84e3437e58a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-657604143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fd49ab1f5444559f1da52c6249c12e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbc9cc5e-b9", "ovs_interfaceid": "fbc9cc5e-b965-459c-b461-dba3ec52a876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73078) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1b8dfd61-c921-43d3-be0a-d0f76673b5bd req-895b41d6-9192-47ec-928e-7dff40f61b89 service nova] Acquired lock "refresh_cache-bd8358d9-7e5c-42fb-97bc-928a7e02d146" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG nova.network.neutron [req-1b8dfd61-c921-43d3-be0a-d0f76673b5bd req-895b41d6-9192-47ec-928e-7dff40f61b89 service nova] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Refreshing network info cache for port fbc9cc5e-b965-459c-b461-dba3ec52a876 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Start _get_guest_xml network_info=[{"id": "fbc9cc5e-b965-459c-b461-dba3ec52a876", "address": "fa:16:3e:b0:49:bf", "network": {"id": "9e2aecd4-1e26-40ca-bc82-d84e3437e58a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-657604143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fd49ab1f5444559f1da52c6249c12e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbc9cc5e-b9", "ovs_interfaceid": "fbc9cc5e-b965-459c-b461-dba3ec52a876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'image_id': '2cbd52c4-773f-4d5a-bbb1-b6f1221c7774'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 19:02:26 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:02:26 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:02:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] CPU controller missing on host. {{(pid=73078) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.host [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] CPU controller found on host. {{(pid=73078) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73078) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T18:06:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T18:07:06Z,direct_url=<?>,disk_format='qcow2',id=2cbd52c4-773f-4d5a-bbb1-b6f1221c7774,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d74e47e937341ec928819ea23835937',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T18:07:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Flavor limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Image limits 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Flavor pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Image pref 0:0:0 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73078) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Got 1 possible topologies {{(pid=73078) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG nova.virt.hardware [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73078) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:02:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-48135591',display_name='tempest-SnapshotDataIntegrityTests-server-48135591',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-48135591',id=53,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTmlzPrOTAyXidxA/SNzVi12sJ5nn5tCpvS8IKyzapouxtzrNwTvCJs59+DAdRkk1zIaOM7ob3Vl6GEjD8/GWrDXtZyNguEJuccYFa4QbYTioSjCxIEGPjyKSJ0O+KRgg==',key_name='tempest-keypair-120437743',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4fd49ab1f5444559f1da52c6249c12e',ramdisk_id='',reservation_id='r-myu06kgk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1645157422',owner_user_name='tempest-SnapshotDataIntegrityTests-1645157422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:02:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1378100bd4b4d7ebeb4ca2ef10339f6',uuid=bd8358d9-7e5c-42fb-97bc-928a7e02d146,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbc9cc5e-b965-459c-b461-dba3ec52a876", "address": "fa:16:3e:b0:49:bf", "network": {"id": "9e2aecd4-1e26-40ca-bc82-d84e3437e58a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-657604143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fd49ab1f5444559f1da52c6249c12e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbc9cc5e-b9", "ovs_interfaceid": "fbc9cc5e-b965-459c-b461-dba3ec52a876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73078) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Converting VIF {"id": "fbc9cc5e-b965-459c-b461-dba3ec52a876", "address": "fa:16:3e:b0:49:bf", "network": {"id": "9e2aecd4-1e26-40ca-bc82-d84e3437e58a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-657604143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fd49ab1f5444559f1da52c6249c12e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbc9cc5e-b9", "ovs_interfaceid": "fbc9cc5e-b965-459c-b461-dba3ec52a876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:49:bf,bridge_name='br-int',has_traffic_filtering=True,id=fbc9cc5e-b965-459c-b461-dba3ec52a876,network=Network(9e2aecd4-1e26-40ca-bc82-d84e3437e58a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbc9cc5e-b9') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG nova.objects.instance [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lazy-loading 'pci_devices' on Instance uuid bd8358d9-7e5c-42fb-97bc-928a7e02d146 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] End _get_guest_xml xml=<domain type="kvm">
Aug 14 19:02:26 user nova-compute[73078]:   <uuid>bd8358d9-7e5c-42fb-97bc-928a7e02d146</uuid>
Aug 14 19:02:26 user nova-compute[73078]:   <name>instance-00000035</name>
Aug 14 19:02:26 user nova-compute[73078]:   <memory>524288</memory>
Aug 14 19:02:26 user nova-compute[73078]:   <vcpu>1</vcpu>
Aug 14 19:02:26 user nova-compute[73078]:   <metadata>
Aug 14 19:02:26 user nova-compute[73078]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 19:02:26 user nova-compute[73078]:       <nova:package version="0.0.0"/>
Aug 14 19:02:26 user nova-compute[73078]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-48135591</nova:name>
Aug 14 19:02:26 user nova-compute[73078]:       <nova:creationTime>2023-08-14 19:02:26</nova:creationTime>
Aug 14 19:02:26 user nova-compute[73078]:       <nova:flavor name="m1.tiny">
Aug 14 19:02:26 user nova-compute[73078]:         <nova:memory>512</nova:memory>
Aug 14 19:02:26 user nova-compute[73078]:         <nova:disk>1</nova:disk>
Aug 14 19:02:26 user nova-compute[73078]:         <nova:swap>0</nova:swap>
Aug 14 19:02:26 user nova-compute[73078]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 19:02:26 user nova-compute[73078]:         <nova:vcpus>1</nova:vcpus>
Aug 14 19:02:26 user nova-compute[73078]:       </nova:flavor>
Aug 14 19:02:26 user nova-compute[73078]:       <nova:owner>
Aug 14 19:02:26 user nova-compute[73078]:         <nova:user uuid="d1378100bd4b4d7ebeb4ca2ef10339f6">tempest-SnapshotDataIntegrityTests-1645157422-project-member</nova:user>
Aug 14 19:02:26 user nova-compute[73078]:         <nova:project uuid="b4fd49ab1f5444559f1da52c6249c12e">tempest-SnapshotDataIntegrityTests-1645157422</nova:project>
Aug 14 19:02:26 user nova-compute[73078]:       </nova:owner>
Aug 14 19:02:26 user nova-compute[73078]:       <nova:root type="image" uuid="2cbd52c4-773f-4d5a-bbb1-b6f1221c7774"/>
Aug 14 19:02:26 user nova-compute[73078]:       <nova:ports>
Aug 14 19:02:26 user nova-compute[73078]:         <nova:port uuid="fbc9cc5e-b965-459c-b461-dba3ec52a876">
Aug 14 19:02:26 user nova-compute[73078]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 19:02:26 user nova-compute[73078]:         </nova:port>
Aug 14 19:02:26 user nova-compute[73078]:       </nova:ports>
Aug 14 19:02:26 user nova-compute[73078]:     </nova:instance>
Aug 14 19:02:26 user nova-compute[73078]:   </metadata>
Aug 14 19:02:26 user nova-compute[73078]:   <sysinfo type="smbios">
Aug 14 19:02:26 user nova-compute[73078]:     <system>
Aug 14 19:02:26 user nova-compute[73078]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 19:02:26 user nova-compute[73078]:       <entry name="product">OpenStack Nova</entry>
Aug 14 19:02:26 user nova-compute[73078]:       <entry name="version">0.0.0</entry>
Aug 14 19:02:26 user nova-compute[73078]:       <entry name="serial">bd8358d9-7e5c-42fb-97bc-928a7e02d146</entry>
Aug 14 19:02:26 user nova-compute[73078]:       <entry name="uuid">bd8358d9-7e5c-42fb-97bc-928a7e02d146</entry>
Aug 14 19:02:26 user nova-compute[73078]:       <entry name="family">Virtual Machine</entry>
Aug 14 19:02:26 user nova-compute[73078]:     </system>
Aug 14 19:02:26 user nova-compute[73078]:   </sysinfo>
Aug 14 19:02:26 user nova-compute[73078]:   <os>
Aug 14 19:02:26 user nova-compute[73078]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 19:02:26 user nova-compute[73078]:     <boot dev="hd"/>
Aug 14 19:02:26 user nova-compute[73078]:     <smbios mode="sysinfo"/>
Aug 14 19:02:26 user nova-compute[73078]:   </os>
Aug 14 19:02:26 user nova-compute[73078]:   <features>
Aug 14 19:02:26 user nova-compute[73078]:     <acpi/>
Aug 14 19:02:26 user nova-compute[73078]:     <apic/>
Aug 14 19:02:26 user nova-compute[73078]:     <vmcoreinfo/>
Aug 14 19:02:26 user nova-compute[73078]:   </features>
Aug 14 19:02:26 user nova-compute[73078]:   <clock offset="utc">
Aug 14 19:02:26 user nova-compute[73078]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 19:02:26 user nova-compute[73078]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 19:02:26 user nova-compute[73078]:     <timer name="hpet" present="no"/>
Aug 14 19:02:26 user nova-compute[73078]:   </clock>
Aug 14 19:02:26 user nova-compute[73078]:   <cpu mode="custom" match="exact">
Aug 14 19:02:26 user nova-compute[73078]:     <model>Nehalem</model>
Aug 14 19:02:26 user nova-compute[73078]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 19:02:26 user nova-compute[73078]:   </cpu>
Aug 14 19:02:26 user nova-compute[73078]:   <devices>
Aug 14 19:02:26 user nova-compute[73078]:     <disk type="file" device="disk">
Aug 14 19:02:26 user nova-compute[73078]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 19:02:26 user nova-compute[73078]:       <source file="/opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk"/>
Aug 14 19:02:26 user nova-compute[73078]:       <target dev="vda" bus="virtio"/>
Aug 14 19:02:26 user nova-compute[73078]:     </disk>
Aug 14 19:02:26 user nova-compute[73078]:     <interface type="ethernet">
Aug 14 19:02:26 user nova-compute[73078]:       <mac address="fa:16:3e:b0:49:bf"/>
Aug 14 19:02:26 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 19:02:26 user nova-compute[73078]:       <mtu size="1442"/>
Aug 14 19:02:26 user nova-compute[73078]:       <target dev="tapfbc9cc5e-b9"/>
Aug 14 19:02:26 user nova-compute[73078]:     </interface>
Aug 14 19:02:26 user nova-compute[73078]:     <serial type="pty">
Aug 14 19:02:26 user nova-compute[73078]:       <log file="/opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/console.log" append="off"/>
Aug 14 19:02:26 user nova-compute[73078]:     </serial>
Aug 14 19:02:26 user nova-compute[73078]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 19:02:26 user nova-compute[73078]:     <video>
Aug 14 19:02:26 user nova-compute[73078]:       <model type="virtio"/>
Aug 14 19:02:26 user nova-compute[73078]:     </video>
Aug 14 19:02:26 user nova-compute[73078]:     <rng model="virtio">
Aug 14 19:02:26 user nova-compute[73078]:       <backend model="random">/dev/urandom</backend>
Aug 14 19:02:26 user nova-compute[73078]:     </rng>
Aug 14 19:02:26 user nova-compute[73078]:     <controller type="usb" index="0" model="none"/>
Aug 14 19:02:26 user nova-compute[73078]:     <memballoon model="virtio">
Aug 14 19:02:26 user nova-compute[73078]:       <stats period="10"/>
Aug 14 19:02:26 user nova-compute[73078]:     </memballoon>
Aug 14 19:02:26 user nova-compute[73078]:   </devices>
Aug 14 19:02:26 user nova-compute[73078]: </domain>
Aug 14 19:02:26 user nova-compute[73078]:  {{(pid=73078) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:02:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-48135591',display_name='tempest-SnapshotDataIntegrityTests-server-48135591',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-48135591',id=53,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTmlzPrOTAyXidxA/SNzVi12sJ5nn5tCpvS8IKyzapouxtzrNwTvCJs59+DAdRkk1zIaOM7ob3Vl6GEjD8/GWrDXtZyNguEJuccYFa4QbYTioSjCxIEGPjyKSJ0O+KRgg==',key_name='tempest-keypair-120437743',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4fd49ab1f5444559f1da52c6249c12e',ramdisk_id='',reservation_id='r-myu06kgk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1645157422',owner_user_name='tempest-SnapshotDataIntegrityTests-1645157422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T19:02:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1378100bd4b4d7ebeb4ca2ef10339f6',uuid=bd8358d9-7e5c-42fb-97bc-928a7e02d146,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbc9cc5e-b965-459c-b461-dba3ec52a876", "address": "fa:16:3e:b0:49:bf", "network": {"id": "9e2aecd4-1e26-40ca-bc82-d84e3437e58a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-657604143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fd49ab1f5444559f1da52c6249c12e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbc9cc5e-b9", "ovs_interfaceid": "fbc9cc5e-b965-459c-b461-dba3ec52a876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Converting VIF {"id": "fbc9cc5e-b965-459c-b461-dba3ec52a876", "address": "fa:16:3e:b0:49:bf", "network": {"id": "9e2aecd4-1e26-40ca-bc82-d84e3437e58a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-657604143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fd49ab1f5444559f1da52c6249c12e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbc9cc5e-b9", "ovs_interfaceid": "fbc9cc5e-b965-459c-b461-dba3ec52a876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:49:bf,bridge_name='br-int',has_traffic_filtering=True,id=fbc9cc5e-b965-459c-b461-dba3ec52a876,network=Network(9e2aecd4-1e26-40ca-bc82-d84e3437e58a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbc9cc5e-b9') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG os_vif [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:49:bf,bridge_name='br-int',has_traffic_filtering=True,id=fbc9cc5e-b965-459c-b461-dba3ec52a876,network=Network(9e2aecd4-1e26-40ca-bc82-d84e3437e58a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbc9cc5e-b9') {{(pid=73078) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfbc9cc5e-b9, may_exist=True, interface_attrs={}) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfbc9cc5e-b9, col_values=(('external_ids', {'iface-id': 'fbc9cc5e-b965-459c-b461-dba3ec52a876', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:49:bf', 'vm-uuid': 'bd8358d9-7e5c-42fb-97bc-928a7e02d146'}),), if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:02:26 user nova-compute[73078]: INFO os_vif [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:49:bf,bridge_name='br-int',has_traffic_filtering=True,id=fbc9cc5e-b965-459c-b461-dba3ec52a876,network=Network(9e2aecd4-1e26-40ca-bc82-d84e3437e58a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbc9cc5e-b9')
Aug 14 19:02:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] No VIF found with MAC fa:16:3e:b0:49:bf, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG nova.network.neutron [req-1b8dfd61-c921-43d3-be0a-d0f76673b5bd req-895b41d6-9192-47ec-928e-7dff40f61b89 service nova] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Updated VIF entry in instance network info cache for port fbc9cc5e-b965-459c-b461-dba3ec52a876. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG nova.network.neutron [req-1b8dfd61-c921-43d3-be0a-d0f76673b5bd req-895b41d6-9192-47ec-928e-7dff40f61b89 service nova] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Updating instance_info_cache with network_info: [{"id": "fbc9cc5e-b965-459c-b461-dba3ec52a876", "address": "fa:16:3e:b0:49:bf", "network": {"id": "9e2aecd4-1e26-40ca-bc82-d84e3437e58a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-657604143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fd49ab1f5444559f1da52c6249c12e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbc9cc5e-b9", "ovs_interfaceid": "fbc9cc5e-b965-459c-b461-dba3ec52a876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:02:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-1b8dfd61-c921-43d3-be0a-d0f76673b5bd req-895b41d6-9192-47ec-928e-7dff40f61b89 service nova] Releasing lock "refresh_cache-bd8358d9-7e5c-42fb-97bc-928a7e02d146" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:02:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:02:27 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:02:28 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:02:28 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 19:02:28 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Rebuilding the list of instances to heal {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 19:02:28 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Skipping network cache update for instance because it is Building. {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 14 19:02:28 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Didn't find any instances for network info cache update. {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 19:02:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:02:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:02:28 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:02:28 user nova-compute[73078]: DEBUG nova.compute.manager [req-6a9dac10-c852-441e-ba11-95d20ed69558 req-54f4a5fa-1b8f-4d29-a9cb-327054ed4991 service nova] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Received event network-vif-plugged-fbc9cc5e-b965-459c-b461-dba3ec52a876 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:02:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6a9dac10-c852-441e-ba11-95d20ed69558 req-54f4a5fa-1b8f-4d29-a9cb-327054ed4991 service nova] Acquiring lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:02:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6a9dac10-c852-441e-ba11-95d20ed69558 req-54f4a5fa-1b8f-4d29-a9cb-327054ed4991 service nova] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:02:28 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-6a9dac10-c852-441e-ba11-95d20ed69558 req-54f4a5fa-1b8f-4d29-a9cb-327054ed4991 service nova] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:02:28 user nova-compute[73078]: DEBUG nova.compute.manager [req-6a9dac10-c852-441e-ba11-95d20ed69558 req-54f4a5fa-1b8f-4d29-a9cb-327054ed4991 service nova] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] No waiting events found dispatching network-vif-plugged-fbc9cc5e-b965-459c-b461-dba3ec52a876 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:02:28 user nova-compute[73078]: WARNING nova.compute.manager [req-6a9dac10-c852-441e-ba11-95d20ed69558 req-54f4a5fa-1b8f-4d29-a9cb-327054ed4991 service nova] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Received unexpected event network-vif-plugged-fbc9cc5e-b965-459c-b461-dba3ec52a876 for instance with vm_state building and task_state spawning.
Aug 14 19:02:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:02:29 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:02:30 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:02:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:02:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:02:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:02:30 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 19:02:30 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692039750.2139084, bd8358d9-7e5c-42fb-97bc-928a7e02d146 => Resumed> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:02:30 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] VM Resumed (Lifecycle Event)
Aug 14 19:02:30 user nova-compute[73078]: DEBUG nova.compute.manager [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Instance event wait completed in 0 seconds for  {{(pid=73078) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 19:02:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Guest created on hypervisor {{(pid=73078) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 19:02:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:02:30 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:02:30 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Instance spawned successfully.
Aug 14 19:02:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 19:02:30 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:02:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Found default for hw_cdrom_bus of ide {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:02:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Found default for hw_disk_bus of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:02:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Found default for hw_input_bus of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:02:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Found default for hw_pointer_model of None {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:02:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Found default for hw_video_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:02:30 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Found default for hw_vif_model of virtio {{(pid=73078) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 19:02:30 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:02:30 user nova-compute[73078]: DEBUG nova.virt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Emitting event <LifecycleEvent: 1692039750.2158563, bd8358d9-7e5c-42fb-97bc-928a7e02d146 => Started> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:02:30 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] VM Started (Lifecycle Event)
Aug 14 19:02:30 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:02:30 user nova-compute[73078]: DEBUG nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73078) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 19:02:30 user nova-compute[73078]: INFO nova.compute.manager [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 19:02:30 user nova-compute[73078]: INFO nova.compute.manager [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Took 6.00 seconds to spawn the instance on the hypervisor.
Aug 14 19:02:30 user nova-compute[73078]: DEBUG nova.compute.manager [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:02:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:02:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:02:30 user nova-compute[73078]: INFO nova.compute.manager [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Took 6.75 seconds to build instance.
Aug 14 19:02:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-20d10699-233c-412b-afee-a43d72b940cf tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.882s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:02:30 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:02:31 user nova-compute[73078]: DEBUG nova.compute.manager [req-dd9e6b46-9d71-4f29-886c-40e486f02f6a req-caa83f93-1d28-454f-bae2-0663fa9121da service nova] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Received event network-vif-plugged-fbc9cc5e-b965-459c-b461-dba3ec52a876 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:02:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-dd9e6b46-9d71-4f29-886c-40e486f02f6a req-caa83f93-1d28-454f-bae2-0663fa9121da service nova] Acquiring lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:02:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-dd9e6b46-9d71-4f29-886c-40e486f02f6a req-caa83f93-1d28-454f-bae2-0663fa9121da service nova] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:02:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-dd9e6b46-9d71-4f29-886c-40e486f02f6a req-caa83f93-1d28-454f-bae2-0663fa9121da service nova] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:02:31 user nova-compute[73078]: DEBUG nova.compute.manager [req-dd9e6b46-9d71-4f29-886c-40e486f02f6a req-caa83f93-1d28-454f-bae2-0663fa9121da service nova] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] No waiting events found dispatching network-vif-plugged-fbc9cc5e-b965-459c-b461-dba3ec52a876 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:02:31 user nova-compute[73078]: WARNING nova.compute.manager [req-dd9e6b46-9d71-4f29-886c-40e486f02f6a req-caa83f93-1d28-454f-bae2-0663fa9121da service nova] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Received unexpected event network-vif-plugged-fbc9cc5e-b965-459c-b461-dba3ec52a876 for instance with vm_state active and task_state None.
Aug 14 19:02:31 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:02:31 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:02:31 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=8545MB free_disk=25.059432983398438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 19:02:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:02:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:02:31 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance bd8358d9-7e5c-42fb-97bc-928a7e02d146 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:02:31 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 19:02:31 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 19:02:31 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Refreshing inventories for resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 19:02:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:02:31 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Updating ProviderTree inventory for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 19:02:31 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Updating inventory in ProviderTree for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 19:02:31 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Refreshing aggregate associations for resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b, aggregates: None {{(pid=73078) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 19:02:31 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Refreshing trait associations for resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV {{(pid=73078) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 19:02:31 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:02:31 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:02:31 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 19:02:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.519s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:02:33 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:02:33 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:02:33 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:02:33 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 19:02:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:02:36 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:02:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:02:40 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:02:41 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:02:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:02:42 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:02:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:02:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:02:48 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:02:48 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73078) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 19:02:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:02:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:02:52 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:02:52 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Cleaning up deleted instances {{(pid=73078) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 19:02:52 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] There are 0 instances to clean {{(pid=73078) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 19:02:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:02:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:02:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:03:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:03:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:03:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:03:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:03:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:03:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:03:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:03:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:03:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:03:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:03:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:03:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:03:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:03:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:03:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:03:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:03:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:03:29 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:03:29 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 19:03:29 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Rebuilding the list of instances to heal {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 19:03:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-bd8358d9-7e5c-42fb-97bc-928a7e02d146" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:03:29 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-bd8358d9-7e5c-42fb-97bc-928a7e02d146" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:03:29 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 19:03:29 user nova-compute[73078]: DEBUG nova.objects.instance [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lazy-loading 'info_cache' on Instance uuid bd8358d9-7e5c-42fb-97bc-928a7e02d146 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:03:30 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Updating instance_info_cache with network_info: [{"id": "fbc9cc5e-b965-459c-b461-dba3ec52a876", "address": "fa:16:3e:b0:49:bf", "network": {"id": "9e2aecd4-1e26-40ca-bc82-d84e3437e58a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-657604143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fd49ab1f5444559f1da52c6249c12e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbc9cc5e-b9", "ovs_interfaceid": "fbc9cc5e-b965-459c-b461-dba3ec52a876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:03:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-bd8358d9-7e5c-42fb-97bc-928a7e02d146" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:03:30 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 19:03:31 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:03:31 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:03:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:03:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:03:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:03:31 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 19:03:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:03:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:03:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:03:31 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:03:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:03:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:03:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:03:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:03:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:03:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:03:31 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:03:31 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:03:31 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=8587MB free_disk=25.020187377929688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 19:03:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:03:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:03:32 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance bd8358d9-7e5c-42fb-97bc-928a7e02d146 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:03:32 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 19:03:32 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 19:03:32 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:03:32 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:03:32 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 19:03:32 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:03:34 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:03:34 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:03:34 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:03:34 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 19:03:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4663-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:03:38 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:03:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:03:42 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:03:43 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:03:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:03:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:03:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:03:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:03:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:03:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:03:51 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:03:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:03:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:03:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:03:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:03:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:03:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:03:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:04:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:04:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:04:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:04:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:04:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:04:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:04:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:04:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:04:12 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:04:15 user nova-compute[73078]: DEBUG nova.compute.manager [req-80253964-d744-4269-b7ff-066ed038e832 req-686c49be-3db1-47d0-8ee5-c3131f30af87 service nova] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Received event network-changed-fbc9cc5e-b965-459c-b461-dba3ec52a876 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:04:15 user nova-compute[73078]: DEBUG nova.compute.manager [req-80253964-d744-4269-b7ff-066ed038e832 req-686c49be-3db1-47d0-8ee5-c3131f30af87 service nova] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Refreshing instance network info cache due to event network-changed-fbc9cc5e-b965-459c-b461-dba3ec52a876. {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 19:04:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-80253964-d744-4269-b7ff-066ed038e832 req-686c49be-3db1-47d0-8ee5-c3131f30af87 service nova] Acquiring lock "refresh_cache-bd8358d9-7e5c-42fb-97bc-928a7e02d146" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:04:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-80253964-d744-4269-b7ff-066ed038e832 req-686c49be-3db1-47d0-8ee5-c3131f30af87 service nova] Acquired lock "refresh_cache-bd8358d9-7e5c-42fb-97bc-928a7e02d146" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:04:15 user nova-compute[73078]: DEBUG nova.network.neutron [req-80253964-d744-4269-b7ff-066ed038e832 req-686c49be-3db1-47d0-8ee5-c3131f30af87 service nova] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Refreshing network info cache for port fbc9cc5e-b965-459c-b461-dba3ec52a876 {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 19:04:15 user nova-compute[73078]: DEBUG nova.network.neutron [req-80253964-d744-4269-b7ff-066ed038e832 req-686c49be-3db1-47d0-8ee5-c3131f30af87 service nova] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Updated VIF entry in instance network info cache for port fbc9cc5e-b965-459c-b461-dba3ec52a876. {{(pid=73078) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 19:04:15 user nova-compute[73078]: DEBUG nova.network.neutron [req-80253964-d744-4269-b7ff-066ed038e832 req-686c49be-3db1-47d0-8ee5-c3131f30af87 service nova] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Updating instance_info_cache with network_info: [{"id": "fbc9cc5e-b965-459c-b461-dba3ec52a876", "address": "fa:16:3e:b0:49:bf", "network": {"id": "9e2aecd4-1e26-40ca-bc82-d84e3437e58a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-657604143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fd49ab1f5444559f1da52c6249c12e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbc9cc5e-b9", "ovs_interfaceid": "fbc9cc5e-b965-459c-b461-dba3ec52a876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:04:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-80253964-d744-4269-b7ff-066ed038e832 req-686c49be-3db1-47d0-8ee5-c3131f30af87 service nova] Releasing lock "refresh_cache-bd8358d9-7e5c-42fb-97bc-928a7e02d146" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:04:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:04:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:04:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:04:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:04:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Acquiring lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:04:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:04:25 user nova-compute[73078]: DEBUG nova.objects.instance [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lazy-loading 'flavor' on Instance uuid bd8358d9-7e5c-42fb-97bc-928a7e02d146 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:04:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:04:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Acquiring lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:04:25 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:04:25 user nova-compute[73078]: INFO nova.compute.manager [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Attaching volume ec2a33c6-b74f-4a84-af61-ad512b5c47aa to /dev/vdb
Aug 14 19:04:25 user nova-compute[73078]: DEBUG os_brick.utils [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:04:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:04:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:04:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9a80be-7633-40d3-945e-43dcd94851e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:04:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:04:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:04:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdbd2d3-fddf-495b-bd01-c820dbc5158a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:04:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:04:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:04:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e74550-2ecc-47e8-bfe0-c06102cbd55c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:04:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54b7d12-2e04-45d6-b788-31d8e7efa82e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:04:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:04:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:04:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:04:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:04:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:04:25 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:04:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[15efd9d8-0236-438f-820c-9590670198dd]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:04:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:04:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:04:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:04:25 user nova-compute[73078]: DEBUG os_brick.utils [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:04:25 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Updating existing volume attachment record: 8dcea24b-98a7-46a5-9da2-7bbe957e22cd {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 19:04:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:04:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:04:30 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:04:30 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 19:04:30 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Rebuilding the list of instances to heal {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 19:04:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-bd8358d9-7e5c-42fb-97bc-928a7e02d146" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:04:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-bd8358d9-7e5c-42fb-97bc-928a7e02d146" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:04:30 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 19:04:30 user nova-compute[73078]: DEBUG nova.objects.instance [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lazy-loading 'info_cache' on Instance uuid bd8358d9-7e5c-42fb-97bc-928a7e02d146 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:04:31 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Updating instance_info_cache with network_info: [{"id": "fbc9cc5e-b965-459c-b461-dba3ec52a876", "address": "fa:16:3e:b0:49:bf", "network": {"id": "9e2aecd4-1e26-40ca-bc82-d84e3437e58a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-657604143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fd49ab1f5444559f1da52c6249c12e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbc9cc5e-b9", "ovs_interfaceid": "fbc9cc5e-b965-459c-b461-dba3ec52a876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:04:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-bd8358d9-7e5c-42fb-97bc-928a7e02d146" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:04:31 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 19:04:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:04:33 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:04:33 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:04:33 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:04:33 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:04:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:04:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:04:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:04:33 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 19:04:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:04:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:04:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:04:33 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:04:33 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:04:33 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:04:33 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=8743MB free_disk=25.017391204833984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 19:04:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:04:34 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:04:34 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance bd8358d9-7e5c-42fb-97bc-928a7e02d146 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:04:34 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 19:04:34 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 19:04:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:04:34 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:04:34 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:04:34 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 19:04:34 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:04:35 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:04:35 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 19:04:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZEDJvazy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:04:37 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:04:37 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:04:37 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:04:37 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:04:37 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:04:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[92169148-62d3-405f-8b31-b9ee06fbc272]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:04:37 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e1add6-5e63-4f09-b58a-378de53a62df]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa] added
Aug 14 19:04:37 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[aded253d-46d5-418c-86d1-f520b430321b]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6af9f8-a98f-4278-8319-c24fa4e1362f]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZEDJvazy {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZEDJvazy" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[127f8a71-dac1-41ca-94a7-3b5eccc32371]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZEDJvazy'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2bdf30-0447-490d-8f45-e804e5394579]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5fb032-6072-4ce2-8f09-13b7d6da79cc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 19:04:37 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 19:04:37 user nova-compute[73078]:  {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:04:37 user nova-compute[73078]: WARNING os_brick.initiator.connectors.iscsi [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 19:04:37 user nova-compute[73078]: 
Aug 14 19:04:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab2b34d-0a37-4356-99bc-112294a4b324]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa, portal: 172.16.0.220,3260]
Aug 14 19:04:37 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa, portal: 172.16.0.220,3260] successful.
Aug 14 19:04:37 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[619714ea-766a-42c3-b34a-79d6317b6318]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4766b6-7e41-41d9-82a2-5d9c5b8cd32d]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa (non-flash)
Aug 14 19:04:37 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa (non-flash)
Aug 14 19:04:37 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.236s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[540980db-b59b-46e2-a8dc-9a76740d6ba7]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:04:37 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:04:38 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:04:38 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:04:38 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZEDJvazy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:04:38 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.269s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:04:38 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] <== connect_volume: return (1270ms) {'type': 'block', 'scsi_wwn': '26439383536306364', 'path': '/dev/sdb'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:04:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439383536306364', 'path': '/dev/sdb'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:04:38 user nova-compute[73078]: DEBUG nova.objects.instance [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lazy-loading 'flavor' on Instance uuid bd8358d9-7e5c-42fb-97bc-928a7e02d146 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:04:38 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 19:04:38 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:04:38 user nova-compute[73078]:   <source dev="/dev/sdb"/>
Aug 14 19:04:38 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:04:38 user nova-compute[73078]:   <serial>ec2a33c6-b74f-4a84-af61-ad512b5c47aa</serial>
Aug 14 19:04:38 user nova-compute[73078]: </disk>
Aug 14 19:04:38 user nova-compute[73078]:  {{(pid=73078) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 19:04:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:04:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:04:39 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] No VIF found with MAC fa:16:3e:b0:49:bf, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:04:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-28cc88a6-2a17-4c20-a080-c59e13adc88b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.729s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:04:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:04:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:04:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:04:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:04:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:04:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:04:42 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:04:43 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:04:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:04:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:04:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:04:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:04:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:04:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:04:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:05:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-02078510-8972-4163-8213-a82739c7a017 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Acquiring lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-02078510-8972-4163-8213-a82739c7a017 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:05:04 user nova-compute[73078]: INFO nova.compute.manager [None req-02078510-8972-4163-8213-a82739c7a017 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Detaching volume ec2a33c6-b74f-4a84-af61-ad512b5c47aa
Aug 14 19:05:04 user nova-compute[73078]: INFO nova.virt.block_device [None req-02078510-8972-4163-8213-a82739c7a017 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Attempting to driver detach volume ec2a33c6-b74f-4a84-af61-ad512b5c47aa from mountpoint /dev/vdb
Aug 14 19:05:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-02078510-8972-4163-8213-a82739c7a017 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Attempting to detach device vdb from instance bd8358d9-7e5c-42fb-97bc-928a7e02d146 from the persistent domain config. {{(pid=73078) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-02078510-8972-4163-8213-a82739c7a017 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:05:04 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:05:04 user nova-compute[73078]:   <source dev="/dev/sdb"/>
Aug 14 19:05:04 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:05:04 user nova-compute[73078]:   <serial>ec2a33c6-b74f-4a84-af61-ad512b5c47aa</serial>
Aug 14 19:05:04 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 19:05:04 user nova-compute[73078]: </disk>
Aug 14 19:05:04 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:05:04 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-02078510-8972-4163-8213-a82739c7a017 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Successfully detached device vdb from instance bd8358d9-7e5c-42fb-97bc-928a7e02d146 from the persistent domain config.
Aug 14 19:05:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-02078510-8972-4163-8213-a82739c7a017 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bd8358d9-7e5c-42fb-97bc-928a7e02d146 from the live domain config. {{(pid=73078) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-02078510-8972-4163-8213-a82739c7a017 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:05:04 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:05:04 user nova-compute[73078]:   <source dev="/dev/sdb"/>
Aug 14 19:05:04 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:05:04 user nova-compute[73078]:   <serial>ec2a33c6-b74f-4a84-af61-ad512b5c47aa</serial>
Aug 14 19:05:04 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 19:05:04 user nova-compute[73078]: </disk>
Aug 14 19:05:04 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Received event <DeviceRemovedEvent: 1692039904.7046685, bd8358d9-7e5c-42fb-97bc-928a7e02d146 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73078) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-02078510-8972-4163-8213-a82739c7a017 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bd8358d9-7e5c-42fb-97bc-928a7e02d146 {{(pid=73078) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 19:05:04 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-02078510-8972-4163-8213-a82739c7a017 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Successfully detached device vdb from instance bd8358d9-7e5c-42fb-97bc-928a7e02d146 from the live domain config.
Aug 14 19:05:04 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02078510-8972-4163-8213-a82739c7a017 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-02078510-8972-4163-8213-a82739c7a017 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZEDJvazy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:05:04 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-02078510-8972-4163-8213-a82739c7a017 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:05:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-02078510-8972-4163-8213-a82739c7a017 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-02078510-8972-4163-8213-a82739c7a017 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-02078510-8972-4163-8213-a82739c7a017 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6c6fc9-d741-483d-83f0-cec5154c84eb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a305df46-bc89-48d1-9747-cc9be63982fc]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-02078510-8972-4163-8213-a82739c7a017 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa (non-flash)
Aug 14 19:05:04 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-02078510-8972-4163-8213-a82739c7a017 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa (non-flash)
Aug 14 19:05:04 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-02078510-8972-4163-8213-a82739c7a017 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe97828e8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa'): ({'sdb'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-02078510-8972-4163-8213-a82739c7a017 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Removing single pathed devices sdb {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7caf88-b19a-4fac-9dd3-17b6dc2cf185]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63b3e79-6134-4c31-98b3-02798d13d1ef]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-02078510-8972-4163-8213-a82739c7a017 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Flushing IO for device /dev/sdb {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9dd97d-6e47-43d5-a68d-5a34e4b956db]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-02078510-8972-4163-8213-a82739c7a017 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4279447e-7926-48be-8121-19b9968377a0]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-02078510-8972-4163-8213-a82739c7a017 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-02078510-8972-4163-8213-a82739c7a017 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] SCSI volumes sdb have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-02078510-8972-4163-8213-a82739c7a017 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba676143-f7c0-422c-9776-de60a53ecae9]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-02078510-8972-4163-8213-a82739c7a017 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0452694-896e-43de-a4eb-c085970c8dcc]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-02078510-8972-4163-8213-a82739c7a017 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa, portal: 172.16.0.220,3260]
Aug 14 19:05:04 user nova-compute[73078]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa, portal: 172.16.0.220,3260] successful.
Aug 14 19:05:04 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:05:04 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:05:05 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec2a33c6-b74f-4a84-af61-ad512b5c47aa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:05:05 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb05efe1-1637-47f6-967c-648b0ff4a890]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:05:05 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-02078510-8972-4163-8213-a82739c7a017 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:05:05 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-02078510-8972-4163-8213-a82739c7a017 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:05:05 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-02078510-8972-4163-8213-a82739c7a017 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] <== disconnect_volume: return (291ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:05:05 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02078510-8972-4163-8213-a82739c7a017 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:05:05 user nova-compute[73078]: DEBUG nova.objects.instance [None req-02078510-8972-4163-8213-a82739c7a017 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lazy-loading 'flavor' on Instance uuid bd8358d9-7e5c-42fb-97bc-928a7e02d146 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:05:05 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-02078510-8972-4163-8213-a82739c7a017 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.677s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:05:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:05:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:05:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:05:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:05:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:05:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:05:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:05:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:05:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:05:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:05:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:05:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:05:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:05:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:05:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:05:30 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:05:30 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 19:05:30 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Rebuilding the list of instances to heal {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 19:05:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-bd8358d9-7e5c-42fb-97bc-928a7e02d146" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:05:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-bd8358d9-7e5c-42fb-97bc-928a7e02d146" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:05:30 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 19:05:30 user nova-compute[73078]: DEBUG nova.objects.instance [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lazy-loading 'info_cache' on Instance uuid bd8358d9-7e5c-42fb-97bc-928a7e02d146 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:05:30 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Updating instance_info_cache with network_info: [{"id": "fbc9cc5e-b965-459c-b461-dba3ec52a876", "address": "fa:16:3e:b0:49:bf", "network": {"id": "9e2aecd4-1e26-40ca-bc82-d84e3437e58a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-657604143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fd49ab1f5444559f1da52c6249c12e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbc9cc5e-b9", "ovs_interfaceid": "fbc9cc5e-b965-459c-b461-dba3ec52a876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:05:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-bd8358d9-7e5c-42fb-97bc-928a7e02d146" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:05:30 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 19:05:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:05:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:05:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:05:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:05:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:05:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:05:34 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:05:34 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:05:35 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:05:35 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:05:35 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 19:05:35 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:05:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:05:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:05:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:05:35 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 19:05:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:05:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:05:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:05:35 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:05:35 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:05:35 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:05:35 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=8792MB free_disk=25.016098022460938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 19:05:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:05:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:05:36 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance bd8358d9-7e5c-42fb-97bc-928a7e02d146 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:05:36 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 19:05:36 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 19:05:36 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:05:36 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:05:36 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 19:05:36 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.332s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:05:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:05:40 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:05:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:05:42 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:05:43 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:05:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:05:51 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:05:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:05:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:05:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:05:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:05:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:05:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:05:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:05:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Acquiring lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:05:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:05:58 user nova-compute[73078]: DEBUG nova.objects.instance [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lazy-loading 'flavor' on Instance uuid bd8358d9-7e5c-42fb-97bc-928a7e02d146 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:05:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:05:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Acquiring lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:05:58 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:05:58 user nova-compute[73078]: INFO nova.compute.manager [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Attaching volume e283f035-7f90-4197-998c-2f87ae15f35e to /dev/vdb
Aug 14 19:05:58 user nova-compute[73078]: DEBUG os_brick.utils [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:05:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:05:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:05:58 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0576853-e1e2-454e-9f10-b06b9f7e9304]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:05:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:05:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:05:58 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a630ef1-7333-4544-9e25-d01d7a310c3c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:05:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:05:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:05:58 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc3afb2-67de-4ec8-ade6-f81cc50a7301]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:05:58 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e446b58-fc4a-4578-9c01-bb8f487e7899]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:05:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:05:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:05:58 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:05:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:05:58 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:05:58 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:05:58 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4db47d1-0d49-48b9-98a5-3f6f4e69ba5f]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:05:58 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:05:58 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:05:58 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:05:58 user nova-compute[73078]: DEBUG os_brick.utils [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:05:58 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Updating existing volume attachment record: 8f4e07ff-6419-4ac0-9724-18e6a6babfb5 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 19:05:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:06:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:06:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:06:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:06:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:06:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:06:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:06:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXWDjCkz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:06:07 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:06:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:06:07 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:06:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:06:07 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:06:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc8fdf3-94b3-4a35-9faa-ab5c229a132e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:06:07 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f35371-102c-4227-b5ba-9ebc5a343c8d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e] added
Aug 14 19:06:07 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b253bf2-977b-475f-a7e5-90b9851498fa]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf0b9b4-fd7a-4af1-9280-48a048937a87]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EXWDjCkz {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EXWDjCkz" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a54436c-b89d-4dab-946c-db21112776e6]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EXWDjCkz'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[649e073e-f256-4b89-b49f-e94e6df7ca05]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3577219-643c-4e19-9998-f1cec6e4ac20]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 19:06:07 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 19:06:07 user nova-compute[73078]:  {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:06:07 user nova-compute[73078]: WARNING os_brick.initiator.connectors.iscsi [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 19:06:07 user nova-compute[73078]: 
Aug 14 19:06:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e -p 172.16.0.220:3260 --login" returned: 0 in 0.135s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f57728-eed7-41ee-89d5-d598764409fd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e, portal: 172.16.0.220,3260]
Aug 14 19:06:07 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e, portal: 172.16.0.220,3260] successful.
Aug 14 19:06:07 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62f8153-dfd4-4120-a1b4-90770b1631f4]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[69aa564a-863b-4512-8977-b4c56b043a05]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e (non-flash)
Aug 14 19:06:07 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e (non-flash)
Aug 14 19:06:07 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bf93d3-8734-43d8-9d0c-9c80a0c1cb11]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:06:07 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:06:08 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:06:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXWDjCkz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:06:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:06:08 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23062393264653933', 'path': '/dev/sdb'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:06:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062393264653933', 'path': '/dev/sdb'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:06:08 user nova-compute[73078]: DEBUG nova.objects.instance [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lazy-loading 'flavor' on Instance uuid bd8358d9-7e5c-42fb-97bc-928a7e02d146 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:06:08 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 19:06:08 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:06:08 user nova-compute[73078]:   <source dev="/dev/sdb"/>
Aug 14 19:06:08 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:06:08 user nova-compute[73078]:   <serial>e283f035-7f90-4197-998c-2f87ae15f35e</serial>
Aug 14 19:06:08 user nova-compute[73078]: </disk>
Aug 14 19:06:08 user nova-compute[73078]:  {{(pid=73078) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 19:06:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:06:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:06:09 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] No VIF found with MAC fa:16:3e:b0:49:bf, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:06:09 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-cc1ee9cf-dcca-4f4d-80f5-8c307c1f1161 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.724s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:06:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-71994647-c3e0-437c-a39c-fc674fe0ed5a tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Acquiring lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:06:10 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-71994647-c3e0-437c-a39c-fc674fe0ed5a tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:06:11 user nova-compute[73078]: INFO nova.compute.manager [None req-71994647-c3e0-437c-a39c-fc674fe0ed5a tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Detaching volume e283f035-7f90-4197-998c-2f87ae15f35e
Aug 14 19:06:11 user nova-compute[73078]: INFO nova.virt.block_device [None req-71994647-c3e0-437c-a39c-fc674fe0ed5a tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Attempting to driver detach volume e283f035-7f90-4197-998c-2f87ae15f35e from mountpoint /dev/vdb
Aug 14 19:06:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-71994647-c3e0-437c-a39c-fc674fe0ed5a tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Attempting to detach device vdb from instance bd8358d9-7e5c-42fb-97bc-928a7e02d146 from the persistent domain config. {{(pid=73078) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-71994647-c3e0-437c-a39c-fc674fe0ed5a tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:06:11 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:06:11 user nova-compute[73078]:   <source dev="/dev/sdb"/>
Aug 14 19:06:11 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:06:11 user nova-compute[73078]:   <serial>e283f035-7f90-4197-998c-2f87ae15f35e</serial>
Aug 14 19:06:11 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 19:06:11 user nova-compute[73078]: </disk>
Aug 14 19:06:11 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:06:11 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-71994647-c3e0-437c-a39c-fc674fe0ed5a tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Successfully detached device vdb from instance bd8358d9-7e5c-42fb-97bc-928a7e02d146 from the persistent domain config.
Aug 14 19:06:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-71994647-c3e0-437c-a39c-fc674fe0ed5a tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bd8358d9-7e5c-42fb-97bc-928a7e02d146 from the live domain config. {{(pid=73078) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-71994647-c3e0-437c-a39c-fc674fe0ed5a tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:06:11 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:06:11 user nova-compute[73078]:   <source dev="/dev/sdb"/>
Aug 14 19:06:11 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:06:11 user nova-compute[73078]:   <serial>e283f035-7f90-4197-998c-2f87ae15f35e</serial>
Aug 14 19:06:11 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 19:06:11 user nova-compute[73078]: </disk>
Aug 14 19:06:11 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Received event <DeviceRemovedEvent: 1692039971.503403, bd8358d9-7e5c-42fb-97bc-928a7e02d146 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73078) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-71994647-c3e0-437c-a39c-fc674fe0ed5a tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bd8358d9-7e5c-42fb-97bc-928a7e02d146 {{(pid=73078) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 19:06:11 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-71994647-c3e0-437c-a39c-fc674fe0ed5a tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Successfully detached device vdb from instance bd8358d9-7e5c-42fb-97bc-928a7e02d146 from the live domain config.
Aug 14 19:06:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71994647-c3e0-437c-a39c-fc674fe0ed5a tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-71994647-c3e0-437c-a39c-fc674fe0ed5a tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXWDjCkz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:06:11 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-71994647-c3e0-437c-a39c-fc674fe0ed5a tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:06:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-71994647-c3e0-437c-a39c-fc674fe0ed5a tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-71994647-c3e0-437c-a39c-fc674fe0ed5a tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-71994647-c3e0-437c-a39c-fc674fe0ed5a tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ab7745-fbd4-47fe-adf5-000ca08f49b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[059cde50-2637-4876-aa69-bf036b2101da]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-71994647-c3e0-437c-a39c-fc674fe0ed5a tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e (non-flash)
Aug 14 19:06:11 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-71994647-c3e0-437c-a39c-fc674fe0ed5a tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e (non-flash)
Aug 14 19:06:11 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-71994647-c3e0-437c-a39c-fc674fe0ed5a tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe97828fc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e'): ({'sdb'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-71994647-c3e0-437c-a39c-fc674fe0ed5a tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Removing single pathed devices sdb {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7522c402-75dc-499f-8928-758ffae4a4f9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f3eefb-f704-4345-9a8b-4dd0d9d402d0]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-71994647-c3e0-437c-a39c-fc674fe0ed5a tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Flushing IO for device /dev/sdb {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf009c7-1b88-45ac-9b25-9a58cf26e0e7]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-71994647-c3e0-437c-a39c-fc674fe0ed5a tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[14785a48-04bd-4687-bd54-653439c3520d]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-71994647-c3e0-437c-a39c-fc674fe0ed5a tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-71994647-c3e0-437c-a39c-fc674fe0ed5a tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] SCSI volumes sdb have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-71994647-c3e0-437c-a39c-fc674fe0ed5a tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eff6919-65aa-48ed-9e2d-5c3f572fa6c5]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-71994647-c3e0-437c-a39c-fc674fe0ed5a tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2eb448-f80e-4783-8c47-7c068dbdc6ce]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-71994647-c3e0-437c-a39c-fc674fe0ed5a tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e, portal: 172.16.0.220,3260]
Aug 14 19:06:11 user nova-compute[73078]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e, portal: 172.16.0.220,3260] successful.
Aug 14 19:06:11 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e283f035-7f90-4197-998c-2f87ae15f35e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[09dff75f-387d-457b-a7be-4a7568105c63]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-71994647-c3e0-437c-a39c-fc674fe0ed5a tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-71994647-c3e0-437c-a39c-fc674fe0ed5a tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.260s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-71994647-c3e0-437c-a39c-fc674fe0ed5a tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] <== disconnect_volume: return (262ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:06:11 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71994647-c3e0-437c-a39c-fc674fe0ed5a tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:06:12 user nova-compute[73078]: DEBUG nova.objects.instance [None req-71994647-c3e0-437c-a39c-fc674fe0ed5a tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lazy-loading 'flavor' on Instance uuid bd8358d9-7e5c-42fb-97bc-928a7e02d146 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:06:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-71994647-c3e0-437c-a39c-fc674fe0ed5a tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.531s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:06:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:06:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:06:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:06:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:06:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:06:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:06:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:06:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:06:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:06:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:06:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:06:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:06:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:06:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:06:30 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:06:30 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 19:06:30 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Rebuilding the list of instances to heal {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 19:06:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-bd8358d9-7e5c-42fb-97bc-928a7e02d146" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:06:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-bd8358d9-7e5c-42fb-97bc-928a7e02d146" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:06:30 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 19:06:30 user nova-compute[73078]: DEBUG nova.objects.instance [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lazy-loading 'info_cache' on Instance uuid bd8358d9-7e5c-42fb-97bc-928a7e02d146 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:06:30 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Updating instance_info_cache with network_info: [{"id": "fbc9cc5e-b965-459c-b461-dba3ec52a876", "address": "fa:16:3e:b0:49:bf", "network": {"id": "9e2aecd4-1e26-40ca-bc82-d84e3437e58a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-657604143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fd49ab1f5444559f1da52c6249c12e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbc9cc5e-b9", "ovs_interfaceid": "fbc9cc5e-b965-459c-b461-dba3ec52a876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:06:30 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-bd8358d9-7e5c-42fb-97bc-928a7e02d146" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:06:30 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 19:06:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:06:35 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:06:35 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:06:36 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:06:36 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:06:36 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 19:06:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:06:37 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:06:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:06:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:06:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:06:37 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 19:06:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:06:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:06:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:06:37 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:06:37 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:06:37 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:06:37 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=8758MB free_disk=25.015056610107422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 19:06:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:06:37 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:06:38 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance bd8358d9-7e5c-42fb-97bc-928a7e02d146 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:06:38 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 19:06:38 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 19:06:38 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:06:38 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:06:38 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 19:06:38 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:06:39 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:06:39 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:06:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:06:44 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:06:45 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:06:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:06:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:06:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:06:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:06:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:06:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:06:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:06:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:06:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:06:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:06:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:06:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:06:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:07:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:07:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:07:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:07:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:07:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:07:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:07:05 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Acquiring lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:07:05 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:07:05 user nova-compute[73078]: DEBUG nova.objects.instance [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lazy-loading 'flavor' on Instance uuid bd8358d9-7e5c-42fb-97bc-928a7e02d146 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:07:05 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:07:05 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Acquiring lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:07:05 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:07:05 user nova-compute[73078]: INFO nova.compute.manager [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Attaching volume e4500720-72f1-43cc-a710-90351414c411 to /dev/vdb
Aug 14 19:07:05 user nova-compute[73078]: DEBUG os_brick.utils [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:07:05 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:07:05 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:07:05 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8839433f-35fb-4aeb-8b7c-d3106fdad0f5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:07:05 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:07:05 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:07:05 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9299eb-523b-40c3-a4e8-7a88e46f7591]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:07:05 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:07:05 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:07:05 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcd4b2a-f022-4197-b639-2ec4191cd2b4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:07:05 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[b375816f-cb9b-4411-8c27-dac36dd75196]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:07:05 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:07:05 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:07:05 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:07:05 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:07:05 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:07:05 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:07:05 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c401bd9-060b-4abc-a19a-2dc50ed5b22a]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:07:05 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:07:05 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:07:05 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:07:05 user nova-compute[73078]: DEBUG os_brick.utils [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:07:05 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Updating existing volume attachment record: a6a9b92a-e631-4802-aa58-30c980ea81d7 {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 19:07:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:07:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:07:09 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:07:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:07:13 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:07:13 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gOCyTvUH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:07:13 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:07:13 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:07:13 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:07:13 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:07:13 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:07:13 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:07:13 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:07:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:07:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:07:13 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[951e1e65-75fe-44a5-ba94-121c90c99261]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:07:13 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:07:13 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:07:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:07:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:07:13 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[656352f8-a603-41b5-8611-2b3e13df5d8b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:07:13 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411] added
Aug 14 19:07:13 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:07:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:07:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:07:13 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a137898-6149-4cdc-b869-39cd3808d031]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:07:13 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:07:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:07:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:07:13 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40f44d7-4cb1-4974-b8c0-d04a9993c6f8]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:07:13 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:07:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gOCyTvUH {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:07:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gOCyTvUH" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:07:13 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[915075e4-bf91-4e76-8517-2a6def4fdc21]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:07:13 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gOCyTvUH'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:07:13 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:07:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:07:14 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b976b7b-b785-450e-8610-4636588eb55e]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:07:14 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:07:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:07:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:07:14 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cff7b82-3eec-4b5a-bfcb-9cd5cbfcba30]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:07:14 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 19:07:14 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:07:14 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 19:07:14 user nova-compute[73078]:  {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:07:14 user nova-compute[73078]: WARNING os_brick.initiator.connectors.iscsi [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 19:07:14 user nova-compute[73078]: 
Aug 14 19:07:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:07:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:07:14 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8596e2ef-7006-4d83-8381-a7ed0908ed77]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:07:14 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411, portal: 172.16.0.220,3260]
Aug 14 19:07:14 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411, portal: 172.16.0.220,3260] successful.
Aug 14 19:07:14 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:07:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:07:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:07:14 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed10f00-f9de-4334-9315-b9c70077e634]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:07:14 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:07:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:07:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:07:14 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0c7df7-0372-4236-bc8f-2d404c6d2d7f]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:07:14 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411 (non-flash)
Aug 14 19:07:14 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:07:14 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411 (non-flash)
Aug 14 19:07:14 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:07:14 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:07:14 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:07:14 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:07:14 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:07:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:07:14 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:07:14 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cea0b6b-67f3-445d-a133-efa50297a8ca]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:07:14 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:07:15 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:07:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gOCyTvUH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:07:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:07:15 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23962623935653665', 'path': '/dev/sdb'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:07:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962623935653665', 'path': '/dev/sdb'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:07:15 user nova-compute[73078]: DEBUG nova.objects.instance [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lazy-loading 'flavor' on Instance uuid bd8358d9-7e5c-42fb-97bc-928a7e02d146 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:07:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 19:07:15 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:07:15 user nova-compute[73078]:   <source dev="/dev/sdb"/>
Aug 14 19:07:15 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:07:15 user nova-compute[73078]:   <serial>e4500720-72f1-43cc-a710-90351414c411</serial>
Aug 14 19:07:15 user nova-compute[73078]: </disk>
Aug 14 19:07:15 user nova-compute[73078]:  {{(pid=73078) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 19:07:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:07:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:07:15 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] No VIF found with MAC fa:16:3e:b0:49:bf, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:07:15 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-2e1bce96-b3aa-48ec-86aa-2819e36d5b36 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.295s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:07:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:07:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-256e4afe-b427-4a67-a360-d2013a0e39b2 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Acquiring lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:07:17 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-256e4afe-b427-4a67-a360-d2013a0e39b2 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:07:17 user nova-compute[73078]: INFO nova.compute.manager [None req-256e4afe-b427-4a67-a360-d2013a0e39b2 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Detaching volume e4500720-72f1-43cc-a710-90351414c411
Aug 14 19:07:17 user nova-compute[73078]: INFO nova.virt.block_device [None req-256e4afe-b427-4a67-a360-d2013a0e39b2 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Attempting to driver detach volume e4500720-72f1-43cc-a710-90351414c411 from mountpoint /dev/vdb
Aug 14 19:07:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-256e4afe-b427-4a67-a360-d2013a0e39b2 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Attempting to detach device vdb from instance bd8358d9-7e5c-42fb-97bc-928a7e02d146 from the persistent domain config. {{(pid=73078) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 19:07:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-256e4afe-b427-4a67-a360-d2013a0e39b2 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:07:17 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:07:17 user nova-compute[73078]:   <source dev="/dev/sdb"/>
Aug 14 19:07:17 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:07:17 user nova-compute[73078]:   <serial>e4500720-72f1-43cc-a710-90351414c411</serial>
Aug 14 19:07:17 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 19:07:17 user nova-compute[73078]: </disk>
Aug 14 19:07:17 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:07:17 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-256e4afe-b427-4a67-a360-d2013a0e39b2 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Successfully detached device vdb from instance bd8358d9-7e5c-42fb-97bc-928a7e02d146 from the persistent domain config.
Aug 14 19:07:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-256e4afe-b427-4a67-a360-d2013a0e39b2 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bd8358d9-7e5c-42fb-97bc-928a7e02d146 from the live domain config. {{(pid=73078) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 19:07:17 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-256e4afe-b427-4a67-a360-d2013a0e39b2 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:07:17 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:07:17 user nova-compute[73078]:   <source dev="/dev/sdb"/>
Aug 14 19:07:17 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:07:17 user nova-compute[73078]:   <serial>e4500720-72f1-43cc-a710-90351414c411</serial>
Aug 14 19:07:17 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 19:07:17 user nova-compute[73078]: </disk>
Aug 14 19:07:17 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Received event <DeviceRemovedEvent: 1692040038.3435643, bd8358d9-7e5c-42fb-97bc-928a7e02d146 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73078) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-256e4afe-b427-4a67-a360-d2013a0e39b2 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bd8358d9-7e5c-42fb-97bc-928a7e02d146 {{(pid=73078) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 19:07:18 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-256e4afe-b427-4a67-a360-d2013a0e39b2 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Successfully detached device vdb from instance bd8358d9-7e5c-42fb-97bc-928a7e02d146 from the live domain config.
Aug 14 19:07:18 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-256e4afe-b427-4a67-a360-d2013a0e39b2 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-256e4afe-b427-4a67-a360-d2013a0e39b2 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gOCyTvUH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:07:18 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-256e4afe-b427-4a67-a360-d2013a0e39b2 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:07:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-256e4afe-b427-4a67-a360-d2013a0e39b2 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-256e4afe-b427-4a67-a360-d2013a0e39b2 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-256e4afe-b427-4a67-a360-d2013a0e39b2 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5b9b9c-bb16-4dd2-a0dc-5c9c3933d660]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef816988-53f4-442f-8d31-77bfa8cd47af]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-256e4afe-b427-4a67-a360-d2013a0e39b2 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411 (non-flash)
Aug 14 19:07:18 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-256e4afe-b427-4a67-a360-d2013a0e39b2 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411 (non-flash)
Aug 14 19:07:18 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-256e4afe-b427-4a67-a360-d2013a0e39b2 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9881fa4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411'): ({'sdb'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-256e4afe-b427-4a67-a360-d2013a0e39b2 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Removing single pathed devices sdb {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[513f0c3a-ce21-421b-a46d-40712a563ac3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[6676728c-0f1f-41b5-806e-df419555a3b8]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-256e4afe-b427-4a67-a360-d2013a0e39b2 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Flushing IO for device /dev/sdb {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[3738bd2b-25c6-4d3c-aebf-0b0d8bf4439f]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-256e4afe-b427-4a67-a360-d2013a0e39b2 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[419d294e-a0c8-4f8d-94f3-994a4cb1bc62]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-256e4afe-b427-4a67-a360-d2013a0e39b2 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-256e4afe-b427-4a67-a360-d2013a0e39b2 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] SCSI volumes sdb have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-256e4afe-b427-4a67-a360-d2013a0e39b2 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1caa2266-d4bf-48a2-a7c1-fbe1b42e871c]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-256e4afe-b427-4a67-a360-d2013a0e39b2 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e19e52-a30e-4004-b78e-f7fb4c53edf4]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-256e4afe-b427-4a67-a360-d2013a0e39b2 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411, portal: 172.16.0.220,3260]
Aug 14 19:07:18 user nova-compute[73078]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411, portal: 172.16.0.220,3260] successful.
Aug 14 19:07:18 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4500720-72f1-43cc-a710-90351414c411 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46e25b8-ca69-45d2-9add-72f8caee6e74]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-256e4afe-b427-4a67-a360-d2013a0e39b2 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-256e4afe-b427-4a67-a360-d2013a0e39b2 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.252s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-256e4afe-b427-4a67-a360-d2013a0e39b2 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] <== disconnect_volume: return (252ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:07:18 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-256e4afe-b427-4a67-a360-d2013a0e39b2 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:07:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:07:19 user nova-compute[73078]: DEBUG nova.objects.instance [None req-256e4afe-b427-4a67-a360-d2013a0e39b2 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lazy-loading 'flavor' on Instance uuid bd8358d9-7e5c-42fb-97bc-928a7e02d146 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:07:19 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-256e4afe-b427-4a67-a360-d2013a0e39b2 tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.540s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:07:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:07:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:07:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:07:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:07:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:07:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:07:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:07:29 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:07:31 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:07:31 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 19:07:31 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Rebuilding the list of instances to heal {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 19:07:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-bd8358d9-7e5c-42fb-97bc-928a7e02d146" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:07:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-bd8358d9-7e5c-42fb-97bc-928a7e02d146" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:07:31 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 19:07:31 user nova-compute[73078]: DEBUG nova.objects.instance [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lazy-loading 'info_cache' on Instance uuid bd8358d9-7e5c-42fb-97bc-928a7e02d146 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:07:31 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Updating instance_info_cache with network_info: [{"id": "fbc9cc5e-b965-459c-b461-dba3ec52a876", "address": "fa:16:3e:b0:49:bf", "network": {"id": "9e2aecd4-1e26-40ca-bc82-d84e3437e58a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-657604143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fd49ab1f5444559f1da52c6249c12e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbc9cc5e-b9", "ovs_interfaceid": "fbc9cc5e-b965-459c-b461-dba3ec52a876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:07:31 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-bd8358d9-7e5c-42fb-97bc-928a7e02d146" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:07:31 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 19:07:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:07:35 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:07:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:07:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:07:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:07:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:07:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:07:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:07:37 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:07:37 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:07:37 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 19:07:38 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:07:39 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:07:39 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:07:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:07:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:07:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:07:39 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 19:07:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:07:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:07:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:07:39 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:07:39 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:07:39 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:07:39 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=8785MB free_disk=25.00629425048828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 19:07:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:07:39 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:07:40 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance bd8358d9-7e5c-42fb-97bc-928a7e02d146 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:07:40 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 19:07:40 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 19:07:40 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Refreshing inventories for resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 19:07:40 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Updating ProviderTree inventory for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 19:07:40 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Updating inventory in ProviderTree for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 19:07:40 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Refreshing aggregate associations for resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b, aggregates: None {{(pid=73078) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 19:07:40 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Refreshing trait associations for resource provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV {{(pid=73078) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 19:07:40 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:07:40 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:07:40 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 19:07:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.350s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:07:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:07:45 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:07:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:07:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:07:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:07:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:07:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:07:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:07:47 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:07:48 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:07:48 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Triggering sync for uuid bd8358d9-7e5c-42fb-97bc-928a7e02d146 {{(pid=73078) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 19:07:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:07:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:07:48 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:07:50 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:07:50 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73078) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 19:07:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:07:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:07:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:07:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:07:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:07:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:07:55 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:07:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:07:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:07:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:07:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:07:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:07:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:07:57 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:07:57 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Cleaning up deleted instances {{(pid=73078) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 19:07:57 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] There are 0 instances to clean {{(pid=73078) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 19:08:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:08:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:08:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:08:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:08:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:08:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:08:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:08:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:08:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:08:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:08:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:08:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:08:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:08:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Acquiring lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:08:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:08:12 user nova-compute[73078]: DEBUG nova.objects.instance [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lazy-loading 'flavor' on Instance uuid bd8358d9-7e5c-42fb-97bc-928a7e02d146 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:08:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:08:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Acquiring lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:08:12 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:08:12 user nova-compute[73078]: INFO nova.compute.manager [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Attaching volume 6687682f-0258-4088-a163-c82846138f31 to /dev/vdb
Aug 14 19:08:12 user nova-compute[73078]: DEBUG os_brick.utils [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:08:12 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:08:12 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:08:12 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[214bd7d1-046e-42d5-a706-381a669db649]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2e3164f1f8a2\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:08:12 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:08:12 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:08:12 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb50206-2c0b-4dc1-82ba-2169b3af262d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:08:12 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:08:12 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:08:12 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fd9595-7c72-42e0-93ae-79ab1f8d5b22]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:08:12 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8aa006-f18c-4f79-bba1-d9270a86c418]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:08:12 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Running cmd (subprocess): nvme version {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:08:12 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] 'nvme version' failed. Not Retrying. {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:08:12 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] nvme not present on system {{(pid=73078) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 19:08:12 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:08:12 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 19:08:12 user nova-compute[73078]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 19:08:12 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[347d20a7-e2e7-4866-8d17-e717a21337cb]: (4, '') {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:08:12 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73078) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 19:08:12 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 19:08:12 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.lightos [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] LIGHTOS: no hostnqn found. {{(pid=73078) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 19:08:12 user nova-compute[73078]: DEBUG os_brick.utils [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2e3164f1f8a2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:08:12 user nova-compute[73078]: DEBUG nova.virt.block_device [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Updating existing volume attachment record: e66d3388-ff34-4e10-99d0-e20a85a1ddba {{(pid=73078) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 19:08:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:08:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Calling os-brick to attach iSCSI Volume {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EfeKadlj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:08:20 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:08:20 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:08:20 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:08:20 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:08:20 user nova-compute[73078]: INFO os_brick.initiator.connectors.iscsi [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 19:08:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31 -p 172.16.0.220:3260 {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60e6c9f-fa5c-4dd2-8a07-02eda7ef32a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 19:08:20 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31 -p 172.16.0.220:3260 --interface default --op new {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cff05a1-a759-4dbd-908f-ca2c4c061dc9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31] added\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31] added
Aug 14 19:08:20 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c5ed86-c783-428c-b4f3-6dd470068a75]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e1fb7d-14ad-4621-a5c2-de0c2a6c8696]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EfeKadlj {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EfeKadlj" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e3a028-002c-490f-bc9e-59e8789d1a5b]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EfeKadlj'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f5f9fc-33bc-428f-935c-f3545c0c1feb]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0e934c-ceb6-466a-bdf6-ee41e7877ee4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 19:08:20 user nova-compute[73078]:  {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 19:08:20 user nova-compute[73078]:  {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:08:20 user nova-compute[73078]: WARNING os_brick.initiator.connectors.iscsi [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 19:08:20 user nova-compute[73078]: 
Aug 14 19:08:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31 -p 172.16.0.220:3260 --login {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a6ae0c-7eec-4a51-8818-2e742b61fd11]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31, portal: 172.16.0.220,3260]
Aug 14 19:08:20 user nova-compute[73078]: Login to [iface: default, target: iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31, portal: 172.16.0.220,3260] successful.
Aug 14 19:08:20 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded34358-6489-434e-8b8b-8083b59521a2]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee11bad-880a-42a4-931e-445f0febf4a1]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31 (non-flash)
Aug 14 19:08:20 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31 (non-flash)
Aug 14 19:08:20 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Connected to 172.16.0.220:3260 {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=73078) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73078) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[821f850f-e192-4a4a-b27f-bc83708ed978]: (4, ('- - 0', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73078) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 19:08:20 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EfeKadlj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73078) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 19:08:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:08:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:08:21 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26666333336356231', 'path': '/dev/sdb'} {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:08:21 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666333336356231', 'path': '/dev/sdb'} {{(pid=73078) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 19:08:21 user nova-compute[73078]: DEBUG nova.objects.instance [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lazy-loading 'flavor' on Instance uuid bd8358d9-7e5c-42fb-97bc-928a7e02d146 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:08:22 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 19:08:22 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:08:22 user nova-compute[73078]:   <source dev="/dev/sdb"/>
Aug 14 19:08:22 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:08:22 user nova-compute[73078]:   <serial>6687682f-0258-4088-a163-c82846138f31</serial>
Aug 14 19:08:22 user nova-compute[73078]: </disk>
Aug 14 19:08:22 user nova-compute[73078]:  {{(pid=73078) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 19:08:22 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] No BDM found with device name vda, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:08:22 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73078) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 19:08:22 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] No VIF found with MAC fa:16:3e:b0:49:bf, not building metadata {{(pid=73078) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 19:08:22 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d1afbc71-faaf-492e-a41d-990eadad8bbd tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.336s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:08:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:08:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-7bf6979c-4ed9-4846-8ebe-960b42cf725b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Acquiring lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:08:24 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-7bf6979c-4ed9-4846-8ebe-960b42cf725b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:08:24 user nova-compute[73078]: INFO nova.compute.manager [None req-7bf6979c-4ed9-4846-8ebe-960b42cf725b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Detaching volume 6687682f-0258-4088-a163-c82846138f31
Aug 14 19:08:24 user nova-compute[73078]: INFO nova.virt.block_device [None req-7bf6979c-4ed9-4846-8ebe-960b42cf725b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Attempting to driver detach volume 6687682f-0258-4088-a163-c82846138f31 from mountpoint /dev/vdb
Aug 14 19:08:24 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-7bf6979c-4ed9-4846-8ebe-960b42cf725b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Attempting to detach device vdb from instance bd8358d9-7e5c-42fb-97bc-928a7e02d146 from the persistent domain config. {{(pid=73078) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 19:08:24 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-7bf6979c-4ed9-4846-8ebe-960b42cf725b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:08:24 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:08:24 user nova-compute[73078]:   <source dev="/dev/sdb"/>
Aug 14 19:08:24 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:08:24 user nova-compute[73078]:   <serial>6687682f-0258-4088-a163-c82846138f31</serial>
Aug 14 19:08:24 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 19:08:24 user nova-compute[73078]: </disk>
Aug 14 19:08:24 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:08:24 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-7bf6979c-4ed9-4846-8ebe-960b42cf725b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Successfully detached device vdb from instance bd8358d9-7e5c-42fb-97bc-928a7e02d146 from the persistent domain config.
Aug 14 19:08:24 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-7bf6979c-4ed9-4846-8ebe-960b42cf725b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bd8358d9-7e5c-42fb-97bc-928a7e02d146 from the live domain config. {{(pid=73078) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 19:08:24 user nova-compute[73078]: DEBUG nova.virt.libvirt.guest [None req-7bf6979c-4ed9-4846-8ebe-960b42cf725b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 19:08:24 user nova-compute[73078]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 19:08:24 user nova-compute[73078]:   <source dev="/dev/sdb"/>
Aug 14 19:08:24 user nova-compute[73078]:   <target dev="vdb" bus="virtio"/>
Aug 14 19:08:24 user nova-compute[73078]:   <serial>6687682f-0258-4088-a163-c82846138f31</serial>
Aug 14 19:08:24 user nova-compute[73078]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 19:08:24 user nova-compute[73078]: </disk>
Aug 14 19:08:24 user nova-compute[73078]:  {{(pid=73078) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-63e59d8b-8563-4c92-823a-ad3054cba997 None None] Received event <DeviceRemovedEvent: 1692040105.220547, bd8358d9-7e5c-42fb-97bc-928a7e02d146 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73078) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.driver [None req-7bf6979c-4ed9-4846-8ebe-960b42cf725b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bd8358d9-7e5c-42fb-97bc-928a7e02d146 {{(pid=73078) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 19:08:25 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-7bf6979c-4ed9-4846-8ebe-960b42cf725b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Successfully detached device vdb from instance bd8358d9-7e5c-42fb-97bc-928a7e02d146 from the live domain config.
Aug 14 19:08:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bf6979c-4ed9-4846-8ebe-960b42cf725b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] calling os-brick to detach iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bf6979c-4ed9-4846-8ebe-960b42cf725b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9786e8ca0>, {'target_iqns': ['iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EfeKadlj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 19:08:25 user nova-compute[73078]: WARNING os_brick.initiator.connectors.base [None req-7bf6979c-4ed9-4846-8ebe-960b42cf725b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 19:08:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-7bf6979c-4ed9-4846-8ebe-960b42cf725b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-7bf6979c-4ed9-4846-8ebe-960b42cf725b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bf6979c-4ed9-4846-8ebe-960b42cf725b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31', 0)] {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0f29e8-e057-47e7-ac4f-4e0de413fe39]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2d4621-be08-4ac7-a5be-39a9ab3964da]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31 (non-flash)\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bf6979c-4ed9-4846-8ebe-960b42cf725b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31 (non-flash)
Aug 14 19:08:25 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bf6979c-4ed9-4846-8ebe-960b42cf725b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31 (non-flash)
Aug 14 19:08:25 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bf6979c-4ed9-4846-8ebe-960b42cf725b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9880f7250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31'): ({'sdb'}, set())}) {{(pid=73078) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-7bf6979c-4ed9-4846-8ebe-960b42cf725b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Removing single pathed devices sdb {{(pid=73078) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[672fbe78-b20a-4400-bf2b-08b942db22a2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[480ea13b-9801-45d5-813f-825004efe20a]: (4, ('ok\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-7bf6979c-4ed9-4846-8ebe-960b42cf725b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Flushing IO for device /dev/sdb {{(pid=73078) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2dd9b2-7447-4c25-b179-f1bdafb31cc6]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-7bf6979c-4ed9-4846-8ebe-960b42cf725b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73078) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c74b79-b648-471c-ac5c-71794ec7b9eb]: (4, ('1', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-7bf6979c-4ed9-4846-8ebe-960b42cf725b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG os_brick.initiator.linuxscsi [None req-7bf6979c-4ed9-4846-8ebe-960b42cf725b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] SCSI volumes sdb have been removed. {{(pid=73078) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bf6979c-4ed9-4846-8ebe-960b42cf725b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31')] {{(pid=73078) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2aafc9-4bb1-4cd2-867e-41810d7f8b20]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bf6979c-4ed9-4846-8ebe-960b42cf725b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31 -p 172.16.0.220:3260 --logout {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea17f0e-e20b-446a-af74-f9916876ec1c]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bf6979c-4ed9-4846-8ebe-960b42cf725b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31, portal: 172.16.0.220,3260]
Aug 14 19:08:25 user nova-compute[73078]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31, portal: 172.16.0.220,3260] successful.
Aug 14 19:08:25 user nova-compute[73078]:  stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31 -p 172.16.0.220:3260 --op delete {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6687682f-0258-4088-a163-c82846138f31 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84732) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cb863c-d36e-458f-8bca-7acd05280d5b]: (4, ('', '')) {{(pid=84732) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bf6979c-4ed9-4846-8ebe-960b42cf725b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73078) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.base [None req-7bf6979c-4ed9-4846-8ebe-960b42cf725b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bf6979c-4ed9-4846-8ebe-960b42cf725b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] <== disconnect_volume: return (287ms) None {{(pid=73078) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 19:08:25 user nova-compute[73078]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bf6979c-4ed9-4846-8ebe-960b42cf725b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Disconnected iSCSI Volume {{(pid=73078) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 19:08:26 user nova-compute[73078]: DEBUG nova.objects.instance [None req-7bf6979c-4ed9-4846-8ebe-960b42cf725b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lazy-loading 'flavor' on Instance uuid bd8358d9-7e5c-42fb-97bc-928a7e02d146 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:08:26 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-7bf6979c-4ed9-4846-8ebe-960b42cf725b tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.619s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:08:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:08:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:08:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:08:33 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:08:33 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 19:08:33 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Rebuilding the list of instances to heal {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 19:08:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-bd8358d9-7e5c-42fb-97bc-928a7e02d146" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:08:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-bd8358d9-7e5c-42fb-97bc-928a7e02d146" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:08:33 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 19:08:33 user nova-compute[73078]: DEBUG nova.objects.instance [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lazy-loading 'info_cache' on Instance uuid bd8358d9-7e5c-42fb-97bc-928a7e02d146 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:08:33 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Updating instance_info_cache with network_info: [{"id": "fbc9cc5e-b965-459c-b461-dba3ec52a876", "address": "fa:16:3e:b0:49:bf", "network": {"id": "9e2aecd4-1e26-40ca-bc82-d84e3437e58a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-657604143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fd49ab1f5444559f1da52c6249c12e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbc9cc5e-b9", "ovs_interfaceid": "fbc9cc5e-b965-459c-b461-dba3ec52a876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:08:33 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-bd8358d9-7e5c-42fb-97bc-928a7e02d146" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:08:33 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 19:08:35 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:08:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:08:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:08:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:08:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:08:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:08:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:08:37 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:08:37 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 19:08:39 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:08:39 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:08:39 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:08:40 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:08:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:08:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:08:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:08:40 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 19:08:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:08:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:08:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:08:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:08:40 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:08:40 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:08:40 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=8774MB free_disk=25.005237579345703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 19:08:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:08:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:08:41 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance bd8358d9-7e5c-42fb-97bc-928a7e02d146 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:08:41 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 19:08:41 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 19:08:41 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:08:41 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:08:41 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 19:08:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:08:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:08:45 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:08:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:08:48 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:08:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:08:56 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:09:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:09:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:09:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:09:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:09:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:09:01 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:09:06 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:09:11 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:09:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:09:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:09:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:09:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:09:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:09:16 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:09:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:09:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:09:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:09:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:09:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:09:21 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:09:26 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:09:31 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:09:35 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:09:35 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 19:09:35 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Rebuilding the list of instances to heal {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 19:09:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "refresh_cache-bd8358d9-7e5c-42fb-97bc-928a7e02d146" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 19:09:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquired lock "refresh_cache-bd8358d9-7e5c-42fb-97bc-928a7e02d146" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 19:09:35 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Forcefully refreshing network info cache for instance {{(pid=73078) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 19:09:35 user nova-compute[73078]: DEBUG nova.objects.instance [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lazy-loading 'info_cache' on Instance uuid bd8358d9-7e5c-42fb-97bc-928a7e02d146 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:09:35 user nova-compute[73078]: DEBUG nova.network.neutron [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Updating instance_info_cache with network_info: [{"id": "fbc9cc5e-b965-459c-b461-dba3ec52a876", "address": "fa:16:3e:b0:49:bf", "network": {"id": "9e2aecd4-1e26-40ca-bc82-d84e3437e58a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-657604143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fd49ab1f5444559f1da52c6249c12e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbc9cc5e-b9", "ovs_interfaceid": "fbc9cc5e-b965-459c-b461-dba3ec52a876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:09:35 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Releasing lock "refresh_cache-bd8358d9-7e5c-42fb-97bc-928a7e02d146" {{(pid=73078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 19:09:35 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Updated the network info_cache for instance {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 19:09:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:09:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:09:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:09:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:09:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:09:36 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:09:37 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:09:39 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:09:39 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:09:39 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:09:39 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 19:09:40 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:09:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:09:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:09:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:09:40 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 19:09:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:09:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:09:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk --force-share --output=json {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 19:09:40 user nova-compute[73078]: DEBUG oslo_concurrency.processutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 19:09:41 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:09:41 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:09:41 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=8798MB free_disk=24.99853515625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 19:09:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:09:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:09:41 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Instance bd8358d9-7e5c-42fb-97bc-928a7e02d146 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73078) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 19:09:41 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 19:09:41 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 19:09:41 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:09:41 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:09:41 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 19:09:41 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:09:41 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:09:42 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:09:45 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:09:46 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:09:48 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:09:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:09:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d6e463e0-596a-420c-9855-c1907e7c6bbc tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Acquiring lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:09:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d6e463e0-596a-420c-9855-c1907e7c6bbc tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:09:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d6e463e0-596a-420c-9855-c1907e7c6bbc tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Acquiring lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:09:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d6e463e0-596a-420c-9855-c1907e7c6bbc tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:09:53 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d6e463e0-596a-420c-9855-c1907e7c6bbc tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:09:53 user nova-compute[73078]: INFO nova.compute.manager [None req-d6e463e0-596a-420c-9855-c1907e7c6bbc tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Terminating instance
Aug 14 19:09:53 user nova-compute[73078]: DEBUG nova.compute.manager [None req-d6e463e0-596a-420c-9855-c1907e7c6bbc tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Start destroying the instance on the hypervisor. {{(pid=73078) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 19:09:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:09:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:09:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:09:53 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:09:54 user nova-compute[73078]: DEBUG nova.compute.manager [req-0926687b-2712-43f3-a1a7-4c877b2f159f req-1cb3b5c7-ba0e-43f8-9686-4283d649a5ae service nova] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Received event network-vif-unplugged-fbc9cc5e-b965-459c-b461-dba3ec52a876 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:09:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0926687b-2712-43f3-a1a7-4c877b2f159f req-1cb3b5c7-ba0e-43f8-9686-4283d649a5ae service nova] Acquiring lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:09:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0926687b-2712-43f3-a1a7-4c877b2f159f req-1cb3b5c7-ba0e-43f8-9686-4283d649a5ae service nova] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:09:54 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-0926687b-2712-43f3-a1a7-4c877b2f159f req-1cb3b5c7-ba0e-43f8-9686-4283d649a5ae service nova] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:09:54 user nova-compute[73078]: DEBUG nova.compute.manager [req-0926687b-2712-43f3-a1a7-4c877b2f159f req-1cb3b5c7-ba0e-43f8-9686-4283d649a5ae service nova] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] No waiting events found dispatching network-vif-unplugged-fbc9cc5e-b965-459c-b461-dba3ec52a876 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:09:54 user nova-compute[73078]: DEBUG nova.compute.manager [req-0926687b-2712-43f3-a1a7-4c877b2f159f req-1cb3b5c7-ba0e-43f8-9686-4283d649a5ae service nova] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Received event network-vif-unplugged-fbc9cc5e-b965-459c-b461-dba3ec52a876 for instance with task_state deleting. {{(pid=73078) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 19:09:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:09:54 user nova-compute[73078]: INFO nova.virt.libvirt.driver [-] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Instance destroyed successfully.
Aug 14 19:09:54 user nova-compute[73078]: DEBUG nova.objects.instance [None req-d6e463e0-596a-420c-9855-c1907e7c6bbc tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lazy-loading 'resources' on Instance uuid bd8358d9-7e5c-42fb-97bc-928a7e02d146 {{(pid=73078) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 19:09:54 user nova-compute[73078]: DEBUG nova.virt.libvirt.vif [None req-d6e463e0-596a-420c-9855-c1907e7c6bbc tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T19:02:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-48135591',display_name='tempest-SnapshotDataIntegrityTests-server-48135591',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-48135591',id=53,image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTmlzPrOTAyXidxA/SNzVi12sJ5nn5tCpvS8IKyzapouxtzrNwTvCJs59+DAdRkk1zIaOM7ob3Vl6GEjD8/GWrDXtZyNguEJuccYFa4QbYTioSjCxIEGPjyKSJ0O+KRgg==',key_name='tempest-keypair-120437743',keypairs=<?>,launch_index=0,launched_at=2023-08-14T19:02:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b4fd49ab1f5444559f1da52c6249c12e',ramdisk_id='',reservation_id='r-myu06kgk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2cbd52c4-773f-4d5a-bbb1-b6f1221c7774',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1645157422',owner_user_name='tempest-SnapshotDataIntegrityTests-1645157422-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T19:02:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1378100bd4b4d7ebeb4ca2ef10339f6',uuid=bd8358d9-7e5c-42fb-97bc-928a7e02d146,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fbc9cc5e-b965-459c-b461-dba3ec52a876", "address": "fa:16:3e:b0:49:bf", "network": {"id": "9e2aecd4-1e26-40ca-bc82-d84e3437e58a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-657604143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fd49ab1f5444559f1da52c6249c12e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbc9cc5e-b9", "ovs_interfaceid": "fbc9cc5e-b965-459c-b461-dba3ec52a876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 19:09:54 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-d6e463e0-596a-420c-9855-c1907e7c6bbc tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Converting VIF {"id": "fbc9cc5e-b965-459c-b461-dba3ec52a876", "address": "fa:16:3e:b0:49:bf", "network": {"id": "9e2aecd4-1e26-40ca-bc82-d84e3437e58a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-657604143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4fd49ab1f5444559f1da52c6249c12e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbc9cc5e-b9", "ovs_interfaceid": "fbc9cc5e-b965-459c-b461-dba3ec52a876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 19:09:54 user nova-compute[73078]: DEBUG nova.network.os_vif_util [None req-d6e463e0-596a-420c-9855-c1907e7c6bbc tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:49:bf,bridge_name='br-int',has_traffic_filtering=True,id=fbc9cc5e-b965-459c-b461-dba3ec52a876,network=Network(9e2aecd4-1e26-40ca-bc82-d84e3437e58a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbc9cc5e-b9') {{(pid=73078) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 19:09:54 user nova-compute[73078]: DEBUG os_vif [None req-d6e463e0-596a-420c-9855-c1907e7c6bbc tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:49:bf,bridge_name='br-int',has_traffic_filtering=True,id=fbc9cc5e-b965-459c-b461-dba3ec52a876,network=Network(9e2aecd4-1e26-40ca-bc82-d84e3437e58a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbc9cc5e-b9') {{(pid=73078) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 19:09:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:09:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfbc9cc5e-b9, bridge=br-int, if_exists=True) {{(pid=73078) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 19:09:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:09:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:09:54 user nova-compute[73078]: INFO os_vif [None req-d6e463e0-596a-420c-9855-c1907e7c6bbc tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:49:bf,bridge_name='br-int',has_traffic_filtering=True,id=fbc9cc5e-b965-459c-b461-dba3ec52a876,network=Network(9e2aecd4-1e26-40ca-bc82-d84e3437e58a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbc9cc5e-b9')
Aug 14 19:09:54 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-d6e463e0-596a-420c-9855-c1907e7c6bbc tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Deleting instance files /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146_del
Aug 14 19:09:54 user nova-compute[73078]: INFO nova.virt.libvirt.driver [None req-d6e463e0-596a-420c-9855-c1907e7c6bbc tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Deletion of /opt/stack/data/nova/instances/bd8358d9-7e5c-42fb-97bc-928a7e02d146_del complete
Aug 14 19:09:54 user nova-compute[73078]: INFO nova.compute.manager [None req-d6e463e0-596a-420c-9855-c1907e7c6bbc tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Took 1.04 seconds to destroy the instance on the hypervisor.
Aug 14 19:09:54 user nova-compute[73078]: DEBUG oslo.service.loopingcall [None req-d6e463e0-596a-420c-9855-c1907e7c6bbc tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73078) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 19:09:54 user nova-compute[73078]: DEBUG nova.compute.manager [-] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Deallocating network for instance {{(pid=73078) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 19:09:54 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] deallocate_for_instance() {{(pid=73078) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 19:09:55 user nova-compute[73078]: DEBUG nova.network.neutron [-] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Updating instance_info_cache with network_info: [] {{(pid=73078) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 19:09:55 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Took 0.79 seconds to deallocate network for instance.
Aug 14 19:09:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d6e463e0-596a-420c-9855-c1907e7c6bbc tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:09:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d6e463e0-596a-420c-9855-c1907e7c6bbc tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:09:55 user nova-compute[73078]: DEBUG nova.compute.manager [req-8002011d-2092-4007-9ccc-2a5ec435e97e req-07f45987-c645-4dc5-8811-4c9ef91fa228 service nova] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Received event network-vif-deleted-fbc9cc5e-b965-459c-b461-dba3ec52a876 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:09:55 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-d6e463e0-596a-420c-9855-c1907e7c6bbc tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:09:55 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-d6e463e0-596a-420c-9855-c1907e7c6bbc tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:09:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d6e463e0-596a-420c-9855-c1907e7c6bbc tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.117s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:09:55 user nova-compute[73078]: INFO nova.scheduler.client.report [None req-d6e463e0-596a-420c-9855-c1907e7c6bbc tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Deleted allocations for instance bd8358d9-7e5c-42fb-97bc-928a7e02d146
Aug 14 19:09:55 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-d6e463e0-596a-420c-9855-c1907e7c6bbc tempest-SnapshotDataIntegrityTests-1645157422 tempest-SnapshotDataIntegrityTests-1645157422-project-member] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.135s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:09:56 user nova-compute[73078]: DEBUG nova.compute.manager [req-a3aac073-4ab0-4cb2-9b19-9036bbf68b00 req-4e421869-7b5f-43a9-9780-3072850a0ea9 service nova] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Received event network-vif-plugged-fbc9cc5e-b965-459c-b461-dba3ec52a876 {{(pid=73078) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 19:09:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a3aac073-4ab0-4cb2-9b19-9036bbf68b00 req-4e421869-7b5f-43a9-9780-3072850a0ea9 service nova] Acquiring lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:09:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a3aac073-4ab0-4cb2-9b19-9036bbf68b00 req-4e421869-7b5f-43a9-9780-3072850a0ea9 service nova] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:09:56 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [req-a3aac073-4ab0-4cb2-9b19-9036bbf68b00 req-4e421869-7b5f-43a9-9780-3072850a0ea9 service nova] Lock "bd8358d9-7e5c-42fb-97bc-928a7e02d146-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:09:56 user nova-compute[73078]: DEBUG nova.compute.manager [req-a3aac073-4ab0-4cb2-9b19-9036bbf68b00 req-4e421869-7b5f-43a9-9780-3072850a0ea9 service nova] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] No waiting events found dispatching network-vif-plugged-fbc9cc5e-b965-459c-b461-dba3ec52a876 {{(pid=73078) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 19:09:56 user nova-compute[73078]: WARNING nova.compute.manager [req-a3aac073-4ab0-4cb2-9b19-9036bbf68b00 req-4e421869-7b5f-43a9-9780-3072850a0ea9 service nova] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Received unexpected event network-vif-plugged-fbc9cc5e-b965-459c-b461-dba3ec52a876 for instance with vm_state deleted and task_state None.
Aug 14 19:09:57 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:09:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:10:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:10:09 user nova-compute[73078]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692040194.689358, bd8358d9-7e5c-42fb-97bc-928a7e02d146 => Stopped> {{(pid=73078) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 19:10:09 user nova-compute[73078]: INFO nova.compute.manager [-] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] VM Stopped (Lifecycle Event)
Aug 14 19:10:09 user nova-compute[73078]: DEBUG nova.compute.manager [None req-1c9d2cef-30dd-4b53-9c58-705a4485283e None None] [instance: bd8358d9-7e5c-42fb-97bc-928a7e02d146] Checking state {{(pid=73078) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 19:10:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:10:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:10:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:10:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:10:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:10:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:10:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:10:19 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:10:24 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:10:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:10:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:10:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:10:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:10:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:10:29 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:10:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:10:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:10:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:10:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:10:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:10:34 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:10:36 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:10:36 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Starting heal instance info cache {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 19:10:36 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Rebuilding the list of instances to heal {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 19:10:36 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Didn't find any instances for network info cache update. {{(pid=73078) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 19:10:39 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:10:39 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:10:40 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:10:40 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:10:40 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:10:40 user nova-compute[73078]: DEBUG nova.compute.manager [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73078) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 19:10:40 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:10:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:10:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:10:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:10:40 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Auditing locally available compute resources for user (node: user) {{(pid=73078) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 19:10:40 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:10:40 user nova-compute[73078]: WARNING nova.virt.libvirt.driver [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 19:10:40 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Hypervisor/Node resource view: name=user free_ram=8930MB free_disk=25.025901794433594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73078) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 19:10:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 19:10:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 19:10:40 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 19:10:40 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73078) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 19:10:40 user nova-compute[73078]: DEBUG nova.compute.provider_tree [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed in ProviderTree for provider: af8baf5b-57ff-4012-bdc8-cc28446f0e7b {{(pid=73078) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 19:10:40 user nova-compute[73078]: DEBUG nova.scheduler.client.report [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Inventory has not changed for provider af8baf5b-57ff-4012-bdc8-cc28446f0e7b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73078) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 19:10:40 user nova-compute[73078]: DEBUG nova.compute.resource_tracker [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Compute_service record updated for user:user {{(pid=73078) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 19:10:40 user nova-compute[73078]: DEBUG oslo_concurrency.lockutils [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.319s {{(pid=73078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 19:10:41 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:10:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:10:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:10:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73078) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 19:10:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:10:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73078) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 19:10:44 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:10:45 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:10:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:10:47 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:10:49 user nova-compute[73078]: DEBUG oslo_service.periodic_task [None req-73c7a73d-9f3b-4f18-946a-d2626e97d0a6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73078) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 19:10:49 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:10:51 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:10:54 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:10:59 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:11:04 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 19:11:09 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 19:11:14 user nova-compute[73078]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73078) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}